How to pull the pump out depends on what type of pipe is hooked to it. If it's PVC the pipe will probably have to be cut and spiced back together to reinstall, unless there is already a coupling where it can be taken apart.
The check valve should be installed right above the pump.
I'm not sure what you mean about drilling through pavement? In a wood-framed house, the pipe exits above the sill plate, just underneath the first floor. Ideally it will exit on the downhill side of the house and then be piped at least 20 feet away from the foundation.
The area around the outside of the basin should be backfilled with crushed gravel. I also suggest wrapping the basin with landscaping cloth before you backfill, as this will act as a filter to keep dirt out of the basin.