PVC = for drains.
CVPC = for water supply.
I went through the same dilemma. I chose copper. BUT, CPVC is quite a bit less expensive (for a bathroom, though, it might save you about $25. Whoopieee!!!) Also, if you have room to leave access to the supply lines, replacements (if they're necessary) won't be a big deal.
Solvent connections for CVPC are less intimidating for those inexperienced with sweating copper. CPVC seems to have a bad reputation among serious plumbers, but around here a lot of new homes have used it without event.
Check, though, if yr local code allows it and allows it in basements, and allows it to be mixed w/ copper.