I was going to suggest that maybe it's the sulfur smell, but you say it is not. Do you get the smell out of all fixtures? How about your neighbors, they have any problems?
Is it both hot and cold water? If hot only, how old is your water heater?
The orange is rust or iron in your water. Do you have galvanized steel pipes (gray silvery color) or copper or (some sort of) plastic?
Are you on well water or city water?