2. Turn on the faucet or shower where the water is “most rusty”, making sure you only run cold water. 3. If you still get rust-colored water, then the issue is with one of your plumbing pipes. Keep in mind though, that it’s possible that rust is present in both your plumbing and water heater. So, after step three, run the faucet or shower