The drinking water from the refrigerator's water dispenser is tainted with a chemical taste. How can I avoid that?

Drinking water should be used regularly to prevent it lying in the appliance for long periods.