For things like milk I always give it a sniff and make a judgement before using, expiration be damned. One thing Chemda said that was okay was moldy bread, that's risky. The roots of the mold grow much deeper than just the surface fuzzy stuff.
There's handy chart that says what moldy foods are still okay
here