When you say, "all over", do you mean that spots are on all the weather seals? Or just on that one? Because you can replace these. If it's "all over" just one piece that is a practical move.
Meanwhile, PlastX by Meguiar's could be the right tool for the wrong job (it's dedicated clear plastic cleaner): I would try it if spots were on anything "plasticky", which I consider rubber to be in that family of surfaces: anyway, it can't hurt. Isopropyl alcohol? Ammonia? (Careful there with the fumes.) If you are dealing with one piece, it's possible that it is a defect and not contamination. Also, call that dealer and rehearse your saga: they can't continue to insist that washing will take the spots out: and under warranty, such defective surfaces are replaced; just push.