Finally I have a positive update on my Audi S4 problems. After the problem had consistently been getting worse, no longer just a cold weather problem, I took it back to the dealer. After a day the dealer calls me up in the morning and tells me that the car started up fine but they are working on my other problem (the passenger window regulator fell off, a common German car problem), I sigh and go on about my day.

 A few hours later I get a call, it's Jerry from the car dealer sounding defeated. He tells me "They have been trying to get your car off the rack for 30 minutes, it won't start.". The good news is since it was on the rack they pushed it up and it was in fact the starter cylenoid. Apparently it was all corroded and couldnt find a contact point. It was replaced and so far the car has started consistently! Audi really needs to take care of this problem with a TSB! There were at least 20-30 people who reported this same problem to me.