How about light khakis with a blue, brown, and yellow striped button down under a dark blue sweater, brown belt, and brown shoes?
I really want to bust out the brown belt and brown shoes.
Also, I might just save the dark grey and blue sweater for the combo you have advised Mike.