What kind of advice exactly are you looking for?
I'm not feeling the sweater. It looks like the shoulders sag and the sleeves look a tad short. It also seems too long, but I can't really tell. Overall the idea is not bad, but the shirt kills it - I would definitely close some more buttons (all but the top one).
I can't tell what kind of pants you're wearing, but if you want a cheap recommendation; go cop a pair of Levi 511s (slim fit) in either dark indigo or black. Note: solid colour!!!! No cheesy washes/sick fades. Also, avoid light blue etc. like the plague. Be sure to get the right size as they stretch with wear (i.e. the size where you can barely close the button at first). Rock some black oxfords and a black leather belt and the lower part of your body is sorted.
As for tops, I recommend sticking with the "button-up + something" idea for this season. Get basic sweaters and cardigans in black/grey/white (or earth tones). By basic I mean no graphics and no logos and the like. Raid your local H&M. What to avoid: zip-ups, hoodies, graphic tees. And is that what I think it is? A left hand with no watch? Go get yourself a nice one!
Also, this doesn't look gay in the slightest. You can worry about looking gay when you start wearing purple skinny jeans and pink chucks. Girls can tell when a man is well dressed, and with good fitting items this look can be classified as 'well dressed'. This definitely gives you a one-up on guys in oversized plaid shirts and cheesy ironic graphic tees.
Tip: google styleforum and find the What are you wearing now thread in Streetwear & denim.