Personally I think WBA is biased due to lactose intolerance -- if milk did that to me I'd stay as far from it as possible, too.
If you're (relatively) lactose tolerant, the problem with milk is that it's high in sugar compared to the amount of protein you get out of it. The protein in milk itself is much more casein than whey protein. That's good for a long-lasting fix of protein, but much less useful right after a tough workout.
The other trouble with milk is that unless you use skim/fat-free (and some people can't stand the taste) then all the fat is saturated fat. You need some saturated fat in your diet, but there are better places to get it (fairly lean red meat, for example).
All the other alleged problems with milk are hogwash as far as I've been able to ascertain, including concerns about bovine growth hormone.