I have changed the advertisements back to AdSense for pretty much the same reasons that Andrew did.
The ads with Yahoo! were just not targeted enough and I did not seem to be getting crawled by any kind of targeting spider. Google on the other hand has been consistent in crawling my site and providing relevant text ads.
I may switch back to Yahoo! in a few months to see if they have provided better ad support.