http://www.justin-cook.com/wp/2007/01/29/how-to-set-the-curl-user-agent-string-with-php/ A web, technology, programming and SEO blog by Justin Cook Sun, 12 Oct 2008 00:45:54 +0000 http://wordpress.org/?v=2.6 http://www.justin-cook.com/wp/2007/01/29/how-to-set-the-curl-user-agent-string-with-php/#comment-46744 James Thu, 01 Nov 2007 22:04:32 +0000 http://www.justin-cook.com/wp/2007/01/29/how-to-set-the-curl-user-agent-string-with-php/#comment-46744 Between HTML comments! Between HTML comments!

]]> http://www.justin-cook.com/wp/2007/01/29/how-to-set-the-curl-user-agent-string-with-php/#comment-46743 James Thu, 01 Nov 2007 22:02:46 +0000 http://www.justin-cook.com/wp/2007/01/29/how-to-set-the-curl-user-agent-string-with-php/#comment-46743 <code>Between <!--a--> and <!--z--></code> Between and ]]> http://www.justin-cook.com/wp/2007/01/29/how-to-set-the-curl-user-agent-string-with-php/#comment-46741 James Thu, 01 Nov 2007 22:02:05 +0000 http://www.justin-cook.com/wp/2007/01/29/how-to-set-the-curl-user-agent-string-with-php/#comment-46741 I can confirm this is the case when trying to scrape Google. With a user agent, the organic results are between <!--a--> and <!--z-->. Without one, they are not included. I can confirm this is the case when trying to scrape Google. With a user agent, the organic results are between and . Without one, they are not included.

]]>