<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
		>
<channel>
	<title>Comments on: Reading ajax content programmatically</title>
	<atom:link href="http://www.displayofpatience.net/2009/10/reading-ajax-content-programmatically/feed/" rel="self" type="application/rss+xml" />
	<link>http://www.displayofpatience.net/2009/10/reading-ajax-content-programmatically/</link>
	<description>my favorite patient</description>
	<lastBuildDate>Sun, 14 Mar 2010 00:26:42 +0000</lastBuildDate>
	<generator>http://wordpress.org/?v=2.9.2</generator>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
		<item>
		<title>By: bodhi</title>
		<link>http://www.displayofpatience.net/2009/10/reading-ajax-content-programmatically/comment-page-1/#comment-2246</link>
		<dc:creator>bodhi</dc:creator>
		<pubDate>Thu, 29 Oct 2009 22:40:22 +0000</pubDate>
		<guid isPermaLink="false">http://www.displayofpatience.net/?p=196#comment-2246</guid>
		<description>I have now rewritten my page fetching tool with pure QT/C++ instead of PyQt, but it performs basically the same. PyQt version used a little more memory, but that&#039;s about it. 

One another thing: I actually forgot one of the most important things from my original post regarding fetching ajaxed content. You need to have some sort of mechanism for waiting the dynamic content to load. I set up a thread for this, which waits a bit and then re-reads the html source provided by QFrame. I use &quot;trigger phrases&quot; to check if the dynamic content is really loaded and then proceed. In my case, the original source has text &quot;Loading...&quot; which will be replaced by the actual content so it&#039;s pretty easy to check. You gotta love BeautifulSoup. I&#039;d go insane if I&#039;d had to do html parsing in C++ (but I&#039;m sure there are suitable libraries for that too).</description>
		<content:encoded><![CDATA[<p>I have now rewritten my page fetching tool with pure QT/C++ instead of PyQt, but it performs basically the same. PyQt version used a little more memory, but that&#8217;s about it. </p>
<p>One another thing: I actually forgot one of the most important things from my original post regarding fetching ajaxed content. You need to have some sort of mechanism for waiting the dynamic content to load. I set up a thread for this, which waits a bit and then re-reads the html source provided by QFrame. I use &#8220;trigger phrases&#8221; to check if the dynamic content is really loaded and then proceed. In my case, the original source has text &#8220;Loading&#8230;&#8221; which will be replaced by the actual content so it&#8217;s pretty easy to check. You gotta love BeautifulSoup. I&#8217;d go insane if I&#8217;d had to do html parsing in C++ (but I&#8217;m sure there are suitable libraries for that too).</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: bodhi</title>
		<link>http://www.displayofpatience.net/2009/10/reading-ajax-content-programmatically/comment-page-1/#comment-2233</link>
		<dc:creator>bodhi</dc:creator>
		<pubDate>Thu, 29 Oct 2009 07:03:41 +0000</pubDate>
		<guid isPermaLink="false">http://www.displayofpatience.net/?p=196#comment-2233</guid>
		<description>Yeah, it&#039;s sometimes difficult to trace back to the original source and I&#039;ve decided to just link to the pages I&#039;ve stumbled across myself so people can find out by themselves if they&#039;re interested. Maybe I&#039;ll add one more link, as finding out about xvfb was the final nail in the coffin for me, and I think that&#039;s when I first came across those PyQT/Screenshot posts. I would&#039;ve probably found them sooner if my goal was to get the screenshot instead of just dynamically generated source.

Regarding your link for using pure QT/C++ to render the page, dang, why I didn&#039;t think about that? I can definitely use that approach myself, all though in my case I still probably hand the content parsing to my Python script. I guess I was blinded for my desire to use Python over anything else. Thanks for the link and the idea!</description>
		<content:encoded><![CDATA[<p>Yeah, it&#8217;s sometimes difficult to trace back to the original source and I&#8217;ve decided to just link to the pages I&#8217;ve stumbled across myself so people can find out by themselves if they&#8217;re interested. Maybe I&#8217;ll add one more link, as finding out about xvfb was the final nail in the coffin for me, and I think that&#8217;s when I first came across those PyQT/Screenshot posts. I would&#8217;ve probably found them sooner if my goal was to get the screenshot instead of just dynamically generated source.</p>
<p>Regarding your link for using pure QT/C++ to render the page, dang, why I didn&#8217;t think about that? I can definitely use that approach myself, all though in my case I still probably hand the content parsing to my Python script. I guess I was blinded for my desire to use Python over anything else. Thanks for the link and the idea!</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: jimmi</title>
		<link>http://www.displayofpatience.net/2009/10/reading-ajax-content-programmatically/comment-page-1/#comment-2225</link>
		<dc:creator>jimmi</dc:creator>
		<pubDate>Thu, 29 Oct 2009 01:46:27 +0000</pubDate>
		<guid isPermaLink="false">http://www.displayofpatience.net/?p=196#comment-2225</guid>
		<description>by the way, you should try that code when you have problems with python:
http://www.insecure.ws/2009/04/02/xserver-less-webpage-screenshot-c</description>
		<content:encoded><![CDATA[<p>by the way, you should try that code when you have problems with python:<br />
<a href="http://www.insecure.ws/2009/04/02/xserver-less-webpage-screenshot-c" rel="nofollow">http://www.insecure.ws/2009/04/02/xserver-less-webpage-screenshot-c</a></p>
]]></content:encoded>
	</item>
	<item>
		<title>By: jimmi</title>
		<link>http://www.displayofpatience.net/2009/10/reading-ajax-content-programmatically/comment-page-1/#comment-2224</link>
		<dc:creator>jimmi</dc:creator>
		<pubDate>Thu, 29 Oct 2009 01:42:52 +0000</pubDate>
		<guid isPermaLink="false">http://www.displayofpatience.net/?p=196#comment-2224</guid>
		<description>funny how this idea has been taken from this insecure.ws website but so rarely referenced
following the pingback they all ping a different page like &quot;i found it first here&quot; then mostof th eold pages reference this insecure.ws site</description>
		<content:encoded><![CDATA[<p>funny how this idea has been taken from this insecure.ws website but so rarely referenced<br />
following the pingback they all ping a different page like &#8220;i found it first here&#8221; then mostof th eold pages reference this insecure.ws site</p>
]]></content:encoded>
	</item>
</channel>
</rss>
