Tuesday, 9 March 2010

Server: Cached and Threaded

Just switched to our new version of our aggregation engine, which finally caches old pages to avoid reloading each web page, and possibly straining our target source websites. We've also multithreaded the engine, to use as many processor cores on the server as we want. Feed Distiller is now good for thousands of feeds, and hundred of thousands source pages. We'll be watching for bugs, over the next few days. But so far so good.

No comments: