Crawler engine, with the HTTP downloader and the publication info parser class.