Craigs list Harvester with Phone Extraction
Publicada el 2026-07-28
Descripción de la oferta
I need a robust, fully-automated application that can crawl every section of Craigs list and pull the complete post data—including any phone numbers that appear in the body or images. While the goal is site-wide coverage, accuracy in the For Sale, Housing, and Jobs categories is especially important to me, so the crawler must never miss an ad in those areas. Core workflow • Navigate each city, category, and sub-category, follow pagination to the end, and retrieve the ad title, body, price, location, posting ID, date, images, and every phone number it detects. • Store results in a clean, deduplicated database and allow export to CSV or Excel in a single click. • Provide a simple dashboard where I can start, stop, or schedule harvest runs and view basic statistics (total ads scanned, success rate, duplicate count, etc.). • Rotate user-agents, honor polite delays, and support proxy lists to minimise blocking. Captcha prompts, if encountered, should be handled automatically or flagged for manual solve. Technical notes I’m comfortable with any language—Python (Scrapy, Selenium, Playwright), C#, or Node.JS are all fine—as long as the final build runs smoothly on a standard desktop without complex setup. A compiled installer or Docker image would be ideal. Source code ownership and clear documentation are required so I can maintain or extend the tool later. Acceptance criteria • 95 % or better capture rate across For Sale, Housing, and Jobs in a full-site test. • Accurate extraction of visible and image-embedded phone numbers. • One-click export producing clean CSV with no duplicate rows. • Stable operation for at least a 24-hour continuous run.
Skills
Fuente original: freelancer