Amazon & Flipkart Data Scraper
Publicada el 2026-07-30
Descripción de la oferta
I need a reliable scraper that automatically captures price, reviews, and the full product description from both Amazon and Flipkart, then serves that data through a simple API I can call each day. The flow I have in mind is straightforward: a scheduler (cron, CloudWatch, or similar) triggers the crawler once every 24 hours, your scraper collects the three data points for every SKU I supply, and the latest results become instantly available through a REST or GraphQL endpoint in JSON. A lightweight authentication layer (token or key) is enough—no elaborate user system required. Robustness matters more than speed; captchas, rotating proxies, or headless browsers can be used as you see fit, provided the solution keeps running unattended. Clear logging and graceful error handling are essential so I can spot failures at a glance. Deliverables • Scraper scripts or containerised service for Amazon & Flipkart • Daily scheduler configuration • Secure API returning fresh JSON for each requested SKU (price, reviews, description) • Setup guide plus one test run proving the data refresh Acceptance criteria 1. Hitting the API after the daily run returns up-to-date fields for at least ten test products. 2. No hard-coded credentials or paths; environment variables fully supported. 3. Documentation covers installation, scaling the crawler count, and updating the SKU list. Any stack is welcome—Python (Scrapy, BeautifulSoup, Selenium), Node (Puppeteer, Cheerio), or another proven toolset—so long as it meets the requirements above and can be deployed on a standard VPS or cloud instance.
Skills
Fuente original: freelancer