Scrapy Spider For Mobile Apps -- 2
Publicada el 2026-07-14
Descripción de la oferta
I already have a Python-based Scrapy project and now need dedicated spiders that can harvest data from the mobile apps Rabbitmart (Egypt), Voo (Egypt) and Oscar (Egypt). The crawlers should pull every publicly available endpoint (or reverse-engineered one) required to deliver: product details, user reviews, pricing information, the underlying product IDs, any active promotions or discounts and—where the apps expose it—current stock levels. All captured information must be written to clean, well-structured JSON files so that I can feed it straight into my existing pipeline. I’m still unsure whether the apps will demand login or token-based authentication; therefore, please build the spider with the flexibility to plug in credentials, headers or session cookies if we discover they’re needed while testing. Deliverables • A fully-commented Scrapy spider (or set of spiders) that crawls Rabbitmart, Voo and Oscar • Example JSON output for each app covering every requested field • A short README explaining setup, any extra libraries (e.g. mitmproxy, adb, Playwright) and how to toggle authentication if required Acceptance criteria Data for at least 100 products per app, matching the requested fields, can be reproduced on my machine with one Scrapy crawl command.
Skills
Fuente original: freelancer