Public Developer Data Scraper and Searchable Database
Publicada el 2026-07-20
Descripción de la oferta
I am looking for an experienced developer to build a lightweight scraping and data-collection tool that gathers publicly available developer profile information from selected trading, blockchain, and software-development platforms. The collected data may include developer name, username, profile URL, technical skills, activity history, projects, reputation indicators, location, and publicly listed contact or social links. The system should clean, normalize, remove duplicates, and store the information in a searchable database. **Main Deliverables** * Scraper for several approved public websites * Searchable developer database * Duplicate detection and data normalization * Filters by skills, activity, platform, location, and reputation * CSV or JSON export * Basic documentation and setup instructions * Error handling and rate-limit protection The scraper must collect only publicly available information and comply with each platform’s terms, robots.txt rules, privacy requirements, and applicable data-protection laws. Please include examples of similar scraping, data-enrichment, or searchable-directory projects you have completed.
Skills
Fuente original: freelancer