Job Description
📋 Description Design and build distributed scraping architectures that scale across thousands of domains. Reverse engineer APIs and mobile apps using Frida, mitmproxy, Charles Proxy, burp and more. Detect anti-bot measures to build crawlers that appear human-like. Lead technical innovation in scraping; prototype new approaches and share knowledge with the team. Set up anomaly detection and monitoring to detect blockers or failures early. 🎯 Requirements 5+ years Python and large-scale scraping experience. Deep understanding of anti-bot technologies and bypass strategies. Experience with Scrapy, Requests, httpx, Selenium, Playwright or similar. Skilled with proxies, session management, cookie injection, TLS tweaking. Strong debugging across browser, HTTP traffic, and device-level interactions. Familiarity with Parquet/Avro or real-time stream processing. 🎁 Benefits Flexible working environment Volunteer time off LinkedIn Learning Employee-Assistance-Program (EAP)
