Job Description
📋 Description Design and build distributed scraping architectures that can scale across thousands of domains. Reverse engineer APIs and mobile apps using tools like Frida, mitmproxy, Charles Proxy, burp and Detect anti-bot measures and build crawlers that appear more human-like. Lead technical innovation in scraping: identify edge cases, prototype new approaches, share Set up anomaly detection and monitoring to detect blockers or failures early 🎯 Requirements 5+ years of experience with Python and large-scale scraping projects. Deep understanding of anti-bot technologies and how to bypass them, fingerprinting, WAFs Experience with Scrapy, Requests, httpx, Selenium, Playwright, or custom headless browser drivers. Skilled handling proxies (residential, datacenter, rotating), session management, cookie injection Strong debugging skills across browser, HTTP traffic, and device-level interactions. Familiarity with Parquet, Avro, or real-time stream processing; knowledge of MongoDB, InfluxDB 🎁 Benefits Flexible working environment Volunteer time off LinkedIn Learning Employee-Assistance-Program (EAP)
