Member of Technical Staff (Backend Software Engineer, Search Crawler)
PerplexityJob Description
📋 Description Design, develop, and operate systems that ingest, process, and manage web-scale data for advanced Own projects focused on large-scale web crawlers, ingestion pipelines, and data processing systems. Build and optimize backend and frontend components for crawler services, including storage Collaborate with Search and Infrastructure teams to ensure reliable ingestion and processing of Architect and implement fullstack features and scalable distributed systems for high-load and Iterate quickly and continuously enhance performance, usability, and reliability. 🎯 Requirements 5+ years of software development experience with strong data structures and algorithms in Python Experience with large-scale web crawlers is highly desirable. Proven experience building, deploying, and optimizing high-load, distributed services. Deep understanding of cloud infrastructure with hands-on Kubernetes (K8s) and AWS. Passion for writing clean, efficient, and scalable systems. 🎁 Benefits