Senior Data Engineer - Web Scraping

📋 Description

• Design, build, deploy, and maintain web scrapers to collect datasets from diverse sources.
• Use Python and Pandas to clean, explore, transform, and prepare large datasets.
• Build and maintain data pipelines that ingest scraped data into databases/data warehouses.
• Develop and manage scheduled workflows with Apache Airflow for reliable data delivery.
• Collaborate with analysts and stakeholders to translate data requirements into technical solutions.
• Ensure data quality through validation checks and robust alerting/monitoring.

🎯 Requirements

• Bachelor’s or master’s in CS, Engineering, or related field.
• 4–6 years of professional data engineering experience.
• Strong Python programming, SQL, and database knowledge.
• Advanced Pandas for data cleaning and transformation.
• Web-scraping experience with Selenium, Scrapy, and related tools; familiarity with HTML/JS/APIs.
• Experience with Apache Airflow; knowledge of Docker and containerization a plus; AWS (S3, RDS

🎁 Benefits

• Fully remote position with flexibility to work from anywhere.
• Full-time opportunity in a collaborative engineering environment.
• Autonomy, ownership, and trust in tackling technical challenges.
• Exposure to sophisticated web-scraping, data engineering, and data-product initiatives.