Senior Data Engineer - Web Scraping

📋 Description

• Design, develop, deploy, and maintain web scrapers from diverse sources.
• Use Python and Pandas to clean and transform large datasets.
• Build data pipelines to ingest scraped data into databases/data warehouses.
• Develop and manage scheduled workflows with Apache Airflow.
• Collaborate with analysts to translate data needs into tech solutions.
• Maintain data quality checks and resolve operational issues.

🎯 Requirements

• Bachelor’s or master’s in CS/Engineering or related field.
• 4–6 years in data engineering.
• Strong Python, SQL, and DB tech knowledge.
• Advanced Pandas for data cleaning and transformation.
• Web-scraping exp with Selenium, Scrapy, Fiddler, Postman, XPath.
• Experience with Airflow for pipelines.

🎁 Benefits

• Fully remote position, work from anywhere.
• Full-time, collaborative, team-oriented environment.
• Autonomy and ownership of projects.
• Opportunity to work on web-scraping, automation, data products.
• Exposure to complex datasets for analytics and decisions.
• Collaboration with cross-functional teams.