Senior Data Engineer - Web Scraping

📋 Description

• Design, develop, deploy, maintain web scrapers for diverse sources.
• Clean, explore, transform large datasets with Python and Pandas.
• Build data pipelines to ingest scraped data into databases/data warehouses.
• Manage scheduled workflows with Airflow and orchestration tools.
• Collaborate with analysts and stakeholders on data requirements.
• Implement quality checks to ensure data accuracy and integrity.

🎯 Requirements

• Bachelor’s or master’s in CS/Engineering or related field.
• 4–6 years in data engineering or related field.
• Strong Python, SQL, and database tech knowledge.
• Hands-on Pandas for cleaning/manipulation/exploration.
• Web-scraping experience with Selenium, Scrapy, Postman, XPath.
• Airflow for workflow orchestration; data pipelines experience.

🎁 Benefits

• Fully remote position from anywhere ( Portugal/Europe ).
• Full-time, team-oriented engineering environment.
• Autonomy and ownership over technical challenges.
• Work on advanced web-scraping, data engineering, automation projects.
• Exposure to complex datasets for analytical decisions.
• Collaborative environment with diverse tech teams.