Senior Data Engineer - Web Scraping
JobgetherRemotely
pythonsqlawsdockerdataseleniumpandasscrapyairflow
Job Description
📋 Description
- Design, develop, deploy, and maintain web scrapers to collect datasets.
- Build data pipelines ingesting scraped data into databases/data warehouses.
- Develop and manage scheduled workflows with Airflow and other tools.
- Collaborate with analysts and stakeholders on data needs.
- Ensure data quality, availability, and integrity with QC checks.
- Maintain alerting and resolve data incidents for reliable delivery.
🎯 Requirements
- Bachelor’s or Master’s in CS/Engineering or related field.
- 4–6 years of data engineering experience.
- Python and strong SQL/database skills.
- Advanced Pandas for cleaning and transformation.
- Web scraping with Selenium, Scrapy, Fiddler, Postman, XPath.
- Airflow for workflow orchestration and pipelines.
🎁 Benefits
- Fully remote position from anywhere in Europe.
- Full-time opportunity in a collaborative engineering environment.
- Autonomy, ownership, and trust in tackling challenges.
- Work on advanced web-scraping, data engineering, automation, and products.
- Exposure to complex datasets supporting analytical decisions.
- Collaboration with engineers, product, analysts, data scientists.
Back to all jobs