Senior Data Engineer - Web Scraping
JobgetherRemotely
pythonsqljavascripthtmlseleniumpandasscrapyairflow
Job Description
📋 Description
- Design, develop, deploy, and maintain web scrapers to collect datasets from diverse sources.
- Use Python and Pandas to clean, explore, transform, and prepare large datasets.
- Build data pipelines that ingest scraped data into databases and data warehouses.
- Develop and manage scheduled workflows with Apache Airflow and orchestration tools.
- Collaborate with analysts and stakeholders to translate data needs into technical solutions.
- Develop quality-control checks to validate data availability, accuracy, and integrity.
🎯 Requirements
- Bachelor’s or master’s degree in CS, Engineering, or related field.
- 4–6 years of professional data engineering experience.
- Strong Python programming and SQL/database knowledge.
- Advanced expertise with Pandas for data cleaning and transformation.
- Web-scraping experience with Selenium, Scrapy, Fiddler, Postman, XPath.
- Experience with Apache Airflow for workflow orchestration.
🎁 Benefits
- Fully remote position from anywhere in Netherlands/Europe.
- Full-time opportunity in a collaborative engineering environment.
- Significant autonomy and ownership over technical challenges.
- Work on web-scraping, data engineering, automation, and data-product initiatives.
- Exposure to complex datasets supporting analytical and investment decisions.
- Collaboration with engineers, product, analysts, and data scientists.
Back to all jobs