Senior Data Engineer - Web Scraping

📋 Description

• Design, develop, deploy, and maintain web scrapers to collect diverse datasets.
• Use Python and Pandas to clean, explore, transform large datasets.
• Build data pipelines ingesting scraped data into databases and data warehouses.
• Develop and manage scheduled workflows with Apache Airflow.
• Collaborate with analysts and stakeholders to translate data needs into technical solutions.
• Develop data quality checks for availability, accuracy, consistency, and integrity.

🎯 Requirements

• Bachelor’s or master’s in Computer Science, Engineering, or related technical discipline.
• 4–6 years of professional experience in data engineering.
• Strong Python programming and SQL/database knowledge.
• Advanced Pandas library for data cleaning and transformation.
• Web-scraping experience with Selenium, Scrapy, Fiddler, Postman, XPath.
• Experience with Apache Airflow for workflows.

🎁 Benefits

• Fully remote position with flexible location.
• Full-time opportunity in a collaborative engineering environment.
• Significant autonomy and ownership over technical challenges.
• Opportunity to work on sophisticated web-scraping, data engineering, automation, and data-product
• Exposure to complex datasets supporting analytical and investment decisions.
• Collaboration with engineers, product teams, analysts, and data scientists.