Senior Data Engineer

📋 Description

• Design, develop and maintain scalable data pipelines and ETL/ELT processes using Azure Data Factory
• Develop efficient data processing and transformation solutions using Python and Databricks.
• Work with large and complex datasets, ensuring data quality, reliability and performance.
• Contribute to the design and implementation of modern data architectures within the Azure ecosystem.
• Work with Medallion Architecture principles to build robust and scalable data solutions.
• Support Data Vault and Business Vault architectures using Databricks on Azure.

🎯 Requirements

• Must Requirements: Experience creating data pipeline using python on Databricks
• Experience working at the curated and product layers of data engineering including transforming
• A good understanding of techniques to manage schema evolution, slowly changing dimensions, data
• Practical experience of using DABs (Declarative Automation Bundles, nee Databricks Asset Bundles)
• Practical experience using git repositories and CI/CD pipelines (preferably with GitHub and ADO)
• Practical experience developing pipeline in a IDE environment (Preferably with VSCode)

🎁 Benefits

• Remote within Spain Time zone.
• Possibility to be part of a multicultural team and work on international projects.
• CET working hours