Data Engineer (Azure/Databricks) | SR

📋 Description

• Design and maintain scalable data pipelines across Azure and Databricks environments.
• Build data models using Databricks, SAP Datasphere, Azure Data Factory, ADLS, Python, and
• Create Data Lakes, Data Lakehouses, and analytical tables; manage data tables in Databricks.
• Develop ETL pipelines for structured and unstructured data; use APIs and tools for validation.
• Integrate data from APIs (including CXL) and process datasets in Databricks.
• Structure RAG solutions using contracts and other documents as data sources.

🎯 Requirements

• Advanced experience with Databricks.
• Solid experience with Azure Data Factory and Azure Data Lake Storage.
• Experience implementing Data Lake and Data Lakehouse architectures.
• Strong Python skills; experience with Apache Spark and distributed processing.
• Professional experience with Apache Airflow for data pipelines.
• Experience with SQL and NoSQL databases (PostgreSQL, MongoDB, Cassandra).

🎁 Benefits

• Opportunity to work with Azure and Databricks data tech.
• Exposure to AI, Generative AI, and RAG use cases.
• Cloud-native Data Lake and Data Lakehouse architectures exposure.
• Professional development in a tech-focused, innovation-driven environment.
• Access to modern AI-powered tools and technologies.
• Work with distributed and diverse teams.