Databricks Engineer - Senior/ Lead
Blend360Remotely
Listed on 2 job boards, which is a stronger signal than one board alone.
pythonsqldataazure databrickspysparkapache sparkdelta lakeparquetadls gen2
Also available on
Job Description
📋 Description
- Design, build, and optimize scalable data pipelines on Azure Databricks.
- ETL/ELT workflows with PySpark, Spark SQL, and Python.
- Optimize Spark jobs for performance, cost, and scalability.
- Work with Parquet, Delta, JSON, CSV data.
- Build and manage Delta Lake tables with ACID, time travel, schema evolution.
- Integrate Databricks with Azure Data Lake Storage Gen2.
🎯 Requirements
- 6+ years of experience in Data Engineering.
- Strong hands-on experience with Azure Databricks.
- Proficiency in Python for data processing.
- Strong knowledge of SQL (joins, window functions, performance tuning).
- Hands-on experience with Apache Spark / PySpark.
- Experience with Delta Lake.
🎁 Benefits
- Azure Data Factory experience.
- Exposure to CI/CD pipelines (Azure DevOps, GitHub Actions).
- Basic understanding of data modeling.
- Familiarity with cloud security and RBAC in Azure.
Back to all jobs
