Databricks Engineer - Lead / Manager

📋 Description

• Design, build, and optimize scalable data pipelines and analytics solutions on Azure cloud
• Design, develop, and maintain scalable data pipelines using Azure Databricks
• Implement ETL/ELT workflows using PySpark, Spark SQL, and Python
• Optimize Spark jobs for performance, cost, and scalability
• Work with structured and semi-structured data (Parquet, Delta, JSON, CSV)
• Build and manage Delta Lake tables (ACID, time travel, schema evolution)

🎯 Requirements

• 6+ years of experience in Data Engineering
• Strong hands-on experience with Azure Databricks
• Proficiency in Python for data processing
• Strong knowledge of SQL (joins, window functions, performance tuning)
• Hands-on experience with Apache Spark / PySpark
• Experience working with Delta Lake