Senior Data Engineer - Databricks
JobgetherJob Description
📋 Description Own production Databricks pipelines for ERP and CRM data. Design, develop, and optimize large-scale data pipelines for analytics and AI-driven apps. Ensure security, scalability, and reliability of data platforms. Provide production support: monitoring, alerting, incident response, and SLA management. Migrate legacy ETL/ELT workflows to Databricks architectures with automated deployments. Build and maintain Delta Lake architectures with schema design and data quality enforcement. 🎯 Requirements 4+ years in data engineering building production-grade pipelines. 2+ years with Databricks and Apache Spark in Azure and/or AWS. Strong PySpark, SQL, and Python skills delivering scalable solutions under SLA. Hands-on Delta Lake experience: ACID, schema evolution, optimization, streaming/incremental Databricks workload tuning, compute resource management, performance improvements. PostgreSQL expertise: query optimization, schema design, production data integration. 🎁 Benefits Comprehensive healthcare coverage for employees and families. 401(k) with employer matching. Unlimited paid time off. Paid parental leave. Online legal services, financial planning, and wellness programs. Travel and lifestyle discounts, education resources, and referral bonuses.