Senior Data Engineer
ExperianRemotely
awsdockerkubernetesterraformscalaci/cdapache sparkparquet
Job Description
📋 Description
- Hybrid role based in Hyderabad with 40% travel to the office per month
- Develop and maintain batch data processing pipelines using Scala and Apache Spark
- Optimize Spark workloads for performance and scalability in AWS
- Partner with data engineers and analysts to deliver high-quality data solutions
- Ensure data integrity and reliability across systems
- Participate in code reviews, technical design, and Agile development
🎯 Requirements
- 3-6 years in software development; at least 2 years with Scala
- Clean, scalable code using SOLID principles and design patterns
- Functional programming concepts and distributed computing
- DevOps / IaC tools (Terraform, CI/CD, Git, Jenkins)
- Hands-on Apache Spark for batch processing
- Experience with AWS services (S3, Glue, Lambda, Step Functions, Batch, CloudWatch)
🎁 Benefits
- Hybrid remote/in-office role
- Global company benefits and recognition programs
- DEI, work-life balance, development opportunities, wellness programs
Back to all jobs