Senior Data Engineer
ExperianRemotely
awsdockerkubernetesterraformscalaci/cdapache sparkparquet
Job Description
📋 Description
- Hybrid role based in Hyderabad; travel to Hyderabad office 40%/month
- Develop and maintain batch data pipelines with Scala and Spark
- Optimize Spark workloads in AWS cloud
- Collaborate with data engineers and analysts on data needs
- Ensure data integrity and reliability across systems
- Participate in code reviews, design discussions, and Agile work
🎯 Requirements
- 3-6 years software dev, 2+ years with Scala
- Clean, scalable code using SOLID and design patterns
- Functional programming and distributed computing
- DevOps/IaC tools: Terraform, CI/CD, Git, Jenkins
- Hands-on Spark for batch processing
- AWS services: S3, Glue, Lambda, Step Functions, Batch, CloudWatch
🎁 Benefits
- Hybrid remote/in-office role at Experian
- Company benefits for work-life balance and wellbeing
- World-class recognition and career opportunities
Back to all jobs