Job Description
📋 Description
- Design, develop, test, and maintain scalable data pipelines and transformation workflows using
- Build and optimise data processing solutions using Apache Spark, PySpark, and SQL.
- Develop batch and, where required, streaming data pipelines to support enterprise data processing
- Implement robust data ingestion, cleansing, transformation, and enrichment processes across
•…
pythonsqlawsdatadatabrickspysparkapache sparkdelta lakeetl/elt
Match
Sign in and add your skills to see how well you match this role.
Tailor your CV to this jobPro
Pro rewrites your CV bullets for this job and checks every line against your CV, dropping anything it can't back up.
See ProBack to all jobs