Lead Data Engineer - GCP
Blend360Remotely
pythonsqlgcpdata pipelinesbigquerycloud storageairflowcloud composer
Job Description
📋 Description
- Design and develop scalable data pipelines using GCP services.
- Build data processing solutions with Python and SQL.
- Develop and optimize ETL/ELT pipelines for large datasets.
- Collaborate with business/technical teams to meet data requirements.
- Model data, validate quality, and optimize performance.
- Monitor, troubleshoot production pipelines and enforce governance.
🎯 Requirements
- 6+ years of experience in Data Engineering.
- Hands-on experience with Google Cloud Platform (GCP).
- Strong Python programming skills.
- Strong SQL skills (complex queries, joins, CTEs, window functions, optimization).
- Experience building ETL/ELT data pipelines.
- Hands-on with GCP services: BigQuery, Cloud Storage, Cloud Composer/Airflow, Dataflow, Pub/Sub