Senior Data Engineer (GCP • Python • Iceberg • Delta Lake • Kafka • Snowflake • Databricks)
JobgetherNorth AmericaFull TimeEngineering
Remotely
pythongcpsnowflakekafkabigqueryapache sparkdelta lakeiceberg
Job Description
📋 Description
- Design and implement the Delta Lake write layer using Iceberg UniForm to maintain dual Delta and
- Build scalable GCS-to-BigQuery ingestion pipelines for structured operational datasets.
- Develop robust data engineering solutions using Python and Apache Spark.
- Implement Kafka-based change data capture (CDC) patterns for real-time and near-real-time data
- Design reusable, modular data-sharing adapters and components that support scalable lakehouse
- Develop data lineage, dependency tracking, and metadata capabilities to improve data governance and
🎯 Requirements
- 6+ years of proven enterprise-level data engineering experience with strong hands-on expertise in
- Advanced experience working with Google Cloud Platform (GCP), particularly BigQuery.
- Strong practical knowledge of Apache Iceberg, Delta Lake, and Iceberg UniForm.
- Experience implementing Delta Sharing and building Kafka-based CDC and event-driven data pipelines.
- Hands-on experience with Snowflake Horizon Catalog and Databricks Unity Catalog.
- Solid understanding of modern data lake and lakehouse architectures, including ingestion pipeline
🎁 Benefits
- Competitive compensation package.
- 100% remote work within the United States.
- Full-time employment opportunity.
- Medical, dental, and vision insurance.
- Pet insurance.
- Paid Time Off (PTO).