Data Engineer

Job Title: Consultant Data Engineer

Location: Remote

Job Summary:

We're looking for a Senior Data Engineer with strong data platform experience to help with support of existing AWS/dbt platform and that can help with standing up our new GCP platform, working with data engineer.

Duties/Responsibilities:

• Design, build, and maintain scalable systems for ingestion, transformation, and storage of data, with a focus on testing and observability
• Implement frameworks, tooling, and automation to safely increase development velocity
• Develop data pipelines, optimize pipelines, SQL or other data workflows from (1) source ingestion and preparation, (2) training and tuning and (3) downstream systems integration (EHR modules, micro-services, dashboards)

Required Skills:

• Proficiency in SQL and Python with strong familiarity towards modern data engineering frameworks, infrastructure, and tooling
• Knowledge of dbt, PySpark, Glue , Terraform to support current infrastructure on AWS
• Great to have experience setting up GCP infra : Iceberg, Dataplex, Terraform to help with initial steps of GCP migration project.
• A collaborative mindset, dependable execution, drive to reflect and improve, and humility to ask questions and learn.

Education & Experience

• Bachelor's degree (or equivalent) in Computer Science, Data Science, Statistics, Engineering or a related field
• 5+ years of experience in data engineering, platform engineering, or ML engineering
• Experience working with major cloud data platforms and tools:
• Preferred experience:
• Healthcare, behavioral health, EHR systems, and/or regulated industries
• Specific expertise with: AWS/GCP, dbt, Airflow, Airbyte, Redshift/BigQuery

Originally posted on Himalayas