New York, BostonFull TimeSoftware Development
Remotely
pythonsparkdatascalaairflowtrinoapache iceberg
Job Description
📋 Description
- Own parts of a large-scale processing platform for billing and cost attribution.
- Design high-throughput data pipelines for billing, cost attribution, and revenue data.
- Improve platform reliability, reduce latency, and optimize Spark processing.
- Collaborate with Finance and Product on root-cause investigations and new billing features.
- Work across Python and Scala with Spark, Airflow, Trino, and Apache Iceberg.
- Participate in on-call rotation and uphold high reliability for production systems.
🎯 Requirements
- Experience building/operating production data pipelines at scale using Spark and Airflow.
- Strong ownership mindset for cross-functional investigations and data correctness.
- Ability to balance feature delivery with platform health and technical debt.
- Analytical, rigorous approach to data correctness and reliability.
- Comfort working in ambiguous environments and aligning multiple stakeholders.
- Commitment to code quality and operational excellence.
🎁 Benefits
- Competitive salary and equity; comprehensive benefits including healthcare, 401(k) match, PTO
Back to all jobs
