Staff Software Engineer, Data Governance  Foundations

📋 Description

• Lead architecture for open lakehouse foundation, governance, and multi-engine compute strategy.
• Define unified table formats, storage governance, and multi-engine compute portfolio.
• Drive real-time streaming infra for critical use cases (Ads, Fraud, ML).
• Pioneer AI-native data infrastructure: apply AI tools to platform lifecycle and cost optimization.
• Mentor engineers, lead architecture reviews, and influence hiring across teams.
• Collaborate with Data Science, ML Platform, Ads Infra, Finance Eng, Product Eng, and Security.

🎯 Requirements

• 10+ years of software engineering in data infrastructure or distributed systems at production scale.
• Hands-on with lakehouse architectures and open formats (Iceberg, Delta Lake, Hudi) and
• Experience with event-driven/streaming infra (Kafka, Flink) for real-time pipelines.
• Proven ownership of platform migrations and ability to build cost/benefit models across teams.
• Strong architecture docs and strategy memos; ability to communicate trade-offs to technical and

🎁 Benefits

• Remote-friendly with Flex First policy; compensation varies by location.
• Base pay ranges provided by location; equity and annual grants available.
• Extensive benefits and learning opportunities as part of Instacart culture.