Senior LLMOps Engineer
Heidi HealthRemotely
datadogllmopsobservabilityintercomtracingsession_data_model
Job Description
📋 Description
- Build deployment health dashboards for all production models
- Provide live visibility into model health and incidents
- Ensure traceability from sessions to models quickly
- Create an improvement flywheel from feedback and CSAT
- Publish complete execution traces for flagged sessions
- Own per-model P&L and unit economics
🎯 Requirements
- 2–3 years hands-on in an LLMOps role
- Experience with observability, tracing, and feedback systems
- Background in AI company at scale (US/China preferred)
- Knowledge of monitoring/alerting (Datadog or similar)
- Experience with LLMs and agent-based triage
- Ability to design and run production systems
🎁 Benefits
- Competitive equity and learning budget
- Health & wellness allowance
- Home office budget
- Generous parental leave support
- Flexible work style and outcomes-driven culture