Senior ML Engineer (Token Factory)
JobgetherRemotely
pythonjaxloramixture of expertsfp8speculative decodingropezero/fsdp
Job Description
📋 Description
- Build inference and fine-tuning tech for foundation models across modalities.
- Improve model quality and training efficiency at scale.
- Address bottlenecks in LLM inference for production performance.
- Develop training/evaluation pipelines using JAX.
- Experiment with dense and mixture-of-experts architectures.
- Investigate scaling laws for model development and resource use.
🎯 Requirements
- Deep ML/ RL theory foundations.
- Strong DL experience for language processing/generation.
- Experience training large models across nodes.
- Performance optimization for large NN training (sharding, kernels).
- Strong Python software engineering skills.
- Extensive experience with JAX.
🎁 Benefits
- Competitive compensation.
- Career growth and continuous learning.
- Flexible working environment with ownership.
- Impactful, large-scale AI projects.
- Collaborative culture with experienced engineers/researchers.
- International environment with diverse teams.
Back to all jobs