Senior ML Engineer (Token Factory)
JobgetherRemotely
pythonjaxlorafsdpzeromixture of expertsfp8flash attention
Job Description
📋 Description
- Build inference and fine-tuning tech for foundation models across language/vision/audio/multimodal
- Improve model quality, training efficiency, and hardware utilization at massive scale.
- Address bottlenecks in distributed training and large-scale inference.
- Develop training/evaluation pipelines using JAX (e.g., speculative decoding, inference
- Explore architectures (dense, mixture-of-experts; autoregressive/parallel).
- Investigate scaling laws for development, performance, and resources.
🎯 Requirements
- Deep theory in ML/RL fundamentals.
- Strong expertise in modern DL for language processing/generation.
- Experience training large models across multiple nodes.
- Understanding of performance optimization for large NN training (sharding, custom kernels
- Strong Python software engineering skills.
- Extensive experience with JAX.
🎁 Benefits
- Competitive compensation.
- Career growth and continuous learning opportunities.
- Flexible working environment with ownership.
- Opportunity to work on impactful large-scale AI projects.
- Collaborative culture with experienced engineers/researchers.
- International environment with diverse teams.
Back to all jobs