AI Researcher — Distillation

📋 Description

• Design, implement, and evaluate advanced model distillation techniques, including teacher-student
• Investigate the tradeoffs between model size, latency, memory consumption, throughput, and accuracy.
• Develop novel approaches to distilling large language models, long-context or specialized
• Conduct large-scale experiments, ablation studies, and rigorous analysis to validate research
• Translate research findings into practical implementations and collaborate closely with engineering
• Prepare and submit research papers to leading machine learning conferences and venues such as

🎯 Requirements

• Strong academic or professional background in machine learning research, with a solid understanding
• Hands-on experience with model distillation or closely related areas such as model compression
• Demonstrated publication experience through conference or journal papers, workshop publications, or
• Strong understanding of optimization, training dynamics, generalization, and modern deep learning
• Fluency in PyTorch or an equivalent deep learning framework, with experience conducting
• Ability to design rigorous experiments, interpret results, and critically evaluate research

🎁 Benefits

• Significant ownership and influence over research direction within a Series A-stage environment.
• Strong support for publishing research and pursuing open research initiatives.
• Close feedback loop between research experimentation and real-world production deployment.
• Access to meaningful compute resources and production-scale machine learning problems.
• Opportunity to work on cutting-edge model efficiency and distillation challenges.
• Collaboration within a small, highly technical team with deep expertise across machine learning and