Research Engineer, Large Language Models
Immiland Canada- Employee
Job Description
📋 Description
- Design and run large-scale pre-training and fine-tuning experiments, from small ablations to full
- Study scaling laws to choose model size, data mix, and hyperparameters under a fixed compute budget.
- Improve training efficiency through parallelism strategies (data, tensor, pipeline, FSDP), mixed
- Diagnose and fix training instabilities such as loss spikes, divergence, and…
pythonmachine learningpytorchjaxcudatritondeepspeedmegatron lm
Match
Sign in and add your skills to see how well you match this role.
Tailor your CV to this jobPro
Pro rewrites your CV bullets for this job and checks every line against your CV, dropping anything it can't back up.
See ProBack to all jobs