- Employee
Listed on 2 job boards, which is a stronger signal than one board alone.
Job Description
📋 Description
- Own the optimization process from research models to production deployment.
- Improve latency and throughput for real-time voice and LLM inference at consumer scale.
- Work directly with inference engines such as vLLM, TensorRT-LLM (TRT-LLM), and SGLang to enhance
- Implement model acceleration techniques, including quantization, distillation, speculative
- Develop…
machine learningllminference optimizationvllmcudatensorrt llmsglang
Match
Sign in and add your skills to see how well you match this role.
Tailor your CV to this jobPro
Pro rewrites your CV bullets for this job and checks every line against your CV, dropping anything it can't back up.
See ProAlso available on
Back to all jobs