🇺🇸San FranciscoFull TimeEngineering
- Employee
Job Description
📋 Description
- Turbocharge our serving layer, consisting of a variety of LLM, speech, and vision models.
- Partner with ML infrastructure and training engineers to build a fast, cost-effective, accurate
- Modify and extend LLM serving frameworks like VLLM and SGLang to take advantage of the latest
- Work with the training team to identify opportunities to produce faster models without…
kubernetesllmgcppytorchvllmmlraysglang
Match
Sign in and add your skills to see how well you match this role.
Tailor your CV to this jobPro
Pro rewrites your CV bullets for this job and checks every line against your CV, dropping anything it can't back up.
See ProBack to all jobs