🇺🇸San FranciscoFull TimeProduct Management
- Employee
Job Description
📋 Description
- Work with inference engineering and research teams to bring new performance capabilities to
- Translate advances in batching, caching, quantization, speculative decoding, and serving
- Define benchmarks and evaluations that demonstrate meaningful improvements in latency, throughput
- Understand customer workloads and help prioritize the optimizations that will have the greatest…
productpythonai/mlmodel servingpytorchvllmgpuinference
Match
Sign in and add your skills to see how well you match this role.
Tailor your CV to this jobPro
Pro rewrites your CV bullets for this job and checks every line against your CV, dropping anything it can't back up.
See ProBack to all jobs