Job Description
What You’ll Do
- Build and improve the inference layer of the Gcore Inference platform.
- Integrate and operate inference frameworks such as vLLM, SGLang, NVIDIA Dynamo, and TensorRT-LLM.
- Bring new language and multimodal models into production.
- Improve inference latency, throughput, memory use, GPU utilization, and cost efficiency.
- Debug performance and reliability issues across model…
platform engineeringbackend engineeringmachine learning engineeringai infrastructure engineeringpython engineeringsenior python engineersenior ai inference engineer
Match
Sign in and add your skills to see how well you match this role.
Tailor your CV to this jobPro
Pro rewrites your CV bullets for this job and checks every line against your CV, dropping anything it can't back up.
See ProBack to all jobs