TorontoFull TimeEngineering
Remotely
llmagentic aivllmcudatritontensorrt llmgpuollama
Job Description
📋 Description
- Build vendor-agnostic agent platform components: orchestration, tools, memory, runtime systems.
- Develop evaluation and reliability tooling: metrics, harnesses, pipelines for agent performance and
- Implement safety/governance controls: guardrails, policy enforcement, human-in-the-loop review.
- Create data grounding, retrieval, memory features to maintain accuracy and context.
- Prototype agent behaviors: planning, multi-step execution, tool coordination.
- Collaborate with product/engineering to implement agent-powered workflows.
🎯 Requirements
- Bachelor’s or Master’s in CS/EE/ML or equivalent practical experience.
- 2+ years of software engineering with distributed systems/backend platforms.
- Foundational knowledge of LLMs and agentic AI; GPU computing and model serving.
- Conway understanding of concurrency, fault tolerance, observability, performance.
- Proficiency in Java, Go, Python or similar; experience with cloud-native infra, APIs, data services.
- Ability to work in ambiguous, early-stage spaces; strong technical impact and collaboration.
🎁 Benefits
- Equity, bonus, and competitive salary within CAD 135K – 175K per year.
- Hybrid work model with Toronto-based role; remote options may apply.
- Opportunity to work with cutting-edge agentic AI and LLM infrastructure.