Senior LLM Engineer | Taskium

Senior LLM Engineer | Taskium Back to Job Board Senior LLM Engineer Remote, USA Posted 2026-07-29 Full-time Tasks: • As a Senior Engineer, you will design and ship agentic AI systems that plan, call tools, and execute reliably inside production workflows. You’ll own the end-to-end delivery of GenAI capabilities—from model adaptation and retrieval to orchestration, evaluation, and operational excellence. • Build agentic systems: design supervisor/planner/executor patterns, routing, memory/context strategies, tool/function calling, and robust failure handling. • LLM adaptation & deployment: fine-tune or parameter-efficiently adapt open-source LLMs; optimize inference (latency/cost) and ship safely to production. • Retrieval-augmented generation (RAG): implement embedding, retrieval, re-ranking, and grounding patterns; optimize for quality, speed, and cost. • Structured and reliable generation: enforce schemas/structured outputs, guardrails, and post-processing; reduce hallucinations and brittleness. • Evaluation & quality: build automated evaluation harnesses for agents/LLMs (offline benchmarks + online monitoring), regression tests, and prompt/model versioning. • Production engineering: ship containerized services and APIs; implement CI/CD, observability, and reliability practices (SLOs, alerting, incident readiness). • Cross-functional delivery: collaborate with product, platform, and data teams to integrate GenAI features into user-facing and internal workflows; mentor others. Requirements: • 5+ years building production ML/AI systems; 2+ years at senior/lead level. • Strong Python engineering (testing, packaging, code quality, performance profiling). • Hands-on experience with LLMs and agentic AI in real systems (tool calling, orchestration, workflow integration). • Experience adapting LLMs (LoRA/QLoRA/PEFT or equivalent) and evaluating quality/safety. • Experience implementing RAG and operating retrieval components in production. • Strong MLOps fundame