LLM Engineer — Careers

LLM Engineer — Careers at Bytown Save 30% on your first month. Redeem Full-time Remote — US & Canada Production LLM experience LLM Engineer Own Bytown's agent framework — multi-model routing across Gemini and Claude, tool calling into Google Ads, Meta, LinkedIn and Reddit, SSE streaming, evals, prompt iteration, guardrails and cost. Production LLM experience required — not just demos. About the role Bytown runs a router agent (`Gemini 2.5 Flash`) that classifies user intent and dispatches to specialized agents —`Claude Haiku` for tool-heavy work,`Claude Sonnet` for creative and reporting. Agents use MCP to read Google Ads data and the Google Ads SDK, Meta Business SDK, and LinkedIn/Reddit REST clients to write. Responses stream back to the frontend over SSE. You'd own that whole stack. This is a production role, not a research role. Real customers are running real ad spend through the agents you touch. You'll iterate on prompts, build evals from customer transcripts, trade off latency and cost deliberately, and make the human-review step catch what it needs to catch before anything ships. What you'll do - Own the agent framework end to end — router, specialized agents, tools. - Run multi-model routing: Gemini as dispatcher, Claude Haiku for tools, Claude Sonnet for creative. - Build tool-calling integrations into Google Ads, Meta, LinkedIn and Reddit. - Ship SSE streaming from agents back to the frontend. - Build evals. Debug regressions with real customer transcripts, not vibes. - Own per-agent cost, latency and quality — and trade them off deliberately. - Add guardrails to the human-review step so marketers catch what they need to. What we're looking for - Shipped LLM-powered features in production — not just demos. - Comfort with tool-calling, evals, streaming, and multi-provider routing. - Strong Python. Bonus points for`FastAPI` experience. - Opinions on when to fine-tune, when to prompt, when to build a real tool. - Comfort in a small