Senior LLM Engineer
Koch
San Francisco, CARemote OKFull-time$195k – $255k / year
About this role
Senior LLM Engineer - United States - 192106 - Koch
Koch Home Page
Senior LLM Engineer
Location(s) Austin, Texas | Fremont, California | Lisle, Illinois
Eligible for remote Yes
Career Field Data & Analytics
Your Job
The Senior LLM Engineer will fine-tune and deploy LLMs on Azure OpenAI / Azure AI Foundry to power generative AI capabilities within our engineering design platform, translating natural-language design intent into structured, engineering-valid outputs.
Our Team
Established in 1938, Molex delivers comprehensive electronic solutions for various markets, including data communications, telecommunications, consumer electronics, industrial, automotive, commercial vehicle, aerospace and defense, medical, and lighting. You'll join the platform team behind our Azure AI/ML engineering tools, working alongside ML engineers, data scientists, and MLOps teams to keep training and inference workloads reliable, secure, and cost-efficient.
What You Will Do
- Fine-tune foundation models (LoRA/QLoRA, RLHF/DPO, instruction tuning) for domain-specific tasks and terminology.
- Build agentic and tool-use workflows that connect the LLM to internal engineering tools and data sources.
- Design evaluation harnesses for factuality and accuracy; own hallucination and safety guardrails.
- Build RAG pipelines (Azure AI Search) and structured tool-use/function-calling systems on top of fine-tuned Azure OpenAI models.
- Deploy and optimize inference (quantization, KV-cache, vLLM/TensorRT-LLM) on Azure Kubernetes Service for cost-efficient serving.
Who You Are (Basic Qualifications)
- 8+ years overall ML/AI engineering experience, with deep hands-on LLM/foundation model work — not just calling APIs.
- Demonstrated experience fine-tuning models (LoRA/QLoRA/PEFT, full fine-tuning, or pretraining at some scale).
- Practical experience with alignment techniques (RLHF, RLAIF, DPO, or instruction tuning).
- Strong Python and deep PyTorch proficiency; solid