[Hiring] Senior Engineer: Local LLMs, llama.cpp, RAG (NVIDIA, G

Hiring Senior Engineer: Local LLMs, llama.cpp, RAG (NVIDIA, G-Assist) - Community Calls - Hugging Face Forums You can login using your huggingface.co credentials. This forum is powered by Discourse and relies on a trust-level system. As a new user, you’re temporarily limited in the number of topics and posts you can create. To lift those restrictions, just spend time reading other posts (to be precise, enter 5 topics, read through 30 posts and spend a total of 10 minutes reading). Start with reading this post. Then maybe someone already had that error that is bugging you check with a quick search. Or you can read the latest awesome paper the team discussed. Hiring Senior Engineer: Local LLMs, llama.cpp, RAG (NVIDIA, G-Assist) You have selected 0 posts. 1 / 3 Apr 9 Hi all, Sharing this here since I think it overlaps quite a bit with what many of you are working on. I’m on the NVIDIA team building GeForce G-Assist, an on-device AI assistant that runs small language models locally. We’re hiring a senior engineer to work on problems like: optimizing local inference (llama.cpp, quantization, memory, latency) improving long-running conversation behavior (state drift, prompt leakage, retrieval cross-talk) building RAG systems grounded in system + user context enabling agent-style workflows (tool use, multi-step execution) working across C/C++ (performance-critical paths) and Python (evaluation + tooling) This role sits at the intersection of systems + model behavior - thinking about how models perform in production environments, especially under real constraints. If you’ve worked with local inference stacks, small models, or care about making LLM systems actually usable, would love to chat. Full job description + apply here: Machine Learning Engineer, GeForce G-Assist | NVIDIA Corporation Machine Learning Engineer, GeForce G-Assist | NVIDIA Corporation link clicked 4 times Jr2012178 jobs in NVIDIA Corporation If you want to see what we’re b