[Remote] LLM / AI Engineer – USA Remote Jobs mysmartpros

Remote LLM / AI Engineer – USA Remote Jobs mysmartpros Anywhere July 24, 2026 Note: The job is a remote job and is open to candidates in USA. District Cyber LLC is a US-based software development company specializing in enterprise software and AI solutions. They are seeking a Mid-Level or Senior LLM / AI Engineer to build production-ready AI solutions using Python and modern LLM technologies, while collaborating closely with backend engineers. Responsibilities - Develop and maintain production RAG services - Build document ingestion pipelines, including parsing, chunking, metadata extraction, indexing, and updates - Integrate LLM APIs and implement prompt engineering, structured outputs, and response validation - Improve retrieval quality using embeddings, metadata filtering, vector search, and retrieval tuning - Optimize performance, reliability, logging, monitoring, and production readiness - Collaborate with the backend team on AI architecture and new product development Skills - 3+ years of commercial Python backend development experience (FastAPI or similar) - Experience building production RAG pipelines - Experience working with LLM APIs - Strong understanding of vector search, embeddings, metadata filtering, and semantic retrieval - Experience designing document ingestion pipelines - Experience with Docker - Good understanding of backend development best practices - English B2 or higher - We prefer candidates located in Ukraine or Europe - LangChain, LangGraph, LlamaIndex, or similar frameworks - Hybrid Search (BM25 + Vector Search) - Experience with reranking techniques - Experience evaluating retrieval quality (Recall@K, MRR, nDCG) - Experience with observability, tracing, latency monitoring, and AI performance metrics - Experience with multi-tenant architectures and document permissions (ACL) Benefits - Full-time remote position. - Long-term collaboration. - No time tracking. - Opportunity to work with modern AI technologies and enterprise-scale