Apply

Senior Infrastructure Software Engineer, Enterprise AI

Scale AI

New York, NY; San Francisco, CAOn-siteFull-time

About this role

<div class="p-rich_text_section" style="text-align: left;">Scale GP is building the infrastructure that makes enterprise AI seamless. We are looking for a Senior Infrastructure Engineer to act as a primary technical lead, engineering the &39;paved road&39; for our knowledge retrieval and inference engines. You won&39;t just be managing resources; you’ll be defining the deployment standards for Agentic workflows at scale. Your mission is to bridge the gap between complex AI orchestration and world-class infrastructure, ensuring our platform remains the most reliable destination for enterprise agents <p>The ideal candidate thrives in a fast-paced environment, has a passion for both deep technical work and mentoring, and is capable of setting a long-term technical strategy for a critical domain while maintaining a strong, hands-on delivery focus. You will architect and implement solutions across multiple cloud providers (GCP, Azure, AWS) for customers in diverse, highly-regulated industries like healthcare, telecom, finance, and retail.</p> </div> <div class="p-rich_text_section"> <p><strong>What You’ll Do:</strong></p> <ul> <li>Architect multi-cloud systems and abstractions to allow the SGP platform to run on top of existing Cloud providers.</li> <li>Use our own data and AI platform to analyze build and test logs and metrics to identify areas for improvement.</li> <li>Define the architectural patterns for our multi-cloud infrastructure to support secure, reliable, and scalable Agentic workflows for enterprise customers.</li> <li>Enhance engineering and infrastructure efficiency, reliability, accuracy, and response times, including CI/CD processes, test frameworks, data quality assurance, end-to-end reconciliation, and anomaly detection.</li> <li>Collaborate with platform and product teams to develop and implement innovative

Related opportunities