Infrastructure Software Engineer, Enterprise GenAI
Scale AI
San Francisco, CA; New York, NYOn-siteFull-time
About this role
<p>Scale GP (Scale Generative AI Platform) is an enterprise-grade AI platform that provides APIs for knowledge retrieval, inference, evaluation, and more. We are looking for a strong engineer to join our team and help us build and scale our core infrastructure in a fast-paced environment.&nbsp;</p> <p>The ideal candidate will have a strong understanding of software engineering principles and practices, as well as experience with large-scale distributed systems. You will implement solutions across multiple cloud providers (GCP, Azure, AWS) for customers in diverse, highly-regulated industries like healthcare, telecom, finance, and retail.</p> <p><strong>What You’ll Do:</strong></p> <ul> <li>Architect multi-cloud systems and abstractions to allow the SGP platform to run on top of existing Cloud providers</li> <li>Implement custom integrations between Scale AI&39;s platform and customer data environments (cloud platforms, data warehouses, internal APIs)</li> <li>Collaborate with platform, product teams and our customers directly to develop and implement innovative infrastructure that scales to meet evolving needs.</li> <li>Deliver experiments at a high velocity and level of quality to engage our customers</li> <li>Work across the entire product lifecycle from conceptualization through production</li> <li>Be able, and willing, to multi-task and learn new technologies quickly</li> </ul> <p><strong>What We’re Looking For:</strong></p> <ul> <li>4+ years of full-time engineering experience, post-graduation</li> <li>Experience scaling products at hyper growth startups</li> <li>Experience tinkering with or productizing LLMs, vector databases, and the other latest AI technologies</li> <li>Proficient in Python or Javascript/Typescript, and SQL</li> <li>Experien