Staff Software Engineer - Data Platform

<p>P-375</p> <p>At Databricks, we are passionate about enabling data teams to solve the world&39;s toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world&39;s best data and AI infrastructure platform so our customers can use deep data insights to improve their business. Founded by engineers — and customer obsessed — we leap at every opportunity to tackle technical challenges, from designing next-gen UI/UX for interfacing with data to scaling our services and infrastructure across millions of virtual machines. And we&39;re only getting started.</p> <p>As a Staff Software Engineer working on the Data Platform team, you will leverage bleeding-edge AI developer tools and techniques to help build the Data Intelligence Platform for Databricks that will allow us to automate decision-making across the entire company. You will achieve this in collaboration with Databricks Product Teams, Data Science, and many more. You will define the future of a variety of tools spanning logging, orchestration, data transformation, metric store, governance platforms, and data consumption layers, just to name a few.</p> <p> </p> <p><strong>The impact you will have:</strong></p> <ul> <li>Design and run the cross-company Data Intelligence Platform, which contains every business and product metric used to run Databricks. You’ll play a key role in developing the right balance of data protection and ease of shareability for the Data Intelligence Platform as we transition to a public company.</li> <li>Develop tooling and infrastructure to efficiently manage and run Databricks on Databricks at scale, across multiple clouds, geographies, and deployment types. This includes CI/CD processes, test frameworks for pipelines and data quality, and infrastructure-as-code tooling.&l