At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to improve their business.
We are the data warehouse (i.e. DBSQL) AI team, a core part of the Databricks Data Intelligence Platform. Our goal is to enable Databricks users to 1- efficiently use ML/AI in their workloads in SQL and 2- have a differentiated experience due to ML/AI-based tuning of the underlying engine in DBSQL based on their workload. We are a highly innovative team working at the intersection of ML/AI, Data and Systems fields. We work with a variety of system and ML teams across the company to drive unique initiatives in various parts of the Databricks software stack. We're seeking a dedicated Engineering Leader to drive innovation and deliver robust solutions in the domain of Data, AI and Systems.
The key responsibilities include:
- Leading a talented engineering team distributed in multiple geographies
- Actively work with the teams across DBSQL to identify impactful areas to apply innovative solutions based on ML and advanced heuristics with the goal of improving performance, cost or usability.
- Overseeing sustained recruitment of top-tier talent, fostering a well-organized and synergistic team structure, and collaborating effectively with internal and external stakeholders
- Implementing robust processes to efficiently execute product vision, strategy, and roadmap in alignment with organizational goals and priorities
The impact you will have:
- Re-architect core parts of Databricks platform using advanced heuristics and ML/AI in ways no other company has
- Define, shape, and drive the future of Databricks Data Intelligence Platform
- Grow a world class team of software engineers. Hire top-notch staff+ level talent
- Ensure consistent delivery against milestones and strong alignment with the field working "two-in-a-box" with product leadership
- Evolve organizational structure to align with long term initiatives, build strong "5 ingredient" teams with good comms architecture
- Manage technical debt, including long term technical architecture decisions and balance product roadmap
What we look for:
- 5+ years experience working in a related system with an emphasis on distributed data systems
- A passion for database systems, storage systems, distributed systems, language design, and performance.
- Can ensure the team builds high quality and reliable infrastructure services. Experience being responsible for testing, quality, and SLAs of a product. Previous experience building and leading teams in a complex technical domain, such as on distributed data systems or database internals
- Ability to attract, hire, and coach engineers who meet the Databricks hiring standards. Can uplevel the existing team via hiring top-notch senior talent, growing leaders and helping struggling members. Can gain trust of the team and guide their careers. Experience managing distributed teams preferred
- Comfort working cross-functionally with product management and directly with customers; ability to deeply understand product and customer personas
- BS in Computer Science (Masters or PhD Preferred)