AIML - Engineering Manager, ML Systems Evaluation Engineering

Would you like to play a part in shipping groundbreaking technology for large-scale systems, natural language, and artificial intelligence powering Apple Intelligence? The Global Evaluation Engineering team is hiring a Senior Manager to help lead evaluation for large-scale, end-to-end ML systems. Join us to build the next-generation Siri, our intelligent assistant that helps millions of people get things done — just by asking. The Global Evaluation Engineering team within the AIML org is looking for an Eng. Manager to drive the evaluation of our Machine Learning systems globally and deliver the best customer experience. In this role, you will work closely with multiple engineering teams and make an impact on the design, planning, and execution of the evaluation strategy for Apple Intelligence, released in 40 languages and on multiple Apple platforms. You will operate in a highly cross-functional environment to keep moving the boundaries of automation and ML evaluation. You will play a meaningful role in crafting success metrics, defining program scope/vision, and driving execution to delivery in production.

Description

We are looking for a motivated and results-focused Engineering Manager with excellent communication and problem-solving skills and extensive experience in Project and Program management. You enjoy working on large-scale projects in a fast-paced environment that cultivates growth, collaboration, and innovation. Some of your responsibilities include:

1. Partner with cross-functional teams to define datasets, metrics, quality plans, and evaluation methodologies to assess Apple Intelligence quality at scale and track their status.
2. Coordinate the execution, tracking, and reporting of quality metrics for Siri and ML-powered systems.
3. Be the liaison among Product, Engineering, and Eval organizations by keeping the teams focused and aligned on top priorities.
4. Optimize and coordinate Siri evaluation and ensure issues are addressed promptly before product release.
5. Participate in the creation of new evaluation datasets and strategies for Apple Intelligence.

Minimum Qualifications

• 5+ years management experience working with E2E systems, preferably ML-powered.
• Experience managing projects spanning multiple cross-functional teams.
• Experience with testing and evaluating complex Machine Learning products.
• M.S. in Computer Science or equivalent.

Preferred Qualifications

• Outstanding communication and presentation abilities, written and verbal, to all levels of an organization.
• Self-motivated and proactive, with multitasking, creative, and critical thinking capabilities.

Apple is an equal opportunity employer that is committed to inclusion and diversity. We take affirmative action to ensure equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant.