Research Engineer, Natural Language Generation (NLG)

As a Machine Learning Research Engineer on our team, you will build and iteratively refine model pipelines that define the intelligent behaviors built deeply into the text input experience on Apple products. You will conduct experiments and create prototypes for new approaches to improve the quality of our models and add new dimensions to their intelligence. Finally, you will implement the building blocks and infrastructure that bring these innovations into our production pipelines.

KEY RESPONSIBILITIES:

1. Development and maintenance of modeling pipelines that scale to deployment in production
2. Definition of robust automated evaluation metrics to facilitate hillclimbing model quality
3. Failure analysis to understand shortcomings of our models
4. Research into techniques for improving model behavior
5. Curation and synthesis of representative training and evaluation data
6. Implementation of experiments and simulations to assess the value of model changes

Minimum Qualifications:

1. MS or PhD in Computer Science or related field with at least 2 years of industry experience
2. Strong Python programming skills, with experience developing production-quality Python modules
3. Solid background in machine learning, data science, natural language processing, or statistics

Preferred Qualifications:

1. Experience building and maintaining model pipelines end-to-end, from data curation to evaluation
2. Ability to design and perform experiments that bring ML and NLP research ideas to production
3. Familiarity with LLMs, such as SFT, RHLF, prompt engineering, data synthesis, automatic evaluation, and RAG
4. Excellent written and verbal communication skills
5. History of developing Python packages and supporting other users
6. Record of publications, innovations, and/or leadership
7. Background in linguistics, fluency in multiple languages, or a passion for scaling NLP features for global audiences