AIML Researcher - Foundation Model, Post-Training

Apple seeks a Mid-level AIML Researcher in Zürich to advance post-training strategies for foundation models, focusing on reasoning, safety, and alignment for Apple products.

This position aims to define the next generation of large language model capabilities by converting raw models into intelligent assistants integrated into Apple devices. The role tackles core training hurdles such as instruction adherence, tool utilization, and deep reasoning, while collaborating with a team of experts to develop innovative training methodologies.

Responsibilities

• Develop and refine end-to-end post-training approaches, including reinforcement learning techniques, to guide specific model behaviors.
• Create new algorithms for preference optimization, model steering, and safety mechanisms.
• Lead data strategy efforts by investigating methods for generating high-quality human and synthetic data, implementing automated filtering, and applying curriculum learning.
• Establish robust evaluation frameworks to assess model helpfulness, factual accuracy, and utility, going beyond traditional static benchmarks.
• Collaborate with pre-training groups to influence architectural decisions and work with product teams to convert user needs into tangible model features.

Requirements

• Proven expertise in deep learning, specifically within large language models, post-training, or reinforcement learning.
• Strong programming abilities in Python and proficiency with major deep learning frameworks like JAX or PyTorch.
• A Master’s or PhD degree in Computer Science, Machine Learning, or a related technical discipline, or equivalent practical experience.

Nice to have

• Background in training state-of-the-art large models at scale, with an understanding of distributed training challenges.
• Experience enhancing model performance on complex reasoning tasks involving math, coding, or logic.
• Familiarity with various transformer architectures and their transformations.
• Excellent communication skills and a passion for cross-functional collaboration between Research and Product teams.

About the company

Apple fosters a culture that values diversity, considering the differences in people's backgrounds, experiences, and perspectives as a core strength. The company is dedicated to inclusion and ensures that all applicants are treated fairly and equally throughout the hiring process.

• The company believes that diverse perspectives and experiences are its greatest asset.
• Apple is committed to inclusion and equal treatment for all applicants.