AI Engineer - LLM Specialist

AlpineAI AG seeks a Mid-level AI Engineer specializing in LLMs for an onsite role in Zürich. The position focuses on testing, evaluating, and operationalizing large language models to ensure high accuracy, safety, and performance for real-world customer applications.

This position centers on transforming advanced language models into reliable, production-ready systems that address genuine customer challenges. The primary objective is to rigorously test, evaluate, and deploy these models while maintaining strict standards for accuracy, robustness, safety, and overall performance.

Responsibilities

• Develop and sustain systematic evaluation frameworks for LLMs, encompassing automated test suites, golden datasets, and regression benchmarks.
• Establish quantitative metrics (such as accuracy, latency, hallucination rate, task success) and qualitative evaluation protocols.
• Conduct error analysis and root-cause investigations on model failures.
• Focus on rapid prototyping and operationalization of customer use cases.
• Improve model performance on specific tasks using a prompt-first workflow (system prompts, few-shot examples, tool instructions).
• Build and iterate evaluation sets; run experiments to measure quality, latency, and cost.
• Curate high-signal datasets for automated prompt optimization (cleaning, labeling, filtering, augmentation).
• Apply lightweight adaptation when beneficial (prompt tuning, parameter-efficient methods like LoRA/adapters).
• Use supervised fine-tuning / instruction tuning when prompting and lightweight methods don’t reach the target.
• Prepare and curate training datasets (cleaning, labeling, augmentation, filtering).
• Evaluate and compare open-source and commercial LLMs for specific use cases.
• Design controlled experiments (A/B tests, offline evaluations).

Requirements

• At least 3–5 years of experience in machine learning or applied AI.
• Practical experience working with LLMs in production or advanced prototypes.
• Experience with PyTorch or TensorFlow.
• Familiarity with fine-tuning techniques and training pipelines.
• Strong understanding of experimental design.
• Experience building evaluation harnesses.
• Strong Python skills.
• Familiarity with REST APIs and backend integration.
• Experience with dataset preprocessing, labeling pipelines, and versioning.
• Familiarity with Docker, CI/CD, and model deployment.
• Good verbal and written communication in English and German.

What the company offers

• Opportunity to participate in AlpineAI’s company shares program after initiation period.
• Dynamic, innovation-driven culture.
• High autonomy and real product impact.
• Close collaboration with experts in speech, NLP, and applied AI.
• Exposure to cutting-edge AI technologies.
• On-site role in Zurich or Davos.

About the company

AlpineAI AG fosters a dynamic, innovation-driven culture where employees enjoy high autonomy and real product impact. The team includes experts in speech, NLP, and applied AI.

• The company culture is dynamic and innovation-driven.
• The role offers high autonomy and real product impact.
• The team includes experts in speech, NLP, and applied AI.

How to apply

Documents to submit:

• CV
• Cover letter