Baer AG seeks a Senior Test Manager & Quality Engineer in Zürich to oversee testing for AI/ML solutions across the development lifecycle, ensuring quality and compliance before evaluation and deployment.
The company is looking for a professional to join its ML & AI Agile Release Train as a Test Manager and Quality Engineer. The role focuses on assessing solution quality during development, providing active feedback to engineering teams, and acting as the final quality gate before Model Risk Management evaluation and Go-Live.
Responsibilities
- Guarantee the quality and thorough testing of AI use cases.
- Develop and refine the technical testing strategy and framework architecture for the ML & AI ART, ensuring alignment with the Bank's overall testing policies.
- Create scalable, reusable testing patterns, such as page objects and API clients, to maintain technical consistency across squads.
- Evaluate requirements and user stories for testability during planning sessions like PI Planning and Backlog Refinement.
- Derive test cases from functional and non-functional requirements, selecting appropriate techniques and automation scope based on risk and ROI.
- Automate test cases using Python-based frameworks, including Playwright-Python for UI, requests and pytest for APIs, and Behave or pytest-bdd for BDD/Gherkin.
- Design and implement AI/ML-specific test cases, including evaluation pipelines for LLM outputs.
- Integrate and orchestrate automated tests within GitLab CI/CD pipelines, utilizing GitLab runners.
- Plan and trigger automated test executions across various environments, including regression suites and release executions.
- Triage execution results, log defects in Jira with supporting evidence, and communicate quality signals to the squad and Product Owner.
- Participate actively in SAFe ceremonies, including PI Planning, System Demos, and Inspect & Adapt.
- Prepare test data, prioritizing synthetic or anonymized data to meet confidentiality standards.
Requirements
- Proven experience integrating and executing tests for AI solutions or large-scale data projects.
- Strong understanding of Git, version control workflows, clean code principles, and code review culture.
- Working knowledge of Docker and familiarity with Kubernetes basics.
- Exposure to testing AI/ML systems or a strong motivation to develop expertise in LLM output evaluation and RAG workflows.
- Understanding of API design, microservices, event-driven architectures, and authentication layers.
- Sound knowledge of SAFe and DevOps principles, with experience in an Agile Release Train being advantageous.
- Experience with Jira for story tracking and test management integration.
- Demonstrated end-to-end thinking, connecting user journeys, data flows, and system boundaries.
- Comfortable working within an established Test Strategy and collaborating with Test Managers.
- Collaborative team player with strong ownership and minimal supervision.
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
- Minimum 5–7 years of experience with data & ML platforms, including substantial hands-on Python experience.
- Experience in a regulated environment is strongly preferred.
- ISTQB Foundation certification.
- SAFe or DevOps certifications are a plus.
- Exposure to AI/ML systems is a strong plus.
- Strong communication skills to work effectively with engineers, Product Owners, and Scrum Masters.
- Good organizational skills, structured and reliable.
- Fluency in English; German is a plus.
Nice to have
- Experience operating in an Agile Release Train.
- SAFe (SP, SSM, or equivalent) or DevOps disciplines.
- Exposure to AI/ML systems through testing, development, or applied projects.
- German language skills.
About the company
At Julius Baer, the company celebrates and values individual qualities, empowering employees to be impactful, entrepreneurial, and to create value beyond wealth. The company invites candidates to shape the future of wealth management together.
- Celebrates and values individual qualities.
- Empowers employees to be impactful and entrepreneurial.
- Focuses on creating value beyond wealth.
- Invites employees to shape the future of wealth management together.
How to apply
Documents to submit:
Quelle: öffentlich zugängliche Karriereseite des Arbeitgebers. Batchly ist nicht der Arbeitgeber und steht nicht notwendigerweise in einem Vertragsverhältnis mit dem Unternehmen.