Huawei Switzerland seeks a Senior Researcher in AI Computing Systems based in Zürich to optimize LLM inference, RAG acceleration, and KV-cache pipelines through research-driven engineering.
The position focuses on bridging advanced research concepts with high-performance system implementation. The successful candidate will work on both low-level kernel optimization and system-level inference stacks, transforming theoretical ideas into efficient, production-ready code for large language models.
Responsibilities
- Create and deploy techniques to accelerate Retrieval-Augmented Generation (RAG), aiming to lower time-to-first-token and boost overall throughput.
- Build and refine pipelines for KV-cache reuse and blending, ensuring seamless integration with modern inference frameworks.
- Develop and tune sparse and selective attention mechanisms to enhance model efficiency.
- Utilize PyTorch and contemporary attention backends to profile, analyze, and optimize computational performance.
- Monitor emerging trends in open-source LLM inference, caching strategies, and RAG architectures, applying relevant advancements to internal projects.
Requirements
- Doctoral degree in Computer Science, Electrical Engineering, or a closely related discipline.
- Proficiency in Python software development, backed by extensive hands-on experience with PyTorch.
- Comprehensive knowledge of transformer inference mechanics and fundamentals.
- Proven ability to benchmark AI workloads, profile LLM execution, and identify performance constraints.
- Excellent interpersonal abilities and a collaborative mindset for working across research and engineering teams.
Nice to have
- Prior exposure to vLLM or LMCache frameworks.
- Understanding of attention kernel architectures and the ability to customize them.
- Hands-on background in constructing RAG workflows.
- Publications, technical reports, or open-source contributions related to AI systems, LLM inference, caching, or storage-aware machine learning.
- Deep systems expertise covering Linux, performance engineering, storage/IO, and memory hierarchy, with comfort operating near hardware levels.
What the company offers
- Work alongside top-tier scientists and engineers within a supportive, curiosity-focused setting.
- Utilize cutting-edge technology and development tools.
- Engage in continuous professional development and career advancement opportunities.
- Receive a competitive compensation package alongside the high living standards found in Zürich.
- Contribute to groundbreaking initiatives that drive meaningful impact.
About the company
Huawei Switzerland operates from research hubs in Zürich and Lausanne, driving innovation in high-performance computing, computer architecture, and artificial intelligence. Guided by a mission to enrich lives through intelligent innovation, the company plays a leading role in global digital transformation, pioneering advancements in cloud computing, smart devices, and networking technologies.
- Fosters an open, curiosity-driven environment that encourages collaboration with world-class experts.
- Focuses on pioneering breakthroughs across multiple technology domains including AI, robotics, and wireless systems.
- Committed to enriching lives through communication and intelligent innovation.
- Positions itself at the forefront of global digital transformation.
Quelle: öffentlich zugängliche Karriereseite des Arbeitgebers. Batchly ist nicht der Arbeitgeber und steht nicht notwendigerweise in einem Vertragsverhältnis mit dem Unternehmen.