AI Kernel Engineer
Develops and optimizes AI and LLM inference kernels for Quadric’s neural processing platform, profiling performance across hardware configurations and improving compiler and runtime components. Requires 5+ years of kernel optimization experience, strong C/C++ and Python skills, and familiarity with CUDA, DSP, NEON, or Triton.
About the job
Responsibilities
- Develop AI/LLM kernels and operators on the Quadric platform for efficient inference.
- Optimize kernel performance for different hardware configurations and workloads.
- Profile and analyze kernel performance across compute, data, and parallelism; identify micro-architecture and software bottlenecks and provide optimization solutions.
- Optimize kernel C/C++ code and maximize hardware utilization.
- Collaborate across related areas of the AI inference stack to support team and business priorities.
- Improve the Quadric toolchain, compiler, and runtime.
- Provide technical support and documentation to customers and the developer community.
Requirements
- Bachelor's or master's degree in Computer Science and/or Electrical Engineering.
- 5+ years of experience in AI kernel development and optimization.
- Experience with model and kernel inference performance profiling.
- Experience with at least one of the following compute development technologies: CUDA, DSP, NEON, or Triton.
- Proficiency in C/C++ and Python.
- Assembly language experience is a plus.
- Strong problem-solving, debugging, and communication skills.
Benefits
- Competitive salary and meaningful equity.
- A politics-free community for people who want to make an immediate impact.
- Opportunities to build long-term career relationships.
- An environment that supports lasting personal relationships alongside professional ones.
Skills
C++, C, Python, CUDA, Dsp, Neon, Triton, Assembly Language, Compiler Toolchain, Runtime Optimization
Similar jobs
AI Research jobsConduct applied research on AI agents, designing experiments and evaluation systems to improve reliability, context retention, and multi-step task completion. The role requires strong AI/ML research, engineering, experimental design, and communication skills.
Conduct research on long-horizon, multi-agent AI behavior by designing agent environments, analyzing large-scale data, and running experiments. The role requires strong research judgment, rapid execution, independence, and familiarity with current AI developments.
Build, optimize, and evaluate long-running and multi-agent AI systems, along with tools for monitoring and analyzing their real-world behavior. The role requires software engineering experience with coding agents, strong independence, and familiarity with current AI developments.
Build Vanta’s organizational intelligence layer by shipping prototypes, internal tools, and AI agent workflows that make cross-source data useful to EPD, GTM, and other teams. The role requires recent hands-on LLM product work, independent problem scoping, and strong judgment around AI quality, reliability, cost, and latency.