AI Kernel Engineer
Develops and optimizes AI/LLM kernels for efficient neural network inference on Quadric's GPNPU platform. Requires 5+ years in AI kernel development, C/C++ proficiency, and experience with compute frameworks like CUDA or DSP.
About the job
Responsibilities
- Develop AI/LLM kernels/operators on Quadric platform for efficient inference
- Optimize the kernel performance for different hardware configurations and workloads
- Profile and analyze kernel performance in terms of compute, data and parallelism; identify micro-architecture and software bottlenecks and provide optimization solutions
- Optimize kernel C/C++ codes, maximize hardware utilization
- Collaborate across related areas of the AI inference stack to support team and business priorities
- Make improvements to Quadric toolchain, compiler and runtime
- Provide technical support and documents to customers and developer community
Requirements
- Bachelor’s or Master’s in Computer Science and/or Electrical Engineering
- 5+ years of experience in AI kernel development and optimization
- Experience with model and kernel inference performance profiling
- Experience with at least one of the following compute development: CUDA, DSP, NEON, Triton-lang
- Proficiency in C/C++ and Python, experience with assembly language a plus
- Demonstrate good capability in problem solving, debug and communication
Benefits
- Competitive salary and meaningful equity
- Medical, dental, and vision plan options starting on day one
- 401(k) retirement plan
- Flexible paid time off (unlimited, non-accrual)
- Company-provided lunches and stocked kitchen (in-office)
- Support for commuting, including monthly parking or Caltrain passes
Skills
C/C++, Python, CUDA, Dsp, Neon, Triton-Lang, Assembly, Performance Profiling, Ai Kernels, Kernel Optimization
Similar jobs
Backend Engineering jobs
PrizePicks
United States
Build and scale Ruby on Rails backend services for rewards, incentives, and loyalty features in a high-throughput platform. The role owns complex feature delivery, contributes to architecture, mentors junior engineers, and requires 3+ years of professional software engineering experience.
Twilio
United States
Build and operate backend capabilities for a cloud identity platform, including authentication flows, APIs, and developer experiences. The role requires 3+ years of experience with high-scale production systems and RESTful API development, with Go, TypeScript, and DynamoDB as preferred skills.
Anthropic
San Francisco, CABuild and scale reliable research infrastructure and distributed systems for evolving AI research workflows. The role independently leads complex technical projects, makes foundational architectural decisions, and partners with researchers and engineering teams.
Cloudflare
Austin, TXBuild and operate Internet-scale HTTP and TLS infrastructure, migrate services to a Rust-based proxy, and improve protocol performance. The role requires systems programming experience, strong reliability and security practices, and interest in open-source standards.
Writer
San Francisco, CABuild secure, scalable backend platforms and AI integrations connecting enterprise systems, tools, and data sources. The role requires 5+ years of backend engineering experience, distributed-systems expertise, cloud-native operations, authentication security, and technical leadership.