Software Engineer, Secure AI
Build and integrate secure, high-performance backend services for confidential AI inference, including APIs, cryptographic attestation workflows, gateways, and cloud-native orchestration. The role requires professional systems programming experience and familiarity with CI/CD and containerized environments.
About the job
Responsibilities
- Program and stabilize core microservices, bridging backend data pipelines with containerized inference runtimes.
- Design, expose, and optimize APIs for protected model ingestion, system lifecycle events, and inference requests.
- Integrate security sidecars and automated provisioning modules using asymmetric decryption protocols, including 4096-bit RSA, and cryptographic signature validation for attestation-gated asset release.
- Configure low-latency sidecar proxies and API gateways with end-to-end encryption and mutual authentication (mTLS).
- Maintain and update cloud-native application configurations, including Helm charts, to orchestrate isolated container runtimes across distributed execution clusters.
Requirements
- Professional fluency in Python, Rust, or C/C++ for performant backend services, API frameworks, or system microservices.
- Familiarity with CI/CD pipelines, container orchestration scripts, and automated validation frameworks.
Nice-to-haves
- Knowledge of digital certificate management, public key infrastructure (PKI), GPG, TLS 1.3, and mTLS.
- Familiarity with Trusted Execution Environments (TEEs), confidential computing, or remote attestation.
- Experience with high-throughput inference engines and serving frameworks such as vLLM or KServe in containerized environments.
Compensation and Benefits
- Base salary: €35,000–€45,000, commensurate with experience, skills, and location.
- Private health insurance, with optional additional coverage for partners and children at the employee's expense.
- Eligibility for Company Profits Interest Units or Profits Interest Units Appreciation Rights.
- Flexible compensation options, including meal, transportation, and childcare vouchers.
- Competitive time off and public holiday policies.
- Supportive, diverse, collaborative, and growth-oriented workplace.
Skills
Python, Rust, C++, CI/CD, Docker, Kubernetes, Helm, Public Key Infrastructure, Gpg, Tls 1.3, Mtls, Trusted Execution Environments, vLLM, Kserve
Similar jobs
Backend Engineering jobs
Rain
Remote
Design and lead secure, scalable wallet infrastructure spanning custody, key management, signing, authorization, and recovery. The role requires deep expertise in wallet or cryptographic security infrastructure, distributed systems architecture, and modern blockchain account models.
Supabase
Remote
Build and operate a globally distributed CI/CD execution platform, including branch orchestration, ephemeral build environments, scheduling, caching, and pipeline observability. Requires Go and TypeScript expertise plus at least 3 years building cloud infrastructure or distributed systems.
Kraken
PolandBuilds and owns high-performance Rust services and libraries powering consumer trading, payments, and crypto experiences. The role requires 3+ years of software engineering experience, distributed-systems knowledge, asynchronous Rust expertise, and a security-first approach.
Justworks
Toronto, Canada
Build and operate backend infrastructure for an AI agent platform, including orchestration, integrations, knowledge systems, trust and safety, and evaluation tooling. The role requires 5+ years of backend experience, hands-on LLM or agent experience, and strong ownership in an early-stage environment.
Scribe
Remote
Build and operate backend systems for large-scale data ingestion, workflow processing, and AI inference. The role requires 8+ years of backend experience, distributed-systems expertise, and proficiency with Python, TypeScript, or Go in production AWS environments.