Staff Software Engineer - GenAI
United StatesML EngineeringRemote7+ YOE
Summary
Designs and builds scalable backend services integrating generative AI models like GPT/LLMs into low-latency SaaS platform for fraud/risk management. Requires 7+ years backend experience with 3+ in AI/ML, Python/Java, AWS, Kubernetes.
About the role
Responsibilities
- Design and implement scalable backend services that leverage generative AI models to deliver high-performance, low-latency solutions.
- Collaborate with product, frontend, and QA teams to define technical requirements and ensure seamless integration of AI models with other platform components.
- Optimize AI models and backend services for maximum performance, scalability, and maintainability in a distributed environment.
- Identify and resolve bottlenecks related to AI processing and system performance, ensuring efficient resource utilization and system stability.
- Implement best practices for deploying, monitoring, and maintaining AI models in production, including CI/CD pipelines and model versioning.
- Proactively monitor the health and performance of AI-driven backend services, applying strategies to mitigate potential issues and ensure high availability.
Requirements
- Bachelor’s or master’s degree in computer science, Software Engineering, or a related field.
- 7+ years of backend software development experience, with 3+ years focusing on AI/ML, including hands-on experience with generative AI models (e.g., GPT, LLMs).
- Strong expertise in Python or Java and AWS technologies, with deep knowledge of building and operating low-latency, high-scale services in distributed environments.
- Proven experience deploying and optimizing AI/ML models in production environments using containerization (Docker, Kubernetes) and cloud platforms (AWS, GCP).
- Familiarity with microservices architecture, RESTful APIs, and security best practices in AI services.
- Experience with distributed data systems such as Kafka, ClickHouse, or similar technologies to manage large-scale AI workloads.
- Strong understanding of CI/CD tools (e.g., Jenkins, Git, Maven, Gradle) and agile development methodologies, with a focus on automating model deployment.
- Excellent problem-solving abilities, with a focus on AI model performance optimization, scalability, and system architecture.
Benefits
- Competitive salary and equity packages, including a 401k.
- Remote-first culture — work from anywhere.
- 100% Employer covered comprehensive health, dental, and vision insurance with a top tier plan for you and your dependents (US).
- Unlimited PTO policy.
Skills
PythonJavaAWSKubernetesDockerGCPKafkaClickHouseRESTful APIsCI/CDJenkinsGitMavenGradleGenerative AI