Skip to content

Staff Software Engineer - GenAI

United StatesML EngineeringRemote7+ YOE
Summary

Designs and builds scalable backend services integrating generative AI models like GPT/LLMs into low-latency SaaS platform for fraud/risk management. Requires 7+ years backend experience with 3+ in AI/ML, Python/Java, AWS, Kubernetes.

About the role

Responsibilities

  • Design and implement scalable backend services that leverage generative AI models to deliver high-performance, low-latency solutions.
  • Collaborate with product, frontend, and QA teams to define technical requirements and ensure seamless integration of AI models with other platform components.
  • Optimize AI models and backend services for maximum performance, scalability, and maintainability in a distributed environment.
  • Identify and resolve bottlenecks related to AI processing and system performance, ensuring efficient resource utilization and system stability.
  • Implement best practices for deploying, monitoring, and maintaining AI models in production, including CI/CD pipelines and model versioning.
  • Proactively monitor the health and performance of AI-driven backend services, applying strategies to mitigate potential issues and ensure high availability.

Requirements

  • Bachelor’s or master’s degree in computer science, Software Engineering, or a related field.
  • 7+ years of backend software development experience, with 3+ years focusing on AI/ML, including hands-on experience with generative AI models (e.g., GPT, LLMs).
  • Strong expertise in Python or Java and AWS technologies, with deep knowledge of building and operating low-latency, high-scale services in distributed environments.
  • Proven experience deploying and optimizing AI/ML models in production environments using containerization (Docker, Kubernetes) and cloud platforms (AWS, GCP).
  • Familiarity with microservices architecture, RESTful APIs, and security best practices in AI services.
  • Experience with distributed data systems such as Kafka, ClickHouse, or similar technologies to manage large-scale AI workloads.
  • Strong understanding of CI/CD tools (e.g., Jenkins, Git, Maven, Gradle) and agile development methodologies, with a focus on automating model deployment.
  • Excellent problem-solving abilities, with a focus on AI model performance optimization, scalability, and system architecture.

Benefits

  • Competitive salary and equity packages, including a 401k.
  • Remote-first culture — work from anywhere.
  • 100% Employer covered comprehensive health, dental, and vision insurance with a top tier plan for you and your dependents (US).
  • Unlimited PTO policy.
Skills
PythonJavaAWSKubernetesDockerGCPKafkaClickHouseRESTful APIsCI/CDJenkinsGitMavenGradleGenerative AI