Skip to content
Mark43Mark43Boston, MA

Senior Software Engineer - Enterprise AI

Builds scalable AI-powered internal tools, integrations, and services to enable AI adoption across teams. Partners with IT, security, and business ops to deliver secure, production-ready solutions with 5+ years experience in software engineering and AI technologies.

Salary not listed
Hybrid5+ YOEML Engineering

About the role

What You’ll Do

  • Built and deployed a reusable AI-powered service or integration that enabled a business team to automate a critical workflow
  • Designed and implemented connectors between AI systems and internal or third-party platforms such as Salesforce or Workday
  • Partnered with stakeholders to identify a high-impact opportunity and translated it into a scalable internal tool or workflow
  • Improved reliability and performance of an existing AI-enabled system by debugging across APIs, services, and infrastructure
  • Evaluated new AI tools or frameworks and contributed to decisions on how they can be securely adopted at scale
  • Partnered with InfoSec to ensure systems meet security, compliance, and governance standards
  • Led a working session or demo to help teams understand and adopt new AI-enabled capabilities
  • Built reusable components, services, or patterns that make it easier for other teams to leverage AI

What You’ll Need

  • 5+ years of experience in software engineering or related technical roles
  • Strong hands-on experience building and shipping production systems using modern programming languages and frameworks
  • Experience working with AI technologies such as LLMs and an understanding of how to integrate them into applications and workflows
  • Strong experience with REST APIs, microservices, and system integrations
  • Experience building internal tools, platforms, or shared services used by multiple teams
  • Familiarity with authentication and security patterns such as OAuth, JWT, and IAM
  • Ability to debug across full-stack systems including services, APIs, workflows, and cloud infrastructure
  • Strong communication skills and the ability to work effectively with both technical and non-technical stakeholders

Nice to have

  • Experience building AI-powered applications using tools such as OpenAI, Claude, or similar platforms
  • Experience with enterprise automation or integration platforms
  • Familiarity with cloud platforms such as AWS, Azure, or GCP
  • Experience with data governance, security, and compliance in enterprise environments

Skills

LLMsREST APIsMicroservicesOAuthJwtIAMOpenAIClaudeAWSGCPSalesforceWorkdayKubernetes

Similar roles

ML Engineering jobs
DAT Freight & Analytics

Senior Applied Scientist

DAT Freight & AnalyticsSeattle, WA

Senior Applied Scientist building and productionizing high-recall fraud detection, risk scoring, graph-based anomaly detection, and decision engines for Trust & Safety in a freight marketplace. Requires advanced degree, 5+ years production ML experience, and strong Python skills.

183k – 226k/yr
Hybrid5+ YOEML Engineering
Airbnb

Senior Machine Learning Engineer, Relevance and Personalization

AirbnbUnited States

Build and productionize cutting-edge ML models for Airbnb's query intelligence, including autocomplete, query tagging, expansion, intent modeling, and LLM-powered natural language search to understand guest intent.

200k – 235k/yr
Remote5+ YOEML Engineering
Scale AI

Senior Machine Learning Engineer, Agent Oversight

Scale AISan Francisco, CA +1

Senior ML Engineer building observability, evaluation frameworks, and improvement loops for production agentic AI systems. Requires 5+ years production ML/LLM experience, strong grounding in agent design or evaluation, and hands-on work taking systems from prototype to scale.

216k – 270k/yr
On-site5+ YOEML Engineering
Scale AI

Senior Software Engineer, Agent Oversight

Scale AISan Francisco, CA +1

Build platform infrastructure for observing, evaluating, and improving production AI agents at scale. Requires 4+ years software engineering experience with ML/LLM systems, strong backend/distributed systems skills, and collaboration with ML engineers.

216k – 270k/yr
On-site5+ YOEML Engineering
Ambient.ai

Senior Software Engineer, AI Infrastructure

Ambient.aiRedwood City, CA

Build and optimize scalable AI infrastructure for real-time inference, evaluation, and continuous improvement of LLMs, LVMs, computer vision, and multimodal models on large-scale video data. Requires 4+ years production ML systems experience, strong Python skills, and expertise in inference optimization and model serving.

168k – 205k/yr
Hybrid4+ YOEML Engineering