# Machine Learning Engineer

**Company:** [OPSWAT](https://hotfix.jobs/companies/opswat)
**Location:** Ho Chi Minh City, Vietnam
**Role:** ML Engineering
**Experience:** 3+ years
**Skills:** Python, RAG, AI Agents, Embeddings, Vector Databases, Prompt Engineering, Llm Evaluation, REST APIs, SQL, NoSQL, Docker, Git, CI/CD, vLLM, Ollama
**Posted:** 2026-08-26

> Build and integrate AI/LLM capabilities for a customer and partner portal, including RAG, agents, retrieval systems, and evaluation pipelines. The role requires 3+ years of AI/ML engineering experience, strong Python skills, and production experience serving and evaluating LLMs.

## Job Description

## Responsibilities
- Develop and integrate retrieval-augmented generation (RAG), AI agents, recommendation and search systems, and AI-powered automation workflows.
- Build and maintain data ingestion, embedding, retrieval, and evaluation pipelines.
- Collaborate with engineering and QA teams to design, build, test, and deliver AI features.
- Collaborate with DevOps to deploy, monitor, and optimize self-hosted large language models (LLMs).
- Establish evaluation gates for LLM changes.
- Continuously improve AI accuracy, latency, cost efficiency, security, and reliability.

## Requirements
- 3+ years of relevant AI/ML engineering experience.
- Strong Python skills, including building data pipelines for training datasets.
- Understanding of prompt engineering, RAG, embeddings, vector databases, tool calling, AI agents, and LLM evaluation.
- Experience with REST APIs, SQL and NoSQL databases, Docker, Git, and CI/CD.
- Ability to debug, evaluate, and validate AI systems in production environments.
- Experience with LLM serving and APIs such as OpenAI, Anthropic, and Azure OpenAI.
- Experience with inference tools such as vLLM and Ollama, including quantization and memory, latency, and quality trade-offs on constrained hardware.
- Ability to design and run evaluations for non-deterministic systems.
- Strong verbal and written English communication skills.
- Self-motivated, adaptable, and comfortable owning work in a fast-paced, collaborative environment.

## Nice to Have
- Experience fine-tuning open-weight LLMs.
- Experience with agent frameworks.
- Awareness of LLM security risks, including prompt injection, data leakage, and misuse.
- Experience deploying compact models on-premises, offline, or in resource-constrained environments.
- Experience with LLM evaluation tooling, including LLM-as-judge, regression suites, and human review loops.
- Cybersecurity knowledge or experience building security product components.

## Similar jobs

- [AI Engineer - New Verticals](https://hotfix.jobs/jobs/4159c72e-536e-4211-969c-6bcb9ad805fd) - Protege - Remote
- [Machine Learning Engineer](https://hotfix.jobs/jobs/9c6b9a26-bf82-414f-9642-3abf08ba4674) - OPSWAT - Ho Chi Minh City, Vietnam
- [Senior AI Engineer](https://hotfix.jobs/jobs/21a85bba-83b6-4f06-9c21-2eccd8cb28b4) - OPSWAT - Ho Chi Minh City, Vietnam
- [Staff Machine Learning Engineer](https://hotfix.jobs/jobs/2cb6da8f-4a54-448d-a4b6-fc05f1412a12) - Payabli - Remote

**Apply:** https://hotfix.jobs/jobs/7d95880a-4cb1-4212-8644-1c8df92ee3cf
**Canonical:** https://hotfix.jobs/jobs/7d95880a-4cb1-4212-8644-1c8df92ee3cf