Software Engineer 3
Build testing and verification frameworks for application and database modernization, including functional equivalence, performance validation, data integrity, and LLM-assisted unit-test generation. The role requires 4+ years of software development experience, JVM expertise, and experience with testing frameworks, databases, and LLM evaluation.
About the job
Responsibilities
- Build and maintain automated testing and verification frameworks for application and database modernization.
- Develop tools for functional equivalence testing, performance benchmarking, data integrity validation, contract testing, database state-based testing, and LLM-generated unit tests.
- Design frameworks that verify database state equivalence across different implementations, including change data capture, event-driven database interception, listeners, relational database triggers, and state-comparison algorithms with pattern-based exclusions.
- Contribute high-quality, well-tested code to modernization frameworks and surrounding services.
- Collaborate with product management, engineers, and designers to deliver the product roadmap.
- Participate in code reviews and technical design reviews.
- Troubleshoot complex issues in distributed systems.
- Contribute to CI/CD, quality, testing, and engineering processes.
- Help recruit and interview new team members.
Requirements
- 4+ years of commercial software development experience.
- Experience with at least one JVM language, such as Java; Spring experience preferred.
- Experience evaluating large language models, including OpenAI, Anthropic, or open-weight models.
- Familiarity with DeepEval, Ragas, Promptfoo, and LLM-as-a-judge concepts.
- Experience integrating LLMs into developer workflows for automated unit-test generation and edge-case discovery.
- Experience creating golden datasets, adversarial test sets, and scoring rubrics for LLM accuracy, safety, and relevance.
- Experience building developer tools, infrastructure, or complex testing frameworks.
- Strong software architecture and development experience.
- Application or database modernization experience, including relational and document data modeling.
- Hands-on experience with at least one SQL database and one document database.
- Understanding of algorithms, data structures, and time and space complexity.
- Excellent verbal and written communication skills.
Nice-to-haves
- Experience with MongoDB or other document databases.
- Experience with PostgreSQL or MySQL.
- Experience with distributed systems and cross-functional software delivery.
Skills
Java, Spring, LLMs, Deepeval, Ragas, Promptfoo, Llm Evaluation, Unit Test Generation, Contract Testing, CI/CD, MongoDB, Postgres, MySQL, Distributed Systems, Data Modeling
Similar jobs
QA Engineering jobs
Q4 Inc
Pune, India
Quality Specialist responsible for software quality engineering across test design, automation, CI/CD, production monitoring, and AI-powered testing of LLM-backed and agentic features. Requires 5+ years of QA experience and familiarity with Java, Python or JavaScript, Selenium, Agile, and test management tools.
Fortanix
Bengaluru, India
The SDET will build and maintain automated test frameworks, execute functional and performance testing, integrate quality checks into CI/CD pipelines, and improve product reliability. The role requires a bachelor's degree and at least five years of SDET or comparable experience, with strong programming and automation skills.
Origin
Bengaluru, India
Owns verification and validation of mechanical subsystems and complete autonomous robot assemblies from prototype through production. The role requires hands-on mechanical testing, inspection, failure analysis, GD&T expertise, and collaboration across design, manufacturing, suppliers, and deployment teams.
Circle
Remote
Senior Quality Engineer partnering across product teams to assess risk, build web and API test automation, investigate technical failures, and improve quality practices. Requires strong Playwright and TypeScript experience, exploratory testing skills, CI/CD knowledge, and the ability to debug application code.
Fivetran
Bengaluru, India
Designs and maintains scalable Java-based test automation frameworks for data pipelines, databases, and distributed systems. The role also develops AI/LLM-assisted testing tools, strengthens CI/CD validation, and requires 6+ years of software industry experience.