AI Analyst
Analyzes user behavior, product usage, and AI model performance to guide product decisions and improve automation pipelines. The role requires a bachelor's degree, 1–2 years of AI analyst experience, Python and SQL proficiency, and statistical analysis skills.
About the job
Responsibilities
- Drive product impact by proposing and conducting quantitative research into key user behaviors and trends.
- Conduct in-depth analysis and build statistical models to identify trends and key drivers that inform user decisions.
- Analyze data to identify common trends.
- Propose enhancements for automation pipelines based on analysis.
- Review AI model output to identify common usage gaps and improve performance.
- Optimize AI model performance through prompt engineering.
- Establish automated model performance improvement pipelines through prompt engineering.
- Generate, test, evaluate, and curate high-quality, diverse, and representative data, including synthetic data, for AI model development, training, and performance.
- Analyze model performance using user feedback data and product usage reports.
- Suggest ways to improve product usage by targeting user groups and features.
- Create a weekly business analysis report.
- Define and monitor key metrics and investigate changes in metrics.
Requirements
- Bachelor's degree or above with a strong academic background.
- 1–2 years of full-time experience as an AI Analyst.
- Strong resourcefulness and willingness to grow in the SaaS AI field.
- Experience with Python, including Pandas, Matplotlib, and NumPy.
- Experience with SQL.
- Experience applying test findings to statistical analysis and model improvement.
Nice to Have
- Prompt engineering experience.
- Familiarity with classical machine learning models and scikit-learn.
- Familiarity with deep learning, Hugging Face, and PyTorch.
- Data engineering experience.
- Knowledge of common machine learning model evaluation metrics.
Skills
Python, pandas, Matplotlib, NumPy, SQL, Prompt Engineering, scikit-learn, Hugging Face, PyTorch, Statistical Analysis, Machine Learning, Deep Learning, Data Engineering, Model Evaluation Metrics
Similar jobs
Data Science jobs
Celonis
Bengaluru, India
Develop statistical and machine learning models, experimentation, visualizations, and foundation-model solutions to deliver operational insights and support strategic decisions. Requires a bachelor’s degree and 3+ years of relevant analytics or data experience in SaaS or enterprise software.
Airbnb
Gurugram, India
Leads advanced analytics for Airbnb’s Community Support business, partnering with product and business leaders on experimentation, scalable data solutions, forecasting, machine learning, and AI-first workflows. Requires 8+ years of experience, advanced quantitative training, expert SQL, advanced Python, and strong stakeholder leadership.
Vanta
Remote
The Senior Data Scientist will build scalable product analytics assets, measurement frameworks, and AI-assisted analytical workflows while partnering with cross-functional teams to guide product and business decisions. The role requires 4+ years of applied data experience and strong SQL, programming, statistics, machine learning, and experimentation skills.
Databricks
Bengaluru, India
Leads search quality for AI-agent retrieval and human search experiences, optimizing hybrid retrieval, ranking, relevance metrics, and evaluation frameworks. The role requires expertise in information retrieval, embeddings, Elasticsearch or Lucene, and RAG.
Databricks
Bengaluru, India
Owns search quality across hybrid retrieval systems serving AI agents and human users. The role focuses on ranking, relevance evaluation, embeddings, and grounding RAG outputs across heterogeneous enterprise data.