# Applied AI Data Analyst

**Company:** [Confido](https://hotfix.jobs/companies/confido)
**Location:** New York, NY
**Role:** Data Analytics
**Salary:** $180k – $240k/yr
**Experience:** 2+ years
**Skills:** Python, SQL, Ai/Ml Models, Postgres, Snowflake, dbt, AWS, Llm Evaluation, Langsmith, Arize Ai, Trulens, Agentic Workflows, Demand Forecasting, Time-Series Models, Statistical Modeling
**Posted:** 2026-08-18

> The Applied AI Data Analyst evaluates LLM-driven workflows and forecasting models, curates golden datasets, monitors performance, and performs root-cause analysis on complex financial and operational data. The role requires a graduate STEM degree, 2–4 years of quantitative or AI evaluation experience, Python, SQL, and enterprise data infrastructure expertise.

## Job Description

## Responsibilities
- Analyze edge cases, model predictions, hallucination rates, and extraction accuracy for LLM-driven document-processing systems and agentic workflows.
- Perform root-cause analysis on inconsistent financial documents and fragmented enterprise systems to determine why extraction or time-series models succeeded or failed.
- Define, curate, and maintain gold-standard evaluation datasets for automated backtesting of AI agents and demand-forecasting models.
- Build dashboards, data transformations, and evaluation harnesses to monitor system health, model drift, and AI performance metrics across release cycles.
- Partner with applied AI engineers, product managers, and business operations managers to turn real-world problem definitions into quantitative product insights.

## Requirements
- Graduate degree (M.S. or Ph.D.) in Computer Science, Data Science, Statistics, Mathematics, Physics, or a related STEM field.
- 2–4 years of experience in a quantitative data analyst or AI evaluation role working closely with AI/ML R&D teams.
- Proficiency in Python and hands-on experience with AI/ML models.
- Strong SQL skills and experience with enterprise data infrastructure, including PostgreSQL, Snowflake, dbt, and AWS.
- Ability to translate noisy, unstructured document data into rigorous evaluation insights for engineers.

## Nice to Have
- Experience with LLM observability, tracing, and evaluation frameworks such as LangSmith, Arize AI, or TruLens.
- Proficiency with agentic workflows or multi-agent orchestration.
- Familiarity with demand forecasting, time-series models, or statistical modeling.
- Comfort working in a fast-moving, high-growth startup environment.

## Compensation & Benefits
- Equity ownership.
- Fully paid employee health coverage through Aetna.
- Dental and vision coverage through Guardian.
- Carrot Fertility Pro fertility and family-forming support.
- 12 weeks of paid parental leave.
- Unlimited PTO and regular four-day holiday weekends.
- 401(k) through Vestwell.
- Paid relocation support.
- Fully equipped workspace, including a $200 setup stipend.
- Catered Friday lunches, team dinners, unlimited coffee, and snacks.

## Similar jobs

- [Forward Deployed Data Analyst](https://hotfix.jobs/jobs/c333cf44-6649-4569-9c71-7306271d43b6) - Valon - New York, NY - $160k – $190k/yr
- [Credit Risk Associate](https://hotfix.jobs/jobs/913ed11b-1191-4c46-94e6-480c9b2c5303) - Ramp - New York, NY - $108k – $200k/yr
- [Business Analyst II - Fraud](https://hotfix.jobs/jobs/8a58765f-e4ed-427a-b99f-5ddbcc0652ea) - PrizePicks - Remote - $100k – $110k/yr
- [Reliability Analyst](https://hotfix.jobs/jobs/b69ad7b1-bba8-4f03-86f8-8a5cc88873a2) - Shield AI - Dallas, TX - $96k – $144k/yr
- [Business Intelligence Data Analyst](https://hotfix.jobs/jobs/7774ae38-60ba-482b-a90a-4a62993b57e5) - OpenX - Remote - $94k – $110k/yr

**Apply:** https://hotfix.jobs/jobs/aa22e7fd-ad56-4848-9fe1-1d5d47ced608
**Canonical:** https://hotfix.jobs/jobs/aa22e7fd-ad56-4848-9fe1-1d5d47ced608