AI Analyst | Quant Insights & Model Optimisation

Level AI; Mountain View (CA); On-site; USD 110,000 - 170,000; Full time

Job summary

Level AI in Mountain View, CA is seeking an AI Analyst to drive product impact through quantitative research on user behavior and trends. You will build statistical models and analyze data to uncover key drivers informing strategic decisions.

You will propose automation enhancements, review AI model outputs, and improve performance via prompt engineering. The role emphasizes creating diverse data for development, evaluating results, and weekly business insights.

Qualifications

• Bachelor's degree or above with a good academic background.
• 1-2 years of full-time work experience as an AI Analyst.
• Experience in Python (Pandas, Matplotlib, NumPy) is a must.
• Experience in SQL is a must.
• Experience with Prompt Engineering is a plus.
• Familiarity with Classical ML Models (scikit-learn) and Deep Learning (Hugging Face, PyTorch) is a plus.
• Experience with Data Engineering is a plus.
• Employing test findings to do Statistical analysis and improve models.
• Knowledge of common metrics for evaluation of ML models is a plus.

Responsibilities

• Drive product impact by proposing and conducting quantitative research into key user behaviors and trends.
• Conduct in-depth analysis and build statistical models to identify trends and key drivers that inform important decisions made by the user.
• Data analysis to identify common trends.
• Based on analysis, propose enhancements for automation pipelines.
• Review the output of AI models to improve performance by identifying common usage gaps.
• Optimise AI model performance through effective prompt engineering techniques.
• Establish automated model performance improvement pipelines through prompt engineering.
• Responsible for generating, testing, evaluating, and curating high-quality, diverse data for AI model development, training, and performance.
• Analyse model performance by diving into user feedback data and product usage reports.
• Suggest ways to improve product usage by targeting each group of users and features.
• Create a business analysis report weekly.
• Define and monitor key metrics; investigate changes in metrics.
• Driven to continuously learn and adapt.

Skills

Python

SQL

Statistical analysis

Data analysis

Prompt engineering

Education

Bachelor's degree or above

Tools

Pandas

NumPy

Matplotlib

scikit-learn

PyTorch

Hugging Face

Job description

Level AI in Mountain View, CA is seeking an AI Analyst to drive product impact through quantitative research on user behavior and trends. You will build statistical models and analyze data to uncover key drivers informing strategic decisions.

You will propose automation enhancements, review AI model outputs, and improve performance via prompt engineering. The role emphasizes creating diverse data for development, evaluating results, and weekly business insights.