Senior BI Analyst: AI Evaluation & Monitoring

Remotedxb; Dubai; On-site; AED 350,000 - 600,000; Full time

Job summary

Geisinger seeks a seasoned data analytics professional to independently consult with AI stakeholders, gather evaluation requirements, and drive data-driven insights across the AI portfolio. You will execute validation studies and production monitoring while collaborating on reporting solutions and analytic studies.

You will design and validate complex queries, apply statistical methods to visualize results, and mentor junior BI developers.

Qualifications

• Minimum of 8 years of relevant experience.
• Proficiency in SQL and Python for data analysis.
• Knowledge of applied statistics including hypothesis testing and regression.
• Experience with LLM and generative AI evaluation.

Responsibilities

• Consult with AI stakeholders to gather evaluation and data requirements.
• Execute evaluation work for the AI portfolio including validation studies and production monitoring.
• Collaborate on reporting solutions and analytic studies.
• Develop, validate, and execute complex queries and reports.
• Use statistical methods to analyze data and visualize results.
• Mentor junior BI developers and participate in code reviews.
• Troubleshoot data quality issues through profiling and testing.

Skills

Data analysis

Statistical methods

Mentoring

Education

High School Diploma or GED

Tools

SQL

Python

Pandas

NumPy

scikit-learn

statsmodels

Job description

Geisinger seeks a seasoned data analytics professional to independently consult with AI stakeholders, gather evaluation requirements, and drive data-driven insights across the AI portfolio. You will execute validation studies and production monitoring while collaborating on reporting solutions and analytic studies.

You will design and validate complex queries, apply statistical methods to visualize results, and mentor junior BI developers.