Data Researcher (Generative AI Analytics)

PTR Global; Elk Grove (CA); Hybrid; USD 89,544 - 96,432; Full time

Benefits offered by this job

Medical, dental, and vision

401K contributions

Job summary

PTR Global is seeking a Data Researcher/Data Scientist with a strong research mindset to evaluate Generative AI and LLM-powered analytics agents through rigorous experimentation. Day 1 onsite Sunnyvale, CA / Austin, TX / Elk Grove, CA with a Hybrid – 3 days onsite and 2 days remote.

Required skills include Python, SQL, Snowflake; Generative AI, LLMs, Prompt Engineering, RAG, and AI agents; experimental design, hypothesis testing and statistical analysis; experimental documentation and

Qualifications

• Experience designing controlled experiments and forming hypotheses.
• Strong background in statistical analysis and hypothesis testing.
• Hands-on experience with Python, SQL, and Snowflake.
• Experience evaluating AI/ML model performance and documenting reproducible research.

Responsibilities

• Evaluate Generative AI analytics agents through rigorous experimentation.
• Design controlled experiments with baselines and bias control.
• Document reproducible research and maintain logs of experiments.

Skills

Python

SQL

Snowflake

Generative AI

LLMs

Prompt Engineering

RAG

AI Agents

Experimental design

Hypothesis testing

Statistical analysis

Reproducible research

Job description

Data Researcher (Generative AI Analytics)

Day 1 onsite Sunnyvale, CA / Austin, TX / Elk Grove, CA (Prefers local folks)

Hybrid – 3 days onsite and 2 days remote

Long term contract

No mid layer / No Implementation partners are Involved

Mode of Interview: 1 Round Virtual Interview Mostly

We're looking for a Data Researcher/Data Scientist with a strong research mindset to evaluate Generative AI and LLM-powered analytics agents through rigorous experimentation.

Required Skills:

• 5+ years of Data Science experience (Python, SQL, Snowflake)
• Experience with Generative AI, LLMs, Prompt Engineering, RAG, or AI Agents
• Strong background in experimental design, hypothesis testing, and statistical analysis
• Experience evaluating AI/ML model performance and documenting reproducible research.
• 3+ years of hands-on experience designing controlled experiments — forming hypotheses, holding conditions constant while varying one thing at a time, establishing baselines, and designing against bias.
• 1+ year of hands-on experience constructing AI agents and using AI for analytics — prompt engineering, model/parameter control (temperature, etc.), programmatic API access, retrieval/RAG, and agent architecture..
• Experienced enough to modify these components confidently, because they are the variables you’ll be manipulating.
• 5+ years of data science fundamentals, including Python, SQL, and Snowflake; ability to reason about metrics and define what a “correct answer” to an analytical question actually is.
• 3+ years of experience evaluating model / ML system performance — measuring error and variability rigorously (percent error, distributions, reproducibility) and reasoning about failure modes.
• 5+ years maintaining disciplined, reproducible documentation — structured logging and records another person could re-run.

Skills:

• SQL – 5-10 Years
• Statistical analysis – 5-10 Years
• Data Science – 5-10 Years
• Research – 5-10 Years
• AI Agent – At least 1 year
• python - 5-10 Years

Preferred Qualifications

• Experience specifically evaluating LLM performance — measuring correctness and repeatability of non-deterministic systems.
• Tableau or similar visualization platforms.
• Domain familiarity with support / operations / IT analytics.
• Prior experience presenting research findings to executive audiences.

Pay Range: $65/hr - $70/hr

The specific compensation for this position will be determined by a number of factors, including the scope, complexity and location of the role as well as the cost of labor in the market; the skills, education, training, credentials and experience of the candidate; and other conditions of employment. Our full-time consultants have access to benefits including medical, dental, and vision as well as 401K contributions.