Senior Gen AI Data Scientist - Production AI & Observability

Ethereum Technologies; Houston (TX); On-site; USD 83,000 - 118,000; Full time

Job summary

Ethereum Technologies is seeking a Senior Data Scientist + Gen AI to build production-grade Gen AI systems in Houston. The role emphasizes prompt engineering, tool orchestration, and multi-step reasoning with a strong Python background.

You will develop evaluation metrics, observability, and grounding validation to reduce hallucinations and improve faithfulness. Work includes RBAC security and privacy considerations in a production environment.

Qualifications

• Hands-on production experience with Gen AI systems.
• Strong Python expertise with real production experience.
• Prompt engineering including system prompts, tool prompts, function calling, and versioning with evaluations.
• Evaluation & observability including ground truth setup and confusion metrics, hallucination rate measurement, and LLM-as-judge with human review.
• Context management and faithfulness/grounding validation, agentic workflows, multi-step reasoning, and tool orchestration.

Responsibilities

• Build production-grade Generative AI systems with emphasis on prompt engineering.
• Develop and maintain evaluation metrics and observability dashboards for model outputs.
• Design and implement agentic workflows with robust tool orchestration.
• Ensure security and privacy through RBAC and compliant data practices.

Skills

Large Language Models

AWS

Prompt Engineering

Python

Machine Learning

Gen AI

Confluence

Jira

Tools

Airflow

AWS Bedrock

Job description

Ethereum Technologies is seeking a Senior Data Scientist + Gen AI to build production-grade Gen AI systems in Houston. The role emphasizes prompt engineering, tool orchestration, and multi-step reasoning with a strong Python background.

You will develop evaluation metrics, observability, and grounding validation to reduce hallucinations and improve faithfulness. Work includes RBAC security and privacy considerations in a production environment.