Senior Data Scientist + Gen AI

Ethereum Technologies LLC; Houston (TX); On-site; USD 83,000 - 118,000; Full time

Job summary

Ethereum Technologies is seeking a Senior Data Scientist + Gen AI to build production-grade Gen AI systems in Houston. The role emphasizes prompt engineering, tool orchestration, and multi-step reasoning with a strong Python background.

You will develop evaluation metrics, observability, and grounding validation to reduce hallucinations and improve faithfulness. Work includes RBAC security and privacy considerations in a production environment.

Qualifications

• Hands-on production experience with Gen AI systems.
• Strong Python expertise with real production experience.
• Prompt engineering including system prompts, tool prompts, function calling, and versioning with evaluations.
• Evaluation & observability including ground truth setup and confusion metrics, hallucination rate measurement, and LLM-as-judge with human review.
• Context management and faithfulness/grounding validation, agentic workflows, multi-step reasoning, and tool orchestration.

Responsibilities

• Build production-grade Generative AI systems with emphasis on prompt engineering.
• Develop and maintain evaluation metrics and observability dashboards for model outputs.
• Design and implement agentic workflows with robust tool orchestration.
• Ensure security and privacy through RBAC and compliant data practices.

Skills

Large Language Models

AWS

Prompt Engineering

Python

Machine Learning

Gen AI

Confluence

Jira

Tools

Airflow

AWS Bedrock

Job description

US Citizen, Green Card, H-1B, OPT-EAD, CPT, Other

• Job Title: Senior Data Scientist + Gen AI
• Location: Houston, TX
• Duration: 6 Months
• Bill Rate: $73/hour (C2C)
• Job Type: W-2, 1099, C2C
• Client: To Be Discussed Later
• Work Authorization: US Citizen, Green Card, OPT-EAD, CPT, H-1B, H4-EAD, Other

Build production-grade Generative AI systems with emphasis on:

• Prompt engineering (system prompts, tool prompts, function calling, versioning with evaluations)
• Evaluation & observability , including:
• Ground truth setup
• Confusion metrics
• Hallucination rate measurement
• LLM-as-judge with human review
• Context management
• Faithfulness & grounding validation
• Agentic workflows
• Multi-step reasoning
• Tool orchestration
• Agent success rate measurement
• AWS Bedrock
• Workflow orchestration
• Airflow
• Security & privacy
• RBAC
• Strong Python expertise with real production experience

Success Criteria:

• Measurable quality lift (accuracy, faithfulness, confusion metrics)
• Reduced hallucinations

Skills:

Large Language Models, AWS, Prompt Engineering, Python, Machine Learning, Gen AI, Confluence, Jira

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.