Senior Data Analyst: AI-Driven Data Pipelines in Houston

General Index Limited; Houston (TX); On-site; USD 90,000 - 140,000; Full time

Benefits offered by this job

Competitive base salary

Private health insurance

401k plan

Mentoring from experienced colleagues

Structured development and internal/e​

Job summary

General Index Limited is seeking a Senior Data Analyst in Houston to lead data projects from specification to release, build and automate pipelines, support daily price assessments, and mentor other analysts.

You will join the Data team within our Product group, collaborating with data colleagues across regions. The role emphasizes delivering data-driven solutions, developing datasets, and applying AI tools to enhance analyses.

Qualifications

• Five or more years working with commodity, financial or other complex data.
• Strong Python and SQL experience, including complex queries.
• Hands-on experience with agentic AI coding tools (e.g. Claude Code, Codex).
• Experience building or maintaining data pipelines and automated processes.
• Experience taking projects from requirements to delivery.
• Experience reviewing others' work and giving useful technical feedback.
• A real interest in using AI in your work.
• Strong numerical and problem-solving skills, and close attention to detail.
• Clear communication, including explaining technical issues to non-technical colleagues and working with global teams.

Responsibilities

• Own data projects and epics: agree requirements and scope with stakeholders, choose the technical approach, and deliver on time.
• Write clear, testable specifications before work starts, covering requirements, acceptance criteria and edge cases.
• Build pipelines in our core system, using Python and SQL to bring new trade and pricing data into our standard format.
• Add new datasets, learning what the market data means and building the processes that clean and validate it.
• Automate existing pipelines and recurring tasks, and build new tools as the business grows.
• Provide operational and QA support for daily assessment processes, and help fix operational issues.
• Review and QA other analysts' work, and check that code and data, whether a person or an AI built them, meet the specification before release.
• Run regular code and pipeline reviews, and help the team follow best practice.
• Find better ways of working to make the Data team faster and more reliable.
• Act as the link between the Index and Data teams, turning methodology requirements into technical solutions.
• Help develop the assessment algorithms behind new and existing benchmarks.
• Be the team's go-to person on commodity trading, market data and price assessment.
• Mentor Data Analysts and help them with day-to-day work and harder problems.
• Help train new analysts, and keep training materials and documentation up to date.

Skills

Python

SQL

Data pipelines

Requirements gathering

Communication

Problem solving

Education

CS / Engineering / Data Science degree

Tools

Claude Code

Codex

Job description

General Index Limited is seeking a Senior Data Analyst in Houston to lead data projects from specification to release, build and automate pipelines, support daily price assessments, and mentor other analysts.

You will join the Data team within our Product group, collaborating with data colleagues across regions. The role emphasizes delivering data-driven solutions, developing datasets, and applying AI tools to enhance analyses.