Data Engineer

Castleton Commodities International, LLC; Houston, Northern (TX, KY); Hybrid; USD 120,000 - 160,000; Full time

Benefits offered by this job

Competitive benefits

Parental and family leave policies

Tuition assistance & reimbursement

Quarterly Innovation & Collaboration**

Job summary

Castleton Commodities International, LLC is seeking a Data Engineer to join our Data Science & Technology team in Houston and Stamford. You will own data architecture, ingestion pipelines, and data quality initiatives to support trading and risk analytics.

You will collaborate with risk and commercial teams, transition datasets to new stacks, and optimize data flows for real-time and batch processing across global markets.

Qualifications

• Bachelor’s degree or higher in a quantitative or computing field.
• 3+ years of Data Engineering, SQL, data architecture, and modeling.
• Experience leading a data engineering team and delivering data solutions.

Responsibilities

• Execute data architecture and data management projects for new and existing sources.
• Manage end-to-end data ingestion and publish insights to investing teams.
• Map, standardize, and normalize data across datasets.
• Develop and optimize ETL/ELT pipelines for large-scale data.
• Collaborate with risk and front-office teams to gather requirements.

Skills

SQL programming

data architecture

dimension modeling

Python

Pandas

Numpy

ETL/ELT frameworks

leadership

Education

Bachelor's degree in Computer Science, Mathematics, Physics, Business Intelligence, or related field

Tools

Snowflake

Oracle

PowerBI

SnapLogic

Job description

Data Engineer page is loaded## Data Engineerlocations: Houston, TX: Stamford, CTtime type: Full timeposted on: Posted Todayjob requisition id: R1228Castleton Commodities International (https://www.cci.com) is a global leader in energy commodity trading and asset investment. Our Data Science & Technology team is central to our success, engineering the high-performance systems and innovative tools that power our commercial decision-making. We build the platforms that help our front-office teams understand market behavior, forecast price movements, and manage risk. Our team solves complex, high-impact challenges using a modern technology stack. We develop everything in cloud-native infrastructure from real-time analytics to backtesting engines, third party integrations, and internal libraries—all designed to give CCI a competitive edge in the global commodities markets. CCI is building a best-in-class data science platform as being on the forefront of data management and analytics is core to our investment platform. This position will play an integral role as the team implements new data management platforms, creates new data ingestion pipelines, and sources new data sets. The role will assist with all aspects of data – from data architecture design to on-going data management and will have significant exposure to our Risk and commercial investing teams globally.**Responsibilities*** Execute data architecture and data management projects for both new and existing data sources.* Help transition existing data sets, databases, and code to a new technology stack.* Manage end to end data ingestion process and publishing to investing teams.* Own the process of mapping, standardizing, and normalizing data.* Ad hoc research on project topics such as vendor trends, usage best practices, big data trends, artificial intelligence, vendors, etc.* Help transition existing data sets, databases, and code to a new technology stack.* Assess data loads for tactical errors and build out appropriate workflows, as well as create data quality analysis that identifies larger issues in data.* Actively manage vendors and capture changes in data input proactively.* Properly prioritize and resolve data issues based on business usage.* Assist with managing strategic initiatives around big data projects for the commercial (trading) business.* Partner with commercial teams to gain understanding of current data flow, data architecture, investment process as well as gather functional requirements.* Assess gaps in current datasets and remediate.**Qualifications:*** Bachelor’s degree in Computer Science, Mathematics, Physics, Business Intelligence, or related field of study.* 3+ years of Data Engineering experience specializing in SQL programming, data architecture, and dimension modeling.* Prior experience as a Technical Lead, managing a team of Data Engineers, overseeing project execution and ensuring the delivery of high-quality data solutions.* Experience in energy commodities or financial services is nice to have but not required.* Experience in mapping, standardizing, and normalizing data.* Experience with data integration platforms is preferred, and SnapLogic experience is highly preferred.* Extensive work experience with ETL/ELT frameworks to write pipelines to load millions/billions of records.* Advanced skills in writing highly optimized SQL code.* Hands-on experience developing data solutions in Python, Pandas, Numpy, etc.* Experience with relational databases Snowflake or Oracle is preferred.* Experience with PowerBI visualization tools.* Ability to communicate and interact with a wide range of data users – from very technical to non-technical.* Team player who is execution focused, with the ability to handle a rapidly changing set of projects. and priorities, while maintaining strong professional presence.* Ability to work effectively in a fast-paced, dynamic and high-intensity environment including an open-floor plan, with timely responsiveness and the ability to work beyond normal business hours when required.**Employee Programs & Benefits:**CCI offers competitive benefits and programs to support our employees, their families and local communities. These include:* Competitive comprehensive medical, dental, retirement and life insurance benefits* Employee assistance & wellness programs* Parental and family leave policies* CCI in the Community: Each office has a Charity Committee and as a part of this program employees are allocated 2 days annually to volunteer at the selected charities.* Charitable contribution match program* Tuition assistance & reimbursement* Quarterly Innovation & Collaboration Awards* Employee discount program, including access to fitness facilities* Competitive paid time off* Continued learning opportunitiesVisit to learn more!#LI-CD1Castleton Commodities International is a leading global energy commodities merchant and infrastructure asset investor. As a trader, CCI deploys capital on a proprietary basis in the physical and financial commodity markets, providing the Company with market insights and access. As a strategic investor and developer, CCI leverages its market expertise, operations capabilities, and industry knowledge to invest in, and develop, select commodity infrastructure assets. This fully integrated platform has generated strong risk-adjusted returns for our investors since our formation.