Data Engineer – Data Acquisition

GMS Advisors; Chicago, Austin, New York (IL, TX, NY); On-site; USD 80,000 - 140,000; Full time

Job summary

Join a forward-thinking firm as a Data Engineer, where your creativity and enthusiasm will help build an exceptional Data Platform. In this exciting role, you will manage data flows, maintain a data lake, and create analytics-ready datasets that empower investment teams to make informed decisions. Collaborate with analysts and portfolio managers to design innovative data solutions, while leveraging your expertise in Python, SQL, and cloud technologies. This position offers a unique opportunity to work with large datasets and contribute to cutting-edge data infrastructure, making a significant impact in the financial industry.

Qualifications

• 3+ years of experience with Spark/Hive/Hadoop.
• Strong analytical and programming skills in Python and SQL.

Responsibilities

• Develop cloud-first data ingestion processes using Python and SQL.
• Engineer data models and maintain alerting systems for datasets.

Skills

Python

SQL

Data Analysis

Data Modeling

Cloud Technologies

Analytical Skills

Team Collaboration

Education

Bachelor's degree in Computer Science

Master's degree in Computer Science

Tools

Spark

Airflow

AWS

Hadoop

Job description

We are looking for creative and enthusiastic Data Engineers to join our team in building the best Data Platform on the street. We’re responsible for managing the flow of data into the firm, maintaining the data lake, creating analytics-ready datasets, and building the APIs that make everything accessible to our clients. Our singular goal is to help our investment teams use data to make better investment decisions.

Our analysts and systematic trading teams rely on us to provide analytics-ready datasets. For each dataset we must consider the implications of point in time storage, optimize for our users’ access patterns, and create useful aggregations/slices. Our ideal candidate will have experience with storing, transforming, and modeling big data.

In this role, you will:

• Develop cloud-first data ingestion processes using Python, SQL, and Spark
• Engineer data models and infrastructure for a wide variety of market and alternative datasets
• Design and build services and plugins to enhance our Data Acquisition Platform
• Maintain alerting systems to ensure smooth day-to-day operations for hundreds of datasets
• Author tests to validate data quality and the stability of the platform
• Investigate and defuse time-sensitive data incidents
• Communicate with data providers to onboard new datasets and troubleshoot technical issues
• Evangelize best practices to our partners throughout the firm
• Work directly with Analysts, Quants, and Portfolio Managers to understand requirements and provide end-to-end data solutions

WHAT YOU’LL BRING

• Bachelors/master’s degree in computer science or a related field
• Strong analytical, data, and programming skills (Python/SQL/NoSQL)
• 3+ years of experience with at least one of Spark/Hive/Hadoop
• 2+ years of experience orchestrating pipelines with a technology likeAirflow/Luigi/Oozie/Nifi
• 1+ years of experience with cloud technologies (AWS / Azure / Google Cloud)
• Solid understanding of time series data and temporal queries
• Experience with large data sets and techniques to architect them for performance
• Ability to understand and contribute to our existing data system software
• Aptitude for designing infrastructure, data products, and tools for Data Scientists a plus
• Financial industry experience is a plus
• Strong oral and written communication skills, most importantly, must be a team player