Data Engineer: Snowflake & AWS Cloud Data Pipelines

RCM-X; New York (NY); Hybrid; USD 95,000 - 115,000; Full time

Benefits offered by this job

Health insurance

401(k) retirement plan

Transit benefits

PTO 22 days per year

Volunteer day

Professional development days

Hybrid in-office three days per week

Job summary

Trading Technologies in New York is seeking a Data Engineer to join the Data & Analytics engineering team. You will work across SQL Server and Snowflake environments, migrating data to Snowflake on AWS and building scalable data pipelines.

Responsibilities include optimizing complex SQL, developing ETL/ELT workflows with Airflow, and collaborating with software engineers, product teams, and DevOps to support TCA-related analytics and large-scale market data processing.

Qualifications

• Bachelor’s degree in Computer Science, Data Engineering, or a related field.
• Strong SQL Server and Snowflake experience.
• Experience with ETL/ELT, Airflow, and AWS.

Responsibilities

• Develop, maintain, and optimize complex SQL Server queries, stored procedures, functions, views, and data processing workflows.
• Design and develop scalable Snowflake data solutions, including data models, SQL transformations, loading processes, and analytical workloads.
• Participate in the migration of large volumes of data and processing from SQL Server to Snowflake.
• Analyze existing SQL Server logic and translate or redesign it for Snowflake where appropriate.
• Build and maintain ETL/ELT pipelines using SQL, Python, and workflow orchestration tools such as Apache Airflow.
• Develop data ingestion and processing workflows using AWS, including S3.
• Perform SQL Server and Snowflake performance tuning, including query optimization, execution plans, indexing, statistics, warehouse sizing, and workload optimization.
• Build data validation and reconciliation processes to ensure migrated and transformed data is accurate and complete.
• Troubleshoot production data issues, identify root causes, and implement reliable long-term solutions.
• Implement monitoring, logging, alerting, and operational controls for critical data pipelines.
• Collaborate with software engineers, service managers and implementation team, product teams, and DevOps.
• Support and enhance existing Transaction Cost Analysis (TCA) products and develop new functionality.
• Work with large-scale trade, market, benchmark, and financial data.

Skills

SQL development

Python

C# scripting

Large data handling

Analytical thinking

Education

Bachelor’s degree in CS/Data Engineering

Tools

Snowflake

AWS

Apache Airflow

Git

CI/CD

Liquibase

Job description

Trading Technologies in New York is seeking a Data Engineer to join the Data & Analytics engineering team. You will work across SQL Server and Snowflake environments, migrating data to Snowflake on AWS and building scalable data pipelines.

Responsibilities include optimizing complex SQL, developing ETL/ELT workflows with Airflow, and collaborating with software engineers, product teams, and DevOps to support TCA-related analytics and large-scale market data processing.