Senior Data Engineer - Finance Data Pipelines & AI (Remote)

Synechron; New York (NY); On-site; USD 120,000 - 170,000; Full time

Benefits offered by this job

Competitive compensation

Global offices in 21 countries

10 days paid annual leave

Maternity & paternity leave

Comprehensive insurance plans

Training & Udemy access

Job summary

Synechron seeks a Data Engineer to design and optimize data models for financial data, including reference, security master, and transactional trade data. You will develop scalable data pipelines, working with PostgreSQL, SQL Server, Snowflake, Redshift, and Databricks on AWS.

Knowledge of Kafka and batch/streaming processing is essential. The role emphasizes data quality, lineage, and regulatory compliance, with exposure to AI/GenAI data prep as a plus.

Qualifications

• Experience with post-trade data flows and financial data structures.
• Proficiency in SQL development and relational data modeling.
• Strong Python data processing using Pandas or PySpark.
• Experience with data warehouse, data lake, and Data Lakehouse concepts.
• Experience with cloud data platforms (AWS) and data integration pipelines.
• Knowledge of streaming and batch data processing (Kafka, Spark, Flink).
• Familiarity with data quality, lineage, validation, and reconciliation processes.
• Exposure to data science/ML data prep is a plus.

Responsibilities

• Understand post-trade data flows including allocations, confirmations, settlement, risk, finance, and regulatory reporting.
• Model securities data and reference data with robust data structures.
• Design and optimize relational data models and database schemas.
• Develop data pipelines using Python/SQL (ETL/ELT).
• Build batch and streaming pipelines on cloud data platforms.
• Ensure data quality, lineage, and reconciliation throughout pipelines.
• Work with messaging systems (Kafka, RabbitMQ, IBM MQ).
• Utilize observability tools (Datadog, Prometheus, Grafana).

Skills

SQL development

Python

Pandas

PySpark

Data warehousing

Data Lake/Lakehouse

Cloud data platforms (AWS)

Database technologies (PostgreSQL, SQL

Tools

Databricks

Snowflake

Redshift

DBMS (PostgreSQL, SQL Server)

Kafka

RabbitMQ/IBM MQ

Grafana/Datadog/Prometheus

Job description

Synechron seeks a Data Engineer to design and optimize data models for financial data, including reference, security master, and transactional trade data. You will develop scalable data pipelines, working with PostgreSQL, SQL Server, Snowflake, Redshift, and Databricks on AWS.

Knowledge of Kafka and batch/streaming processing is essential. The role emphasizes data quality, lineage, and regulatory compliance, with exposure to AI/GenAI data prep as a plus.