Senior Data Engineer - ETL Pipelines & Data Integrations

Codest Ltd.; Województwo mazowieckie; On-site; PLN 180,000 - 260,000; Full time

Job summary

The Codest is seeking a Senior Data Engineer to contribute to a banking platform for Japan's leading financial group. You will design data processing pipelines, build integrations across APIs, SQL databases, S3, and SFTP, and ensure data accuracy and reliable delivery in a fast-paced, international environment.

You will work with a Data Flow Team to support Fund Administration data flows, from ten minutes to monthly, and collaborate with stakeholders to align requirements with production

Qualifications

• 5+ years of hands-on experience with ETL tools and data engineering processes.
• Strong SQL skills and experience with databases and data integration workflows.
• Commercial experience with Python for data processing and scripting.
• Experience designing, developing, and maintaining data pipelines across multiple sources and destinations.
• Advanced English skills, both spoken and written, for collaboration within an international team.

Responsibilities

• Designing and implementing data processing pipelines based on business and technical requirements.
• Building and maintaining integrations between data sources and destinations (APIs, SQL, S3, SFTP).
• Developing and modifying ETL workflows and data flows.
• Processing and synchronizing data across systems and formats.
• Conducting testing and validation to ensure data accuracy and reliability.
• Providing post-deployment support and troubleshooting data integration issues.
• Collaborating with stakeholders to gather requirements and support production processes.

Skills

Advanced English

Strong communication

Attention to detail

Collaboration

Python

Tools

Apache NiFi

Databricks

AWS S3

Job description

The Codest is seeking a Senior Data Engineer to contribute to a banking platform for Japan's leading financial group. You will design data processing pipelines, build integrations across APIs, SQL databases, S3, and SFTP, and ensure data accuracy and reliable delivery in a fast-paced, international environment.

You will work with a Data Flow Team to support Fund Administration data flows, from ten minutes to monthly, and collaborate with stakeholders to align requirements with production