Senior Data Engineer

The Codest; Województwo mazowieckie; On-site; PLN 180,000 - 260,000; Full time

Job summary

The Codest is seeking a Senior Data Engineer to contribute to a banking platform for Japan's leading financial group. You will design data processing pipelines, build integrations across APIs, SQL databases, S3, and SFTP, and ensure data accuracy and reliable delivery in a fast-paced, international environment.

You will work with a Data Flow Team to support Fund Administration data flows, from ten minutes to monthly, and collaborate with stakeholders to align requirements with production

Qualifications

• 5+ years of hands-on experience with ETL tools and data engineering processes.
• Strong SQL skills and experience with databases and data integration workflows.
• Commercial experience with Python for data processing and scripting.
• Experience designing, developing, and maintaining data pipelines across multiple sources and destinations.
• Advanced English skills, both spoken and written, for collaboration within an international team.

Responsibilities

• Designing and implementing data processing pipelines based on business and technical requirements.
• Building and maintaining integrations between data sources and destinations (APIs, SQL, S3, SFTP).
• Developing and modifying ETL workflows and data flows.
• Processing and synchronizing data across systems and formats.
• Conducting testing and validation to ensure data accuracy and reliability.
• Providing post-deployment support and troubleshooting data integration issues.
• Collaborating with stakeholders to gather requirements and support production processes.

Skills

Advanced English

Strong communication

Attention to detail

Collaboration

Python

Tools

Apache NiFi

Databricks

AWS S3

Job description

Hello World! We are The Codest - International Tech Software Company with Partners tech hubs in Poland delivering global IT solutions and projects. Our core values lie in "Customers and People First" approach that prioritises the needs of our customers and a collaborative environment for our employees, enabling us to deliver exceptional products and services. Our expertise centers on web development, cloud engineering, DevOps and quality. After many years of developing our own product - Yieldbird, which was honored as a laureate of the prestigious Top25 Deloitte awards, we arrived at our mission: to help tech companies build impactful product and scale their IT teams through boosting IT delivery performance. Through our extensive experience with product development challenges, we have become experts in building digital products and scaling IT teams.

But our journey does not end here - we want to continue our growth. If you're goal-driven and looking for new opportunities, join our team! What awaits you is an enriching and collaborative environment that fosters your growth at every step.

SENIOR DATA ENGINEER

Here, you will have an opportunity to contribute to a banking platform for one of Japan's leading financial groups. The platform includes banking modules, data management features, and customer-facing applications. The Data Flow Team supports the Fund Administration domain, integrating internal, vendor-hosted, and third-party systems. Data flows are triggered by specific rules or events, with frequencies ranging from every ten minutes to monthly.

Key Responsibilities

• Designing and implementing data processing pipelines based on business and technical requirements, including data transformation, validation, and mapping.
• Building and maintaining integrations between various data sources and destinations, including APIs, SQL databases, S3 buckets, and SFTP servers.
• Developing and modifying existing ETL workflows and data flows.
• Processing and synchronizing data across different systems and formats.
• Conducting comprehensive testing and validation to ensure data accuracy, integrity, and reliable delivery.
• Providing post-deployment support and troubleshooting data integration issues.
• Collaborating with business stakeholders to gather requirements and support production processes when needed.

Requirements (skills & experience)

• Advanced English skills, both spoken and written, for collaboration within an international team.
• 5+ years of hands-on experience with ETL tools and data engineering processes in a professional environment.
• Strong SQL skills and experience working with databases and data integration workflows.
• Commercial experience with Python for data processing and scripting.
• Experience designing, developing, and maintaining data pipelines across multiple sources and destinations.
• Ability to understand complex data flows, coding structures, and logical workflows.
• Experience collaborating with developers and business stakeholders in an international environment.
• High attention to detail and a commitment to data accuracy and reliability.
• Strong communication skills and the ability to engage with stakeholders at different organizational levels.

Nice to have

• Experience with Apache NiFi for building and maintaining data flows.
• Familiarity with Databricks, particularly for implementing new data integrations.
• Experience with cloud-based data storage and services, including AWS S3.

Recruitment process

• Screening call (30 min)
• Technical interview (60 min)
• Interview with the Team Leader (60 min)
• Offer

Questions, insights? Feel free to reach out to our recruiting team: [e-mail]. In the meantime, feel free to visit our website where you can find key facts about us.