Data Engineer

Codest Ltd. Company No. 12590542, VAT number: GB363431020; United States; Remote; USD 120,000 - 180,000; Full time

Job summary

The Codest is seeking a Senior Data Engineer to contribute to a banking platform project for a major Japanese financial group. You will design, build, and optimize data pipelines, ensure data quality, and coordinate with internal teams and vendors to deliver reliable data flows.

You will work with modern ETL tools, cloud storage, APIs, and streaming/data processing frameworks, ensuring timely data delivery and robust validation across environments.

Qualifications

• 5+ years of hands-on ETL and data engineering experience in a professional environment.
• Advanced English proficiency, written and spoken, for international collaboration.
• Strong SQL skills and experience with databases and data integration workflows.
• Commercial experience with Python for data processing and scripting.

Responsibilities

• Design and implement data processing pipelines based on business and technical requirements.
• Build and maintain integrations between data sources and destinations (APIs, SQL, S3, SFTP).
• Develop and modify ETL workflows and data flows.
• Process and synchronize data across systems and formats.
• Conduct testing to ensure data accuracy, integrity, and reliable delivery.
• Provide post-deployment support and troubleshoot data integration issues.
• Collaborate with stakeholders to gather requirements and support production processes.

Skills

Advanced English

SQL

Python

ETL processes

Data integration

Tools

Apache NiFi

Databricks

AWS S3

SFTP

APIs

Job description

Описание:

Hello World! We are The Codest - International Tech Software Company with Partners tech hubs in Poland delivering global IT solutions and projects. Our core values lie in “Customers and People First” approach that prioritises the needs of our customers and a collaborative environment for our employees, enabling us to deliver exceptional products and services. Our expertise centers on web development, cloud engineering, DevOps and quality. After many years of developing our own product - Yieldbird, which was honored as a laureate of the prestigious Top25 Deloitte awards, we arrived at our mission: to help tech companies build impactful product and scale their IT teams through boosting IT delivery performance. Through our extensive experience with product development challenges, we have become experts in building digital products and scaling IT teams. But our journey does not end here - we want to continue our growth. If you’re goal-driven and looking for new opportunities, join our team! What awaits you is an enriching and collaborative environment that fosters your growth at every step. We are currently looking for: SENIOR DATA ENGINEER

SENIOR DATA ENGINEER

Here, you will have an opportunity to contribute to a banking platform for one of Japan’s leading financial groups. The platform includes banking modules, data management features, and customer-facing applications. The Data Flow Team supports the Fund Administration domain, integrating internal, vendor-hosted, and third‑party systems. Data flows are triggered by specific rules or events, with frequencies ranging from every ten minutes to monthly.

Задачи:

• Designing and implementing data processing pipelines based on business and technical requirements, including data transformation, validation, and mapping.
• Building and maintaining integrations between various data sources and destinations, including APIs, SQL databases, S3 buckets, and SFTP servers.
• Developing and modifying existing ETL workflows and data flows.
• Processing and synchronizing data across different systems and formats.
• Conducting comprehensive testing and validation to ensure data accuracy, integrity, and reliable delivery.
• Providing post-deployment support and troubleshooting data integration issues.
• Collaborating with business stakeholders to gather requirements and support production processes when needed.

Требования:

• Advanced English skills, both spoken and written, for collaboration within an international team.
• 5+ years of hands‑on experience with ETL tools and data engineering processes in a professional environment.
• Strong SQL skills and experience working with databases and data integration workflows.
• Commercial experience with Python for data processing and scripting.
• Experience designing, developing, and maintaining data pipelines across multiple sources and destinations.
• Ability to understand complex data flows, coding structures, and logical workflows.
• Experience collaborating with developers and business stakeholders in an international environment.
• High attention to detail and a commitment to data accuracy and reliability.
• Strong communication skills and the ability to engage with stakeholders at different organizational levels.
• Experience with Apache NiFi for building and maintaining data flows.
• Familiarity with Databricks, particularly for implementing new data integrations.
• Experience with cloud‑based data storage and services, including AWS S3.

Recruitment process:

• Screening call (30 min)
• Technical interview (60 min)
• Interview with the Team Leader (60 min)
• Offer

In the meantime, feel free to visit our website where you can find key facts about us.