Talend Engineer

ACI Global Business Services; Navi Mumbai; On-site; INR 1,800,000 - 2,800,000; Full time

Job summary

ACI Global Business Services in Navi Mumbai is seeking a Talend Engineer with 6 years of experience to design, develop, and maintain complex ETL workflows. You will extract data from AWS S3, transform it per business rules, load results into APIs, and ensure API data accuracy across environments.

You will work with data engineering and data science teams to maintain data quality, build automated pipelines, and document all ETL processes for continuity and scalability.

Qualifications

• Six years of experience in Talend development.
• Expertise in creating Talend ETL jobs using File and Database components.
• Experience with Talend API components for GET and POST.
• Experience with AWS components in Talend ETL processes.
• Experience migrating and deploying ETL pipelines across environments.
• Proficient in SQL and relational databases.
• Knowledge of Java or Python for automation within ETL workflows.
• Understanding of Git for version control and Nexus for artifact storage.
• Able to identify, diagnose, and resolve ETL pipeline issues.
• Strong analytical skills and attention to data quality.
• Excellent teamwork and communication to meet project deadlines.

Responsibilities

• Design, develop, and maintain ETL workflows to extract data from AWS S3, transform it, load into APIs, and retrieve results from APIs.
• Analyze existing ETL processes to streamline and automate for better performance.
• Build dynamic ETL pipelines that are scalable and easy to maintain.
• Collaborate with data engineering and data science teams to ensure data integrity and availability.
• Conduct unit tests to validate pipelines and diagnose performance bottlenecks.
• Deploy Talend ETL pipelines across environments, following best practices.
• Document ETL processes, pipelines, and methodologies for future teams.

Skills

Team collaboration

Analytical thinking

Communication

Problem solving

Tools

Talend

AWS

SQL

Java/Python

Git

Nexus

REST API

Job description

Role: Talend Engineer

Experience : 6 years in Talend Development

Responsibilities:

1. 1) Design, develop, and maintain ETL workflows to efficiently extract data from AWS S3, transform it based on business requirements, load it into custom APIs, and retrieve the results from the APIs.
2. 2) Understand existing ETL processes and workflows, analyze areas for improvement, and design streamlined, automated ETL solutions to enhance performance and eliminate unnecessary complexity.
3. 3) Build dynamic and flexible ETL pipelines from the ground up, ensuring they are easy to maintain, scalable, and adaptable for future requirements and enhancements.
4. 4) Work closely with the data engineering and data science teams to ensure the accuracy, consistency, and availability of the data being processed, ensuring that the final data is of high integrity and quality.
5. 5) Conduct comprehensive unit tests to validate the functionality of ETL pipelines, diagnose, and resolve any issues or performance bottlenecks that arise in the pipeline execution.
6. 6) Responsible for deploying Talend ETL pipelines across various environments, ensuring adherence to best practices and utilizing dynamic context variables where appropriate for seamless configuration and flexibility.
7. 7)Document all ETL processes, pipeline structures, and methodologies to ensure consistency, reliability, and clarity for current and future development teams.

Requirements:

1. 1. 6 years of experience in Talend development
2. 2.Expertise in creating Talend ETL jobs utilizing File and Database components
3. 3.Practical experience in using Talend''s API components to handle GET and POST requests for data communication and integration.
4. 4.Should have experience or a good understanding of AWS components and how to utilize them in Talend ETL processes.
5. 5.Experience in migrating and deploying ETL pipelines across different environments.
6. 6.Proficient in SQL and experienced in working with relational databases to ensure efficient data manipulation and retrieval.
7. 7.Knowledge of programming languages like Java or Python for general coding tasks and automation within ETL workflows.
8. 8.Understanding of version control with Git for managing code repositories and Nexus for artifact storage and management.
9. 9.Skilled in identifying, diagnosing, and resolving any issues within ETL pipelines to ensure optimal operation.
10. 10.Excellent analytical abilities and a keen eye for detail to maintain high data quality throughout the ETL process.
11. 11.Ability to work effectively in a collaborative, team-oriented environment to meet project goals and deadlines.
12. 12.Strong communication and interpersonal skills