Senior Data Engineer – Talend Big Data Developer

Edgematics Technologies LLC; Pune District; Hybrid; INR 800,000 - 1,200,000; Full time

Job summary

Edgematics Technologies LLC, based in Pune, is seeking a Talend Big Data Developer to design and develop scalable ETL/ELT pipelines using the Talend Big Data Platform. The ideal candidate will possess 5–8 years of experience in ETL/Data Engineering and be proficient in big data technologies such as Hadoop and Spark.

The role involves integrating data from varied sources and optimizing data workflows for large-scale processing. This job offers a hybrid work model and a chance to collaborate with project teams to deliver top-notch data solutions.

Qualifications

• 5–8 years of experience in ETL / Data Engineering.
• Strong hands-on experience with Talend Big Data Platform.
• Experience with Hadoop ecosystem (Spark, Hive, HDFS).
• Strong SQL and data transformation skills.
• Experience working with large datasets and data pipelines.
• Knowledge of Linux/Unix environments.

Responsibilities

• Design and develop ETL/ELT pipelines using Talend Big Data Platform.
• Work with big data technologies such as Hadoop, Spark, Hive.
• Develop and optimize data integration workflows for large-scale data processing.
• Perform data transformation, data quality checks, and validation.
• Integrate data from multiple sources including databases and APIs.
• Troubleshoot ETL job failures and performance issues.
• Collaborate with data engineers and project teams.

Skills

ETL / Data Engineering

Talend Big Data Platform

Hadoop ecosystem (Spark, Hive, HDFS)

SQL and data transformation

Large datasets and data pipelines

Linux/Unix environments

Tools

Hadoop

Spark

Hive

Kafka

Airflow

Job description

Experience: 5–8 Years

Location: Pune / Hybrid

Company: Edgematics Group

About Edgematics Edgematics is a global Data and AI consulting company helping enterprises modernize their data platforms and unlock insights through advanced data engineering, analytics, and AI solutions.

Role Overview

We are looking for a Talend Big Data Developer with strong experience in building scalable ETL/ELT pipelines on big data platforms. The candidate should have hands‑on expertise with Talend Big Data Platform and Hadoop ecosystem technologies to design and develop high-performance data integration solutions.

Key Responsibilities

• Design and develop ETL/ELT pipelines using Talend Big Data Platform.
• Work with big data technologies such as Hadoop, Spark, Hive, and distributed data processing frameworks.
• Develop and optimize data integration workflows for large-scale data processing.
• Perform data transformation, data quality checks, and data validation.
• Integrate data from multiple sources including databases, APIs, and files.
• Troubleshoot and resolve ETL job failures and performance issues.
• Collaborate with data engineers, architects, and project teams to deliver scalable data solutions.

Required Skills

• 5–8 years of experience in ETL / Data Engineering.
• Strong hands‑on experience with Talend Big Data Platform.
• Experience with Hadoop ecosystem (Spark, Hive, HDFS).
• Strong SQL and data transformation skills.
• Experience working with large datasets and data pipelines.
• Knowledge of Linux/Unix environments.

Preferred Skills

• Experience with cloud platforms (AWS, Azure, or GCP).
• Familiarity with data warehousing and data modeling concepts.
• Exposure to Kafka, Airflow, or other data orchestration tools.