Talend Big data Developer

Photon; Bengaluru; On-site; INR 1,500,000 - 2,600,000; Full time

Job summary

Photon in Bengaluru, India is seeking an experienced Talend Big Data ETL Developer (5–6 yrs) to design and implement scalable, high‑performance data pipelines on Spark across enterprise ecosystems. The role requires hands‑on Talend Jobs, Joblets, and custom Java components, strong SQL Server experience, and deep knowledge of Hive/Impala/HDFS, plus tuning Spark jobs and data formats like Parquet/ORC.

You will also work with TAC, CI/CD deployments, Linux, and robust logging, monitoring, and

Qualifications

• 5–6 years of hands-on experience with Talend Big Data on Spark
• Hands-on expertise in Talend Jobs, Joblets, and custom Java components
• Proficient in Spark-based processing, SQL Server, Hive/Impala/HDFS
• Skilled in performance tuning of Spark jobs, Hive/Impala queries, and using Parquet/ORC
• Experience with Talend Administration Console (TAC), job scheduling, deployment and environment management
• Proficient in Linux environments, CI/CD deployments, and robust error handling, logging, monitoring and alerting

Responsibilities

• Design and implement scalable, high-performance data pipelines on Spark using Talend Big Data
• Develop Talend Jobs, Joblets and Java components to support ingestion and processing
• Tune Spark jobs and Hive/Impala queries; optimize data formats like Parquet/ORC
• Manage TAC for scheduling, deployment and environment management
• Implement robust logging, monitoring, alerting and CI/CD workflows
• Collaborate with cross-functional teams for data platform support and analytics delivery

Skills

Big Data ETL

Talend Jobs

Talend Joblets

Java components

Spark processing

SQL Server

Hive

Impala

HDFS

Parquet/ORC

TAC

CI/CD

Linux

Monitoring

Logging

Tools

Talend

Spark

SQL Server

Hive

Impala

HDFS

TAC

Parquet

ORC

CI/CD

Linux

Job description

Roles and Responsibilities

Talend Big Data ETL Developer (5–6 yrs)

• Experienced Big Data ETL Developer with 4+ years of hands‑on expertise in Talend Big Data on Spark, specializing in building scalable, high-performance data pipelines across enterprise ecosystems.
• Strong proficiency in developing Talend Jobs, Joblets, and custom Java components, with deep understanding of ETL lifecycle, data ingestion (structured/unstructured), and orchestration.
• Technically strong in Spark-based processing, SQL (SQL Server preferred), and big data frameworks within Cloudera environments, including Hive, Impala, and HDFS.
• Skilled in performance tuning (Spark jobs, Hive/Impala queries), partitioning strategies, and file formats like Parquet/ORC. Hands‑on experience with Talend Administration Console (TAC), job scheduling, deployment, and environment management.
• Proficient in Linux environments, CI/CD-based deployments, and implementing robust error handling, logging, monitoring, and alerting frameworks.
• Adept at troubleshooting production issues, optimizing data workflows, and collaborating with cross‑functional teams for data platform support and analytics delivery.