Senior PySpark Developer (Cloudera, Iceberg, Airflow & AWS) - Tieto Tech Consulting (m/f/d)

Tieto; Bengaluru; On-site; INR 4,000,000 - 6,000,000; Full time

Job summary

Tieto in Bengaluru seeks a Senior/Lead Developer with 10–12+ years of IT experience, strong PySpark, Apache Iceberg, Airflow, and AWS Data Engineering expertise.

You will design and implement data pipelines, optimize data lake architectures, and collaborate with cross-functional teams to drive modern data platforms. The role emphasizes problem solving, communication, and agile collaboration.

Qualifications

• Bachelor's degree in Computer Science, Information Systems, Engineering, or related field.
• 10+ years IT experience with 6+ years in Data Engineering and Big Data development.
• Hands-on PySpark and Spark-based data processing.
• CDP data pipelines development in enterprise environments.
• Knowledge of Apache Iceberg and data lake concepts.
• Airflow workflow design and management.
• SQL and data modeling proficiency.
• ETL/ELT development and data transformation experience.
• Experience with large-scale structured and unstructured data.
• Git, CI/CD pipelines, and DevOps practices.
• Strong analytical, troubleshooting, and communication skills.

Skills

PySpark

Spark

Airflow

SQL

Data modeling

ETL/ELT

DevOps

Git

Big data

Communication

Education

Bachelor's degree in Computer Science/Information Systems/Engineering

Tools

Cloudera CDP

AWS

Apache Iceberg

Kafka

Job description

Job Description

• Bachelor's degree in Computer Science, Information Systems, Engineering, or related field.
• 10+ years of IT experience with 6+ years in Data Engineering and Big Data development.
• Strong hands-on experience with PySpark and Spark-based data processing.
• Strong knowledge of Apache Iceberg table architecture and data lake concepts.
• Experience designing and managing workflows using Apache Airflow.
• Experience with SQL and data modeling techniques.
• Strong understanding of ETL/ELT development and data transformation frameworks.
• Experience working with large-scale structured and unstructured datasets.
• Knowledge of Git, CI/CD pipelines, and DevOps practices.
• Strong analytical, troubleshooting, and problem-solving skills.
• Excellent communication and collaboration skills.

Required Qualifications

• Bachelor's degree in Computer Science, Information Systems, Engineering, or related field.
• 10+ years of IT experience with 6+ years in Data Engineering and Big Data development.
• Strong hands-on experience with PySpark and Spark-based data processing.
• Experience developing data pipelines on Cloudera Data Platform (CDP).
• Strong knowledge of Apache Iceberg table architecture and data lake concepts.
• Experience designing and managing workflows using Apache Airflow.
• Experience with SQL and data modeling techniques.
• Strong understanding of ETL/ELT development and data transformation frameworks.
• Experience working with large-scale structured and unstructured datasets.
• Knowledge of Git, CI/CD pipelines, and DevOps practices.
• Strong analytical, troubleshooting, and problem-solving skills.
• Excellent communication and collaboration skills.

Preferred Qualifications

• Experience with AWS services including S3, Glue, Lambda, ECS/EKS, EMR, RDS, IAM, and CloudWatch.
• Experience building cloud-native data lake and Lakehouse solutions.
• Strong knowledge of data partitioning, performance tuning, and query optimization.
• Experience with Kafka or event-driven data processing frameworks.
• Experience with Java or Python application development.
• Experience implementing data quality, metadata, and data governance solutions.
• Healthcare, Medicaid, Claims Processing, or Insurance industry experience.
• Experience working in Agile development environments.
• AWS Certification and/or Cloudera Certification preferred.
• Experience supporting large-scale cloud migration and modernization initiatives.

Additional Information

At Tieto, we believe in the power of diversity, equity, and inclusion. We encourage applicants of all backgrounds, genders (m/f/d), and walks of life to join our team, as we believe that this fosters an inspiring workplace and fuels innovation.Our commitment to openness, trust, and diversity is at the heart of our mission to create digital futures that benefit businesses, societies, and humanity.

Diversity, equity and inclusion | Sustainability | Tieto

Role Level: Senior Developer / Lead Developer

Experience: 10-12+ years overall with strong expertise in PySpark, Cloudera CDP, Apache Iceberg, Airflow, and AWS Data Engineering.