Senior Data Engineer

Hiringhood; Hyderabad; On-site; INR 1,200,000 - 2,400,000; Full time

Job summary

Hiringhood is conducting a Phygital Matchday to connect experienced Data Engineers with opportunities across 2 Global Capability Centres (GCCs) and 3 Indian product companies. We are looking for Senior Data Engineer with strong expertise in Python, SQL, PySpark, Apache Spark, ETL/ELT pipelines and cloud data engineering.

Candidates should have hands-on experience building scalable, production-grade data pipelines and modern data platforms.

Qualifications

• 4-6 years of Senior Data Engineer experience.
• Strong proficiency in Python and SQL.
• Hands-on ETL/ELT pipeline development.
• Experience with Apache Spark and PySpark.
• Knowledge of data warehousing, data lakes and data modelling.
• Experience with at least one cloud platform: AWS, Azure or GCP.
• Experience with PostgreSQL, MySQL, SQL Server or similar databases.
• Familiarity with Apache Airflow or other workflow orchestration tools.
• Understanding of star and snowflake schemas, fact and dimension tables, and slowly changing dimensions (SCDs).
• Knowledge of data quality, pipeline optimization and performance tuning.
• Familiarity with Git and CI/CD practices.

Responsibilities

• Design, develop and maintain scalable data pipelines for data ingestion, transformation and processing.
• Build and optimize ETL/ELT workflows integrating data from multiple sources.
• Develop data processing solutions using Python, SQL and PySpark.
• Work with large datasets using Apache Spark.
• Design and maintain data warehouses, data lakes and lakehouse solutions.
• Implement data quality checks, validation, monitoring and error handling.
• Optimize pipeline performance, scalability and reliability.
• Work with cloud platforms such as AWS, Azure or GCP.
• Collaborate with data scientists, analysts, software engineers and business stakeholders.
• Follow best practices for data security, governance, Git, CI/CD and documentation.

Skills

Python

SQL

PySpark

Apache Spark

ETL/ELT pipelines

Cloud platforms

Data modeling

Data warehouses/lakes

Git/CI-CD

Education

Bachelors/Masters in CS/IT/Engineering

Tools

Airflow

Databricks

Snowflake

BigQuery

Redshift

Kafka

Docker

Delta Lake

Job description

Experience: 4-6 Years

Employment Type: Full-Time, Permanent

Job Summary

Hiringhood is conducting a Phygital Matchday to connect experienced Data Engineers with opportunities across 2 Global Capability Centres (GCCs) and 3 Indian product companies.

We are looking for Senior Data Engineer with strong expertise in Python, SQL, PySpark, Apache Spark, ETL/ELT pipelines and cloud data engineering. Candidates should have hands-on experience building scalable, reliable, production-grade data pipelines and modern data platforms.

Key Responsibilities

• Design, develop and maintain scalable data pipelines for data ingestion, transformation and processing.
• Build and optimize ETL/ELT workflows integrating data from multiple sources.
• Develop data processing solutions using Python, SQL and PySpark.
• Work with large datasets using Apache Spark.
• Design and maintain data warehouses, data lakes and lakehouse solutions.
• Implement data quality checks, validation, monitoring and error handling.
• Optimize pipeline performance, scalability and reliability.
• Work with cloud platforms such as AWS, Azure or GCP.
• Collaborate with data scientists, analysts, software engineers and business stakeholders.
• Follow best practices for data security, governance, Git, CI/CD and documentation.

Required Skills

• 4-6 years of relevant Senior Data Engineer experience.
• Strong proficiency in Python and SQL.
• Hands-on experience with ETL/ELT pipeline development.
• Experience with Apache Spark and PySpark.
• Knowledge of data warehousing, data lakes and data modelling.
• Experience with at least one cloud platform: AWS, Azure or GCP.
• Experience with PostgreSQL, MySQL, SQL Server or similar databases.
• Familiarity with Apache Airflow or other workflow orchestration tools.
• Understanding of star and snowflake schemas, fact and dimension tables, and slowly changing dimensions (SCDs).
• Knowledge of data quality, pipeline optimization and performance tuning.
• Familiarity with Git and CI/CD practices.

Good-to-Have Skills

• Database Certification preferred.
• Snowflake Certification preferred.
• Databricks, Snowflake, Microsoft Fabric, BigQuery or Amazon Redshift.
• Parquet and columnar data formats.
• Kafka or other streaming technologies.
• Delta Lake and lakehouse architecture.
• Docker and data pipeline deployment practices.

Education

Bachelors or Masters degree in Computer Science, Information Technology, Engineering or a related field.

Hiringhood Phygital Matchday Selection Process

1. 1. Online Registration: Register for the Data Engineer opportunity.
2. 2. Preliminary Online MCQ:Complete the initial technical assessment. Qualification is mandatory to attend the in-person Matchday.
3. 3. In-Person Technical Assessment Hyderabad, 14th Nov 2026: Complete a technical MCQ, executable coding assessment and TARA AI technical interview.
4. 4. Employer Shortlisting: Participating employers evaluate candidates based on technical performance, experience and role fit. Additional interview rounds may apply.

Important:

In-person attendance is mandatory for candidates who qualify in the preliminary online assessment. Assessment completion does not guarantee shortlisting or an offer.