Senior Data Engineer

Distilhire

Bengaluru

Hybrid

INR 2,500,000 - 4,000,000

Full time

2 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Distilhire in Bengaluru is seeking an experienced Senior Data Engineer to design and build scalable data pipelines and data platforms that support analytics and product operations.

The ideal candidate has 5–10 years of hands-on data engineering experience, strong Python and SQL, and exposure to Spark/PySpark, cloud platforms, and modern data warehouses.

Qualifications

  • 5 to 10 years of overall experience, with substantial hands-on experience in Data Engineering.
  • Strong proficiency in Python and SQL.
  • Hands-on experience with Apache Spark or PySpark.
  • Experience building and maintaining production-grade ETL/ELT pipelines.
  • Working experience with AWS, Azure or GCP.
  • Experience with modern data warehouses or lakehouse platforms like Snowflake, Databricks, BigQuery or Redshift.
  • Familiarity with data orchestration tools such as Apache Airflow, Dagster or similar.
  • Good understanding of data modelling, distributed processing and data warehousing concepts.
  • Experience with PostgreSQL or MySQL.

Responsibilities

  • Design, develop and maintain scalable data pipelines for batch and real-time data processing.
  • Build and optimise ETL/ELT workflows to process data from multiple sources.
  • Develop data transformation and processing solutions using Python, SQL and PySpark.
  • Work with cloud-based data platforms and modern data warehouse technologies.
  • Design efficient data models and optimise queries for performance and scalability.
  • Implement data quality checks, monitoring and pipeline reliability mechanisms.
  • Collaborate with Analytics, Product and Engineering teams to support data requirements.
  • Troubleshoot pipeline failures and improve overall data platform performance.

Skills

Python
SQL
PySpark
Spark
Airflow
Dagster
Data modeling
PostgreSQL
MySQL

Tools

Spark
Airflow
Dagster
Docker
Kubernetes
dbt
Delta Lake
Iceberg

Job description

Experience: 5 to 10 Years
Salary: 25 to 40 LPA
Location: Bengaluru
Work Mode: Hybrid / On-site
Employment Type: Full-time


About the Role

One of our clients, a growing product-based technology company, is looking for an experienced Senior Data Engineer to join its engineering team.


The role involves designing and building scalable data pipelines, developing reliable data processing systems and managing data infrastructure that supports business intelligence, analytics and product operations.


We are looking for engineers with strong fundamentals in Python, SQL and modern data engineering technologies, along with hands‑on experience building and maintaining production‑grade data systems.


Key Responsibilities
  • Design, develop and maintain scalable data pipelines for batch and real‑time data processing.
  • Build and optimise ETL/ELT workflows to process data from multiple sources.
  • Develop data transformation and processing solutions using Python, SQL and PySpark.
  • Work with cloud‑based data platforms and modern data warehouse technologies.
  • Design efficient data models and optimise queries for performance and scalability.
  • Implement data quality checks, monitoring and pipeline reliability mechanisms.
  • Collaborate with Analytics, Product and Engineering teams to support data requirements.
  • Troubleshoot pipeline failures and improve overall data platform performance.

Required Skills & Experience
  • 5 to 10 years of overall experience, with substantial hands‑on experience in Data Engineering.
  • Strong proficiency in Python and SQL.
  • Hands‑on experience with Apache Spark or PySpark.
  • Experience building and maintaining production‑grade ETL/ELT pipelines.
  • Working experience with at least one major cloud platform: AWS, Azure or GCP.
  • Experience with at least one modern data warehouse or lakehouse platform: Snowflake, Databricks, BigQuery or Redshift.
  • Familiarity with data orchestration tools such as Apache Airflow, Dagster or similar.
  • Good understanding of data modelling, distributed processing and data warehousing concepts.
  • Experience working with relational databases such as PostgreSQL or MySQL.

Good to Have
  • Experience with Kafka or other streaming technologies.
  • Familiarity with dbt and modern analytics engineering practices.
  • Experience with Docker, Kubernetes or CI/CD pipelines.
  • Knowledge of data lake technologies such as Delta Lake or Apache Iceberg.
  • Experience working in a product‑based company, SaaS or fintech environment.

Ideal Candidate
  • Has independently designed and delivered data engineering solutions.
  • Understands the challenges of building and maintaining production data pipelines.
  • Can make sound technical decisions around scalability, performance and reliability.
  • Comfortable collaborating with cross‑functional engineering and product teams.

Note: Candidates should have strong practical experience in core Data Engineering concepts. Expertise in every technology mentioned is not expected.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer
Senior Data Engineer

INFOSLAB CONSULTANCY PRIVATE LIMITED • Hyderabad

On-site
INR 1,200,000 - 1,800,000
Big Data Engineer
Big Data Engineer

Global Infovision • Chennai, Bengaluru

Hybrid
INR 1,500,000 - 2,600,000
Senior Data Engineer
Senior Data Engineer

Impronics Technologies • Indore

On-site
INR 1,200,000 - 1,800,000
Senior Data Engineer
Senior Data Engineer

RBM Software • Pune District

On-site
INR 1,200,000 - 1,500,000
Opportunity to work on large-scale data projects
Exposure to modern cloud technologies
Collaborative work environment
Senior Data Engineer
Senior Data Engineer

Edgematics Consulting • Pune District

Hybrid
INR 2,000,000 - 4,000,000
Data Engineer - Python / Big Data
Data Engineer - Python / Big Data

Kreditbee • Bengaluru

On-site
INR 1,800,000 - 2,400,000
Specialist - Data Engineering
Specialist - Data Engineering

Vivantify Technology Solutions India Private Limited • Bengaluru

On-site
INR 1,800,000 - 3,200,000
Competitive salary and benefits
Opportunities for professional growth
Collaborative and inclusive work环境
+2
Data Engineer
Data Engineer

Primesoft Solutions • Mumbai, Hyderabad, Bengaluru

On-site
INR 1,800,000 - 2,400,000
Senior Data Engineer - Python/SQL
Senior Data Engineer - Python/SQL

India Fan Corporation • Bengaluru

On-site
INR 1,800,000 - 2,400,000
Senior Data Engineer
Senior Data Engineer

Flipkart Group • Bengaluru

On-site
INR 1,100,000 - 2,100,000