Data Engineer (Python, PySpark & ETL Pipelines) | Zenbyte Technologies | PAN India

Zenbyte Technologies

Bengaluru, Chennai

On-site

INR 1,200,000 - 2,400,000

Full time

5 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Zenbyte Technologies is seeking an experienced Data Engineer to drive advanced data engineering across PAN India, primarily in Bangalore and Chennai. The role involves designing, building, and scaling high-performance data pipelines, distributed storage, and cloud-native workflows.

You'll work with Python, SQL, Spark/PySpark, and cloud platforms (AWS/Azure/GCP), collaborating with data scientists and software teams, ensuring data governance, and contributing to enterprise analytics and data

Qualifications

  • Bachelor’s or Master’s in Computer Science, Data Engineering, Information Technology, or a related technical discipline.
  • 3.5+ years of progressive professional hands‑on experience in data engineering and distributed data systems.
  • Strong, demonstrable operational proficiency in Python and SQL programming.
  • Comprehensive working knowledge and practical hands‑on experience with ETL/ELT pipeline design and data warehousing.
  • Proven expertise in Apache Spark, PySpark, and big data distributed computing frameworks.
  • Solid practical grasp of cloud platforms (AWS, Azure, or GCP) and modern data architecture principles.
  • Strong analytical problem‑solving skills and effective stakeholder communication capabilities.
  • Mandatory legal work authorization and physical availability for professional operations in India (preferred locations: Bangalore & Chennai).

Responsibilities

  • Architect, design, and scale robust ETL/ELT data pipelines for ingestion, transformation, and loading of enterprise data.
  • Write clean, maintainable, and high‑performance Python and SQL code for complex data processing workflows.
  • Develop and optimize distributed big data workloads utilizing Apache Spark and PySpark across cloud clusters.
  • Design and maintain scalable data warehousing structures, dimensional data models, and star/snowflake schemas.
  • Deploy, configure, and manage data infrastructure across cloud platforms including AWS, Azure, and Google Cloud Platform (GCP).
  • Monitor pipeline execution, troubleshoot performance bottlenecks, and resolve data integrity discrepancies.
  • Collaborate proactively with cross‑functional data analytics, data science, and DevOps engineering squads.
  • Ensure strict adherence to enterprise data security baselines, privacy regulations, and compliance frameworks.
  • Maintain meticulous technical documentation, data lineage maps, pipeline architecture blueprints, and operational runbooks.
  • Participate actively in agile sprint planning, architectural design reviews, and continuous improvement engineering sessions.

Skills

Python
SQL
Apache Spark
PySpark
Cloud platforms (AWS/Azure/GCP)
ETL/ELT pipelines
Data warehousing

Education

Bachelor's or Master’s in CS/IT/Data Engineering

Tools

Apache Airflow
Docker
Kubernetes
Jira
Confluence
ServiceNow

Job description

Position Summary

Driving advanced data engineering, robust ETL/ELT pipeline architecture, data warehousing, and big data processing across PAN India operations, Zenbyte Technologies is actively seeking an experienced Data Engineer with 3.5+ years of hands‑on experience for a permanent full‑time engagement. In this vital data infrastructure and pipeline development role, you will take full operational, tactical, and technical ownership of designing, building, optimizing, and scaling high‑performance data pipelines, distributed data storage architectures, and cloud‑native integration workflows. Bringing deep technical proficiency in Python, SQL, Apache Spark, PySpark, and cloud data platforms, you will empower an elite international technology consulting and analytics corporation to achieve uncompromised data reliability and lightning‑fast query execution. This prestigious career opportunity offers competitive remuneration, enterprise client exposure, and professional growth within a leading global technology corporation.


Detailed Job Description

As a Data Engineer supporting Zenbyte Technologies on a professional basis across PAN India (with preferred locations in Bangalore and Chennai), you will take full operational, tactical, and technical ownership of data pipeline design, distributed cluster optimization, cloud storage provisioning, and cross‑functional engineering collaboration. Your day‑to‑day responsibilities include designing, developing, and maintaining robust ETL/ELT data pipelines using Python, SQL, and Apache Spark/PySpark, implementing scalable data warehousing and data modeling solutions across enterprise databases, deploying and managing data workloads on cloud platforms (AWS, Azure, or GCP), optimizing data storage, partitioning, and query performance, collaborating proactively with data scientists, software developers, and technical recruitment leadership like Yashika N at Zenbyte Technologies, adhering to strict corporate data governance standards.


Key Responsibilities


  • Architect, design, build, and scale robust ETL/ELT data pipelines for ingestion, transformation, and loading of enterprise data.

  • Write clean, maintainable, and high‑performance Python and SQL code for complex data processing workflows.

  • Develop and optimize distributed big data workloads utilizing Apache Spark and PySpark across cloud clusters.

  • Design and maintain scalable data warehousing structures, dimensional data models, and star/snowflake schemas.

  • Deploy, configure, and manage data infrastructure across cloud platforms including AWS, Azure, and Google Cloud Platform (GCP).

  • Monitor pipeline execution, troubleshoot performance bottlenecks, and resolve data integrity discrepancies.

  • Collaborate proactively with cross‑functional data analytics, data science, and DevOps engineering squads.

  • Ensure strict adherence to enterprise data security baselines, privacy regulations, and compliance frameworks.

  • Maintain meticulous technical documentation, data lineage maps, pipeline architecture blueprints, and operational runbooks.

  • Participate actively in agile sprint planning, architectural design reviews, and continuous improvement engineering sessions.


Required Qualifications & Skills


  • Bachelor’s or Master’s degree in Computer Science, Data Engineering, Information Technology, or a related technical discipline.

  • Minimum of 3.5+ years of progressive professional hands‑on experience in data engineering and distributed data systems.

  • Strong, demonstrable operational proficiency in Python and SQL programming.

  • Comprehensive working knowledge and practical hands‑on experience with ETL/ELT pipeline design and data warehousing.

  • Proven expertise in Apache Spark, PySpark, and big data distributed computing frameworks.

  • Solid practical grasp of cloud platforms (AWS, Azure, or GCP) and modern data architecture principles.

  • Strong analytical problem‑solving skills and effective stakeholder communication capabilities.

  • Mandatory legal work authorization and physical availability for professional operations in India (preferred locations: Bangalore & Chennai).


Nice-to-Have Skills


  • Professional vendor certifications such as AWS Certified Data Analytics – Specialty, Google Cloud Professional Data Engineer, or Databricks Certified Associate Developer.

  • Prior professional working experience supporting Tier‑1 global technology enterprises, financial institutions, or enterprise consulting firms.

  • Hands‑on familiarity with workflow orchestration tools (Apache Airflow, Prefect, Dagster) and containerization (Docker, Kubernetes).

  • Experience utilizing enterprise agile tracking and IT service desk platforms (Jira, Confluence, ServiceNow).

  • Active participation in open‑source data communities, engineering user groups, or PySpark contributor networks.


Application Information


  • Recruiter: Zenbyte Technologies Recruitment Division

  • Contact Name: Yashika N (IT Recruiter & Talent Acquisition Specialist at Zenbyte Technologies)

  • Email: nilamuki20@gmail.com

  • Phone:

  • Company Website: https://www.zenbytetech.com

  • Salary/Rate: Market Competitive / Enterprise Data Engineering Package

  • Work Schedule: Professional Operations (PAN India / Bangalore & Chennai)

  • Deadline: Open until filled (Urgent PAN India Data Engineer Opening)

  • Notice Period: Immediate to 30 Days Preferred

  • Contract Duration: Permanent / Full-Time Employment


Recruitment Pro Tip

When applying for this Data Engineer position with Zenbyte Technologies, ensure your resume and GitHub portfolio explicitly highlight your PySpark tuning tenure, complex ETL pipeline architecture, and cloud data warehouse experience.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Analyst (Python, SQL & Power BI) | Zenbyte Technologies | PAN India
Data Analyst (Python, SQL & Power BI) | Zenbyte Technologies | PAN India

Zenbyte Technologies • Bengaluru, Chennai

On-site
INR 1,200,000 - 2,400,000
Data Scientist (Machine Learning & Predictive Modeling) | Zenbyte Technologies | PAN India
Data Scientist (Machine Learning & Predictive Modeling) | Zenbyte Technologies | PAN India

Zenbyte Technologies • Bengaluru, Chennai

On-site
INR 900,000 - 1,300,000
Data Engineer (Python, PySpark & Generative AI) | Prominent Staffing | PAN India
Data Engineer (Python, PySpark & Generative AI) | Prominent Staffing | PAN India

Prominent Staffing • India

Remote
INR 1,500,000 - 2,500,000
Azure Data Engineer (Databricks, PySpark & GenAI) | IBM | Bangalore
Azure Data Engineer (Databricks, PySpark & GenAI) | IBM | Bangalore

International Business Machines Corporation • Bengaluru

On-site
INR 4,200,000 - 6,000,000
GCP Data Engineer (Google Cloud, BigQuery, PySpark & Cloud Composer) | Techedge Solution | Pan India
GCP Data Engineer (Google Cloud, BigQuery, PySpark & Cloud Composer) | Techedge Solution | Pan India

Techedge Solution • India

Remote
INR 1,500,000 - 2,700,000
Data Engineer
Data Engineer

InfoBeans • Pune City

Hybrid
INR 1,200,000 - 1,800,000
Senior Data Engineer
Senior Data Engineer

Wissen • Bengaluru

Hybrid
INR 2,800,000 - 4,800,000
Data Engineer (PySpark)
Data Engineer (PySpark)

Talent Basket • Bengaluru

On-site
INR 1,200,000 - 1,800,000
Data Engineer with Power BI
Data Engineer with Power BI

CyZen • Hyderabad

Remote
INR 1,200,000 - 1,800,000
2702 - Data Engineer
2702 - Data Engineer

EXL • Pune City

On-site
INR 1,000,000 - 1,500,000