Data Engineer - Immediate Joiners only & F2F interview is Mandatory

Mployee.me

Bengaluru

On-site

INR 1,200,000 - 1,800,000

Full time

4 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Mployee.me is actively seeking an experienced Data Engineer to design, build, and maintain scalable data pipelines and cloud data warehouse solutions in Bengaluru, India. The role emphasizes hands-on development with Python, PySpark, SQL, and Snowflake, along with shell scripting and data governance practices.

The ideal candidate will implement ETL/ELT processes, optimize performance and costs, and collaborate with data architects, analysts, and stakeholders to deliver reliable data solutions.

Qualifications

  • Experience with relational databases (SQL Server, Oracle, MySQL, PostgreSQL).
  • Strong SQL skills: complex queries, joins, window functions, stored procedures, optimization.
  • Hands-on ETL/ELT pipeline design and development.
  • Proficiency in Python for data processing and automation.
  • Hands-on PySpark for large-scale batch processing.

Responsibilities

  • Design, build, test, deploy, and maintain reliable ETL/ELT pipelines for data ingestion, transformation, validation and loading.
  • Extract and integrate data from relational databases, files, APIs, cloud storage, and other sources.
  • Develop data transformations and processing workflows using Python and PySpark.
  • Build and optimize Snowflake data warehouse objects and SQL transformations.
  • Write complex SQL queries for extraction, transformation, validation, reconciliation and reporting.
  • Develop and maintain Unix/Linux shell scripts for file handling, job automation, scheduling support and monitoring.
  • Perform data profiling, cleansing, deduplication, validation and data-quality checks.
  • Optimize SQL queries, PySpark jobs and Snowflake workloads for performance and cost efficiency.
  • Monitor production pipelines, troubleshoot data issues and implement preventive fixes.
  • Collaborate with data architects, analysts, and stakeholders to translate requirements into solutions.
  • Create and maintain technical documentation and runbooks.
  • Follow data governance, security, access-control and coding best practices.

Skills

Relational databases
SQL
ETL/ELT pipelines
Python
PySpark
Unix/Linux shell scripting
Snowflake
Data modeling
Airflow
Git/CI-CD

Tools

Snowflake
Airflow
SnowSQL
Git
CI/CD

Job description

We are seeking an experienced Data Engineer to design, build, and maintain scalable data pipelines and cloud data warehouse solutions. The ideal candidate will have strong hands‑on expertise in relational databases, ETL/ELT development, Python, PySpark, shell scripting, and Snowflake.

Key Responsibilities
  • Design, develop, test, deploy, and maintain reliable ETL/ELT pipelines for ingesting, transforming, validating, and loading data.
  • Extract and integrate data from relational databases, files, APIs, cloud storage, and other source systems.
  • Develop efficient data transformation and data‑processing workflows using Python and PySpark.
  • Build and optimize Snowflake data warehouse objects, including tables, views, staging layers, stored procedures, and SQL transformations.
  • Write complex SQL queries for data extraction, transformation, validation, reconciliation, and reporting.
  • Develop and maintain Unix/Linux shell scripts for file handling, job automation, scheduling support, and operational monitoring.
  • Perform data profiling, cleansing, deduplication, validation, and data‑quality checks.
  • Optimize SQL queries, PySpark jobs, and Snowflake workloads for performance, scalability, and cost efficiency.
  • Monitor production pipelines, investigate failures, troubleshoot data issues, and implement preventive fixes.
  • Collaborate with data architects, analysts, business stakeholders, and downstream reporting teams to translate requirements into technical solutions.
  • Create and maintain technical documentation, data-flow diagrams, deployment steps, and operational runbooks.
  • Follow data governance, security, access‑control, and coding best practices.
Required Skills
  • Strong experience with relational databases such as SQL Server, Oracle, MySQL, or PostgreSQL.
  • Strong SQL skills, including complex queries, joins, window functions, stored procedures, and query optimization.
  • Hands‑on experience designing and developing ETL/ELT pipelines.
  • Proficiency in Python for data processing, automation, APIs, and reusable frameworks.
  • Hands‑on experience with PySpark for large-scale batch data processing and transformations.
  • Good working Experience of Unix/Linux shell scripting.
  • Practical experience with Snowflake, including warehouse design, data loading, performance tuning, and SnowSQL/SQL development.
  • Experience with data modeling, dimensional modeling, data warehousing concepts, and data‑quality practices.
  • Familiarity with orchestration and scheduling tools such as Airflow, Control-M, Tidal, or similar.
  • Experience with Git, CI/CD practices, and Agile delivery.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer - Immediate Joiners only & F2F interview is Mandatory
Data Engineer - Immediate Joiners only & F2F interview is Mandatory

Wissen Technology Pte Ltd • Bengaluru

On-site
INR 1,500,000 - 2,300,000
Data Engineer
Data Engineer

Unison Group • Hyderabad

On-site
INR 600,000 - 1,200,000
Data Engineer - Python & Snowflake
Data Engineer - Python & Snowflake

DXC Luxoft • Chennai

On-site
INR 420,000 - 660,000
Data Engineer _ Snowflake ,PLSQL, Python
Data Engineer _ Snowflake ,PLSQL, Python

SP Software • Hyderabad, Bengaluru

On-site
INR 1,200,000 - 2,400,000
Data Engineer - Python & Snowflake
Data Engineer - Python & Snowflake

DXC Luxoft • Bengaluru

On-site
INR 4,000,000 - 7,000,000
Data Engineer - Python & Snowflake
Data Engineer - Python & Snowflake

DXC Luxoft • Gurugram District

On-site
INR 4,200,000 - 6,400,000
Data Engineer
Data Engineer

Bacancy Technology Inc • Ahmedabad District

On-site
INR 1,500,000 - 3,000,000
Snowflake Data Engineer
Snowflake Data Engineer

Randomtrees • Hyderabad

On-site
INR 900,000 - 1,500,000
Data Engineer
Data Engineer

Thoughtwin • Indore District

On-site
INR 800,000 - 1,300,000
Snowflake Data Engineer
Snowflake Data Engineer

Fugetron Corporation • Mumbai

Hybrid
INR 1,500,000 - 3,000,000