Data Engineer - Immediate Joiners only & F2F interview is Mandatory

Wissen Technology Pte Ltd

Bengaluru

On-site

INR 1,500,000 - 2,300,000

Full time

3 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Wissen Technology seeks an experienced Data Engineer to design, build, and maintain scalable data pipelines and cloud data warehouse solutions. You will work with relational databases, ETL/ELT processes, Python, PySpark, shell scripting, and Snowflake to deliver robust data platforms.

You will design end-to-end data flows, optimize performance, and collaborate with stakeholders to translate requirements into scalable technical solutions while following governance and security best practices.

Qualifications

  • Strong experience with relational databases such as SQL Server, Oracle, MySQL, or PostgreSQL.
  • Proficient in SQL, including complex queries, joins, window functions, and optimization.
  • Hands-on experience designing and developing ETL/ELT pipelines.
  • Proficiency in Python for data processing, automation, and APIs.
  • Hands-on experience with PySpark for large-scale batch processing and transformations.
  • Good working knowledge of Unix/Linux shell scripting.
  • Practical experience with Snowflake, including warehouse design and SQL development.
  • Experience with data modelling, dimensional modelling, and data warehousing concepts.
  • Familiarity with orchestration tools like Airflow and modern CI/CD practices.
  • Experience with Git and Agile delivery.

Responsibilities

  • Design, build, test, deploy, and maintain reliable ETL/ELT pipelines for ingesting, transforming, validating, and loading data.
  • Extract and integrate data from relational databases, files, APIs, cloud storage, and other sources.
  • Develop data transformations and processing workflows using Python and PySpark.
  • Build and optimize Snowflake data warehouse objects, including tables, views, and transformations.
  • Write complex SQL queries for extraction, transformation, validation, and reporting.
  • Develop Unix/Linux shell scripts for file handling, scheduling, and monitoring.
  • Perform data profiling, cleansing, deduplication, and quality checks.
  • Optimize SQL queries and PySpark jobs for performance and cost efficiency.
  • Monitor pipelines, troubleshoot issues, and implement preventive fixes.
  • Collaborate with data architects, analysts, and stakeholders to translate requirements into solutions.
  • Create and maintain data-flow diagrams, deployment steps, and runbooks.
  • Follow data governance, security, and coding best practices.

Skills

SQL
ETL/ELT
Python
Data modelling
CI/CD
Agile

Tools

Snowflake
PySpark
Unix/Linux shell scripting
Airflow

Job description

We are seeking an experienced Data Engineer to design, build, and maintain scalable data pipelines and cloud data warehouse solutions. The ideal candidate will have strong hands-on expertise in relational databases, ETL/ELT development, Python, PySpark, shell scripting, and Snowflake.

Key Responsibilities
  • Design, develop, test, deploy, and maintain reliable ETL/ELT pipelines for ingesting, transforming, validating, and loading data.
  • Extract and integrate data from relational databases, files, APIs, cloud storage, and other source systems.
  • Develop efficient data transformation and data-processing workflows using Python and PySpark.
  • Build and optimize Snowflake data warehouse objects, including tables, views, staging layers, stored procedures, and SQL transformations.
  • Write complex SQL queries for data extraction, transformation, validation, reconciliation, and reporting.
  • Develop and maintain Unix/Linux shell scripts for file handling, job automation, scheduling support, and operational monitoring.
  • Perform data profiling, cleansing, deduplication, validation, and data-quality checks.
  • Optimize SQL queries, PySpark jobs, and Snowflake workloads for performance, scalability, and cost efficiency.
  • Monitor production pipelines, investigate failures, troubleshoot data issues, and implement preventive fixes.
  • Collaborate with data architects, analysts, business stakeholders, and downstream reporting teams to translate requirements into technical solutions.
  • Create and maintain technical documentation, data-flow diagrams, deployment steps, and operational runbooks.
  • Follow data governance, security, access-control, and coding best practices.
Required Skills
  • Strong experience with relational databases such as SQL Server, Oracle, MySQL, or PostgreSQL.
  • Strong SQL skills, including complex queries, joins, window functions, stored procedures, and query optimization.
  • Hands-on experience designing and developing ETL/ELT pipelines.
  • Proficiency in Python for data processing, automation, APIs, and reusable frameworks.
  • Hands-on experience with PySpark for large-scale batch data processing and transformations.
  • Good working Experience of Unix/Linux shell scripting.
  • Practical experience with Snowflake, including warehouse design, data loading, performance tuning, and SnowSQL/SQL development.
  • Experience with data modeling, dimensional modeling, data warehousing concepts, and data-quality practices.
  • Familiarity with orchestration and scheduling tools such as Airflow, Control-M, Tidal, or similar.
  • Experience with Git, CI/CD practices, and Agile delivery.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer - Immediate Joiners only & F2F interview is Mandatory
Data Engineer - Immediate Joiners only & F2F interview is Mandatory

Mployee.me • Bengaluru

On-site
INR 1,200,000 - 1,800,000
Data Engineer
Data Engineer

Unison Group • Hyderabad

On-site
INR 600,000 - 1,200,000
Data Engineer
Data Engineer

Bacancy Technology Inc • Ahmedabad District

On-site
INR 1,500,000 - 3,000,000
Data Engineer – PySpark & Snowflake
Data Engineer – PySpark & Snowflake

DTC Infotech. Pvt. Ltd. • Bengaluru

On-site
INR 600,000 - 1,200,000
Data Engineer
Data Engineer

Fa Ewjt Saasfaprod1 • Gurugram District

On-site
INR 600,000 - 1,200,000
Data Engineer _ Snowflake ,PLSQL, Python
Data Engineer _ Snowflake ,PLSQL, Python

SP Software • Hyderabad, Bengaluru

On-site
INR 1,200,000 - 2,400,000
Data Engineer
Data Engineer

Botmet • India

Remote
INR 3,000,000 - 3,500,000
Data Engineer
Data Engineer

BPMLinks • Hyderabad

On-site
INR 1,000,000 - 1,800,000
Data Engineer
Data Engineer

Thoughtwin • Indore District

On-site
INR 800,000 - 1,300,000
Data Engineer - ETL
Data Engineer - ETL

Forward Eye Technologies • Pune District

On-site
INR 1,500,000 - 2,100,000