Data Engineer

R Systems; Varanasi; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

R Systems seeks a skilled Databricks Engineer to design and build scalable ETL/ELT pipelines using Databricks and Snowflake. You will shape data lakehouse architectures and implement Lambda patterns for both batch and streaming workflows.

You will collaborate with cross-functional teams to translate business requirements into robust data solutions, optimize data models, and ensure governance and quality across enterprise platforms.

Qualifications

• Proficiency in designing and developing ETL/ELT pipelines using Databricks (PySpark/Spark SQL) and Snowflake.
• Experience architecting data lakehouse solutions (Bronze, Silver, Gold layers).
• Ability to implement Lambda architecture patterns for batch and real-time data processing.
• Skilled in developing data ingestion frameworks from databases, APIs, and streaming platforms.
• Experience with orchestration tools such as Airflow, ADF, or Databricks Workflows.
• Knowledge of CI/CD practices for data pipelines and infrastructure-as-code.
• Familiarity with data governance and cataloging tools.
• Familiarity with data quality frameworks and pipeline monitoring.

Responsibilities

• Design and develop scalable ETL/ELT pipelines using Databricks and Snowflake.
• Architect data lakehouse solutions following Medallion architecture.
• Collaborate with cross-functional teams to translate business requirements into reliable technical solutions.

Skills

Databricks

PySpark

Spark SQL

Snowflake

Lakehouse

Lambda Architecture

Data Ingestion Frameworks

Airflow

ADF

Databricks Workflows

CI/CD for data pipelines

Infrastructure as Code

Data Quality & Monitoring

Delta Live Tables

Tools

Delta Live Tables (DLT)

Unity Catalog

Informatica

Streamsets

Airflow

Databricks Workflows

Job description

In this role, you will design and develop scalable ETL/ELT pipelines using Databricks and Snowflake. You will be responsible for architecting data lakehouse solutions following Medallion architecture and implementing Lambda patterns for batch and real-time processing. The ideal candidate will build and maintain a single source of truth across enterprise platforms while optimizing data models and query performance. You will collaborate with cross-functional teams to translate business requirements into reliable technical solutions.

Required Skills And Qualifications

• Proficiency in designing and developing ETL/ELT pipelines using Databricks (PySpark/Spark SQL) and Snowflake
• Experience architecting data lakehouse solutions (Bronze, Silver, Gold layers)
• Ability to implement Lambda architecture patterns for batch and real-time data processing
• Skilled in developing data ingestion frameworks from databases, APIs, and streaming platforms
• Experience with orchestration tools such as Airflow, ADF, or Databricks Workflows
• Knowledge of CI/CD practices for data pipelines and infrastructure-as-code
• Familiarity with data quality frameworks and pipeline monitoring.

Databricks Engineer,Snowflake,Azure,ETL/ELT,APIs

• Experience with Delta Live Tables (DLT) or Unity Catalog
• Knowledge of Informatica, Streamsets, or other industry-standard ETL tools
• Familiarity with data governance and cataloging tools
• Understanding of security and compliance standards in data engineering