Databricks Data Engineer INFYSYJP00007375

NITYO; Bengaluru; On-site; INR 2,000,000 - 3,600,000; Full time

Job summary

NITYO in Bengaluru, India invites a Databricks Data Engineer with 5+ years of experience to design scalable data platforms using Databricks Lakehouse architecture. You will work on large-scale cloud-native data engineering, focusing on PySpark, Delta Lake, and Spark SQL to deliver robust data pipelines.

The role emphasizes building bronze, silver, and gold data models, optimizing cluster performance, and collaborating with data analysts, architects, and business users to drive data-driven

Qualifications

• 5+ years of data engineering experience.
• 5+ years of Databricks platform experience.
• Strong PySpark, Spark SQL, Python, Delta Lake, and Databricks Workflows skills.
• Knowledge of Lakehouse Architecture and Medallion Architecture and data modeling.
• Experience building scalable data pipelines for large data volumes.
• Strong SQL development and optimization.

Responsibilities

• Design and develop scalable ETL/ELT pipelines using Databricks.
• Build data processing frameworks with PySpark and Spark SQL.
• Implement Delta Lake Lakehouse architectures.
• Develop bronze, silver, and gold data models.
• Optimize cluster utilization and performance.
• Collaborate with data analysts, architects, and business users.
• Support real-time and batch data processing requirements.
• Create reusable frameworks to accelerate data ingestion.

Skills

PySpark

Spark SQL

Python

Delta Lake

Databricks Workflows

Snowflake integration

Kafka/Event Streaming

Airflow

dbt

MLflow exposure

Job description

Databricks Data Engineer

We are seeking a Databricks Data Engineer with 5+ years of experience building modern data platforms using Databricks Lakehouse architecture. The candidate should have strong expertise in Spark, Delta Lake, and large-scale cloud-native data engineering.

Key Responsibilities

• Design and develop scalable ETL/ELT pipelines using Databricks.
• Build and optimize data processing frameworks using PySpark and Spark SQL.
• Implement modern Lakehouse architectures using Delta Lake.
• Develop and maintain bronze, silver, and gold layer data models.
• Optimize cluster utilization and processing performance.
• Build reusable frameworks and accelerate data ingestion capabilities.
• Support real-time and batch data processing requirements.
• Collaborate with data analysts, architects, and business users.

Requirements

• 5+ years of data engineering experience.
• 5+ years of Databricks platform experience.
• Strong expertise in:
  • PySpark
  • Spark SQL
  • Python
  • Delta Lake
  • Databricks Workflows
• Strong understanding of:
  • Lakehouse Architecture
  • Medallion Architecture
  • Data Modeling
  • Data Warehousing Concepts
• Experience building scalable data pipelines handling large data volumes.
• Strong SQL development and optimization skills.

Work Arrangements

• Location: Bengaluru, Karnataka, India | Hyderabad, Telangana, India
• Remote: Not specified
• Shift/schedule details: Not specified
• Office visits: Not specified
• Travel requirements: Not specified

Salary and Benefits

• Salary: Not specified
• Benefits: Not specified

Preferred Skills

• Snowflake integration
• Kafka/Event Streaming
• Airflow
• dbt
• MLflow exposure

Soft Skills

• Strong debugging and performance tuning abilities.
• Excellent communication and stakeholder interaction skills.
• Ability to independently drive technical solutions.