Application Support Engineer - Databricks

Next Level Business Services Inc.; Bengaluru; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Next Level Business Services Inc. in Bengaluru is seeking an Application Software Engineer for an immediate joiner with rotational shifts.

You will design, build, and maintain scalable data solutions on the Databricks platform, collaborating with cross-functional teams to deliver high-quality data products. The role requires strong Python, SQL and Apache Spark skills, experience with Delta Lake, SDP, data modeling, and dashboards using Databricks SQL, Lakeview, Power BI or Tableau.

Qualifications

• Strong knowledge of Databricks platform fundamentals.
• Proficiency in Python, SQL and Apache Spark (batch and streaming).
• Hands-on experience with Delta Lake and ETL/data engineering patterns.
• Experience with Spark Declarative Pipelines (SDP).
• Solid data modeling skills: medallion architecture and dimensional modeling.
• Experience building dashboards with Databricks SQL, Lakeview, Power BI or Tableau.
• Familiar with DevOps, CI/CD and deployment automation.
• Knowledge of data governance and security in Databricks.

Responsibilities

• Design, build, and maintain scalable data solutions on Databricks.
• Develop and optimize batch and streaming pipelines using Spark, Python, and SQL.
• Implement SDP with streaming tables, materialized views and data quality rules.
• Apply ETL design patterns for robust processing.
• Design data models using medallion architecture and Delta Lake optimization.
• Create dashboards using Databricks SQL, Lakeview, Power BI or Tableau.
• Manage Databricks workspaces, clusters, notebooks, and Unity Catalog.
• Implement CI/CD pipelines and deployment automation with Lakeflow Jobs.
• Ensure governance and security via Unity Catalog permissions and row/column security.
• Collaborate with cross-functional teams to deliver secure data solutions.

Skills

Databricks platform fundamentals

Python

SQL

Apache Spark

Delta Lake

ETL design patterns

Spark Declarative Pipelines

Data modeling techniques

Medallion architecture

Dimensional modeling

Databricks SQL

Lakeview

DevOps practices

Data governance

Tools

Power BI

Tableau

Unity Catalog

Terraform

REST APIs

Lakeflow

Job description

HIRING FOR APPLICATION SOFTWARE ENGINEER - IMMEDIATE JOINER - ROTATIONAL SHIFTS

Key Responsibilities:

• Design, build, and maintain scalable data solutions using the Databricks platform.
• Develop and optimize batch and streaming data pipelines using Apache Spark, Python, and SQL.
• Implement modern data pipelines using Spark Declarative Pipelines (SDP), including streaming tables, materialized views, and embedded data quality rules.
• Apply ETL design patterns and best practices for robust and efficient data processing.
• Design and manage data models using medallion architecture, dimensional modeling, and Delta Lake optimization techniques.
• Create and maintain dashboards and visualizations using Databricks SQL, Lakeview dashboards, notebook charting libraries, and BI tools such as Power BI and Tableau.
• Manage Databricks workspaces, cluster configurations, notebooks, and Unity Catalog for secure and governed data access.
• Implement CI/CD pipelines, job orchestration using Lakeflow Jobs, and deployment automation with Asset Bundles.
• Ensure compliance with governance and security standards through Unity Catalog permissions, row/column-level security, and audit logging.
• Collaborate with cross-functional teams to deliver high-quality, scalable, and secure data solutions.

Required Skills & Qualifications:

• Strong knowledge of Databricks platform fundamentals, including workspaces, clusters, notebooks, and Unity Catalog.
• Proficiency in Python, SQL, and Apache Spark (batch and streaming).
• Hands-on experience with Delta Lake and modern ETL/data engineering design patterns.
• Experience with Spark Declarative Pipelines (SDP).
• Good understanding of data modeling techniques, including medallion architecture and dimensional modeling.
• Experience in developing dashboards and reports using Databricks SQL, Lakeview, Power BI, or Tableau.
• Familiarity with DevOps practices, including CI/CD and deployment automation.
• Knowledge of data governance and security concepts within Databricks.

Preferred Skills:

• Experience with MLflow, Terraform, and REST APIs.
• Exposure to cloud platforms such as AWS, Azure, or GCP.