Databricks Engineer

Nice Software Solutions; Bengaluru; Hybrid; INR 1,200,000 - 1,800,000; Full time

Benefits offered by this job

Hybrid work arrangement

Job summary

NICE Software Solutions in Bengaluru/Chennai seeks an experienced Data Engineer to design and implement scalable data pipelines using Python, PySpark, SQL, and Databricks, with a focus on reliable ETL and data warehousing.

The role requires hands-on development, Airflow workflow, Linux shell scripting, and familiarity with AI coding assistants. Immediate joiners or those who can join within 30 days are preferred.

Qualifications

• 58 years of experience in Data Engineering or a similar role (as stated).
• Strong hands-on experience with Python, PySpark, SQL, and Databricks.
• Experience with data modelling, ETL processes and data warehousing concepts.
• Familiarity with Apache Airflow for orchestration and scheduling.
• Linux administration and shell scripting experience.
• Experience using AI coding assistants such as Claude Code, GitHub Copilot, Codex, or Cursor.

Responsibilities

• Design, develop, and maintain scalable data pipelines using Python, PySpark, and SQL.
• Ingest, process, and transform data from multiple sources; ensure data quality and reliability.
• Develop and optimize Databricks jobs for performance and cost efficiency.
• Build and optimize data warehouse solutions and data models to support analytics.
• Create and manage Airflow DAGs for workflow orchestration and scheduling.

Skills

Python

PySpark

SQL

Databricks

Airflow

Linux

Shell scripting

AI coding assistants

Education

Bachelors degree in Computer Science or Engineering

Tools

Claude Code

GitHub Copilot

Codex

Cursor

Job description

Data Engineer Python, PySpark & Databricks

Company: NICE Software Solutions

Experience: 5 - 8 years

Location: Chennai / Bengaluru

Work Mode: Hybrid

Notice Period: Immediate joiners or candidates who can join within 30 days preferred

About NICE Software Solutions

NICE Software Solutions is a business intelligence solutions company focused on delivering impactful, self-driven BI applications that support business growth.

Role Overview

We are looking for a hands-on Data Engineer with 58 years of experience and strong expertise in Python, PySpark, SQL, and Databricks. The ideal candidate will have experience building scalable data pipelines, implementing ETL workflows, and developing data warehouse solutions.

The role also requires familiarity with Apache Airflow, Linux administration, shell scripting, and practical experience using AI coding assistants such as Claude Code, GitHub Copilot, Codex, or Cursor.

Key Responsibilities

Data Pipeline Development

• Design, develop, and maintain scalable data pipelines using Python, PySpark, and SQL.
• Ingest, process, and transform data from multiple sources.
• Implement data quality checks and monitoring to ensure pipeline reliability and data integrity.

Databricks Development & Optimization

• Use Databricks for data ingestion, ETL processing, transformation, and analysis.
• Develop and optimize Databricks jobs and clusters for performance and cost efficiency.
• Work with large volumes of structured and unstructured data.

Data Warehousing & Modelling

• Build and optimize data warehouse solutions for efficient data storage and retrieval.
• Design and implement data models to support analytical and reporting requirements.
• Apply best practices across ETL development and data warehousing processes.

Workflow Orchestration

• Develop, configure, and manage Apache Airflow DAGs for pipeline orchestration and scheduling.
• Implement error handling, monitoring, and alerting to support reliable workflow execution.

Linux & Shell Scripting

• Work with Linux-based environments supporting data engineering workloads.
• Troubleshoot infrastructure and server-related issues.
• Develop shell scripts to automate routine data engineering tasks.

AI-Assisted Development

• Use AI coding assistants such as Claude Code, GitHub Copilot, Codex, or Cursor in day-to-day engineering work.
• Leverage these tools to improve development productivity, code quality, and efficiency.

Collaboration & Documentation

• Collaborate with Data Scientists, Data Analysts, and business stakeholders to understand requirements and deliver effective data solutions.
• Document data pipelines, workflows, technical solutions, and best practices.
• Contribute to the continuous improvement of data engineering practices and standards.

Required Skills & Qualifications

• 58 years of experience in Data Engineering or a similar role.
• Strong hands-on experience with Python, PySpark, SQL, and Databricks.
• Strong understanding of data modelling, ETL processes, and data warehousing concepts.
• Familiarity with Apache Airflow for workflow orchestration and scheduling.
• Experience with Linux administration and shell scripting.
• Practical experience using AI coding assistants such as Claude Code, GitHub Copilot, Codex, or Cursor.
• Strong problem-solving, analytical, communication, and collaboration skills.
• Bachelors degree in Computer Science, Engineering, or a related field.

Joining Preference

Candidates who can join immediately or within 30 days will be preferred.