Databricks Data Engineer

LTM; Raritan (NJ); On-site; USD 120,000 - 180,000; Full time

Benefits offered by this job

Medical plan

Disability coverage

401(k) plan

Life insurance

Vacation & paid leave

Paternity/maternity leave

Job summary

LTIMindtree is seeking a Data Engineer to design and implement scalable data pipelines using Databricks. You will work with Delta Lake, Unity Catalog, and Delta Sharing to ensure secure, governed data platforms. Strong Python and PySpark skills are essential to deliver robust ETL/ELT solutions for cross-functional teams.

You will partner with architects and analysts to meet data requirements, optimize performance, and support production deployments with modern DevOps practices.

Qualifications

• Experience with Databricks and Delta Lake technologies.
• Hands-on coding in Python and PySpark for large-scale data processing.
• Strong SQL understanding and query optimization.
• Experience implementing CI/CD for Databricks workloads.
• Familiarity with Git-based source control and DevOps pipelines.

Responsibilities

• Design, develop, and maintain scalable ETL/ELT pipelines using Databricks notebooks.
• Build and optimize data processing solutions with PySpark and Python.
• Implement and manage data governance, security, and access with Unity Catalog.
• Work with Delta Lake features including Delta Sharing, Time Travel, and CDF.
• Develop and maintain CI/CD pipelines for Databricks deployments.
• Tune performance of Databricks workloads and monitor data quality.

Skills

Databricks

Python

PySpark

SQL

CI/CD

Git

Delta Lake

Unity Catalog

Delta Sharing

Structured Streaming

Data governance

Medallion Architecture

Large-scale processing

Spark optimization

DevOps practices

Tools

Databricks

Delta Lake

Delta Sharing

Unity Catalog

Job description

Role Description

We are looking for a highly motivated Data Engineer with strong expertise in Databricks and modern data engineering practices

We are looking for a highly motivated Data Engineer with strong expertise in Databricks and modern data engineering practices

The ideal candidate should have handson experience in building scalable data pipelines notebooks implementing CICD processes and working with Delta Lake technologies The candidate must possess excellent Python programming skills a solid understanding of Unity Catalog and the ability to collaborate effectively within large crossfunctional teams

Key Responsibilities

Design develop and maintain scalable ETLELT pipelines Notebooks using Databricks

Build and optimize data processing solutions using PySpark and Python

Implement and manage data governance security and access controls using Unity Catalog

Work with Delta Lake features including Delta Sharing Time Travel Change Data Feed CDF and data optimization techniques

Develop and maintain CICD pipelines for Databricks deployments using industrystandard DevOps practices

Perform performance tuning and optimization of Databricks workloads

Collaborate with architects business analysts and stakeholders to understand data requirements and deliver solutions

Support production deployments troubleshooting monitoring and performance improvements

Follow coding standards documentation and best practices for software development lifecycle SDLC

Required Skills

Databricks Strong

Strong understanding of Databricks architecture and ecosystem

handson experience with

Delta Lake

Delta Sharing

Unity Catalog

Structured Streaming

Workflow orchestration

Performance tuning and optimization

Data governance and access management

Experience with Medallion Architecture Bronze Silver Gold layers

Programming

Strong handson coding experience in Python

Experience with PySpark for largescale data processing

Good understanding of SQL and query optimization

DevOps CICD

Experience implementing CICD processes for Databricks workloads

Familiarity with Gitbased source control and branching strategies

Experience with deployment automation tools and DevOps pipelines

Data Engineering Concepts

ETLELT design patterns

Data modeling and data warehousing concepts

Data quality monitoring and observability frameworks

Good to Have Skills

AWS Cloud

AWS Glue

S3

IAM

Lambda

Azure Cloud

Azure Data Factory ADF

Azure Storage

Azure Databricks

Key Vault

Soft Skills

Excellent verbal and written communication skills

Strong problemsolving and analytical abilities

Ability to work effectively in a large global team environment

Strong stakeholder management and collaboration skills

Selfdriven proactive and able to work independently with minimal supervision

Other Details

Actual compensation within the range will be dependent upon the individual's skills, experience, performance and internal equity.

Benefits/perks listed below may vary depending on the nature of your employment with LTIMindtree (“LTIM”).

Benefits And Perks

• Comprehensive Medical Plan Covering Medical, Dental, Vision
• Short Term and Long-Term Disability Coverage
• 401(k) Plan with Company match
• Life Insurance
• Vacation Time, Sick Leave, Paid Holidays
• Paid Paternity and Maternity Leave

The range displayed on each job posting reflects the minimum and maximum salary target for the position across all US locations. Within the range, individual pay is determined by work location and job level and additional factors including job-related skills, experience, and relevant education or training. Depending on the position offered, other forms of compensation may be provided as part of overall compensation like an annual performance-based bonus, sales incentive pay and other forms of bonus or variable compensation.

Disclaimer: The compensation and benefits information provided herein is accurate as of the date of this posting.

LTIMindtree is an equal opportunity employer that is committed to diversity in the workplace. Our employment decisions are made without regard to race, color, creed, religion, sex (including pregnancy, childbirth or related medical conditions), gender identity or expression, national origin, ancestry, age, family-care status, veteran status, marital status, civil union status, domestic partnership status, military service, handicap or disability or history of handicap or disability, genetic information, atypical hereditary cellular or blood trait, union affiliation, affectional or sexual orientation or preference, or any other characteristic protected by applicable federal, state, or local law, except where such considerations are bona fide occupational qualifications permitted by law.