Databricks Developer

LTM; Branchville (NJ); On-site; USD 120,000 - 160,000; Full time

Benefits offered by this job

Comprehensive Medical Plan Covering .M

Short Term and Long-Term Disability .?

401(k) Plan with Company match

Life Insurance

Paid Paternity and Maternity Leave

Job summary

LTIMindtree is seeking an ETL/Data Engineer for an onsite role in the United States (New Jersey). The candidate will design and implement ETL pipelines using Azure Databricks, PySpark, and SparkSQL while collaborating with client stakeholders to derive technical solutions.

Must have 5+ years in ETL and 3+ years on Azure Databricks migrations, with strong written and spoken communication. Onsite responsibilities include coordinating with offshore teams and delivering accurate work estimates.

Qualifications

• Minimum 5+ years in ETL development with Azure Databricks.
• 3+ years in Azure Databricks development on on-prem to cloud migrations.
• Proficiency with SparkSQL, Python, SQL, and ETL pipelines.
• Experience with XML/JSON workflows and data formats is a plus.
• Strong communication and client-facing skills for onsite role.

Responsibilities

• Develop and optimize ETL pipelines using Azure Databricks and SparkSQL.
• Collaborate with stakeholders to review requirements and estimate work.
• Review code and mentor offshore team members.
• Ensure technical solutions align with data integration needs.

Skills

Azure Databricks

Python

SQL

ETL concepts

Code reviews

Pyspark

SparkSQL

Required documentation

Offshore team coordination

Client stakeholder interaction

Tools

JIRA

Informatica PC

ADF (Azure Data Factory)

Job description

LTIMindtree is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies. As a digital transformation partner to more than 700+ clients, LTIMindtree brings extensive domain and technology expertise to help drive superior competitive differentiation, customer experiences, and business outcomes in a converging world. Powered by nearly 90,000 talented and entrepreneurial professionals across more than 30 countries, LTIMindtree — a Larsen & Toubro Group company — combines the industry-acclaimed strengths of erstwhile Larsen and Toubro Infotech and Mindtree in solving the most complex business challenges and delivering transformation at scale. For more information, please visit www.ltimindtree.com.

Technical Skills Primary

Primary Technologies Azure Databricks pyspark python

Database Technologies SQL MS SQL Server Relational Databases

Adherence to Application Development Documentation Best Practices

Experience in conducting Design Code Reviews

Strong experience on ETL concepts

Strong Hands on coding experience on primary technology

Technical Skills Secondary Nice to have NOT MANDATORY

Understanding on ADF platform and framework

Experience on working with XML JSON file

Experience on Informatica PC

Familiar with Agile software development methodologies preferable JIRA

Soft Skills

As this is an onsite role must have strong written and oral communication skills

Insurance Domain Knowledge

Strong ability to work with client stakeholders

Requirement Review and Work Effort Estimation

Ability to manage offshore team work and code review

Ability to understand user customer requirement and provide technical solution

Evaluation Questions

Does the candidate have minimum 5 yrs of experience working on ETL developemnt minimum 3 yrs experience on Azure Databricks development

has the candidate worked on onprem to cloud migration project for Azure Databricks for atleast 1 project

Does the candidate have advance level knowledge on ETL concepts to develop ETL pipeline from multiple types of date sources like csv xml JSON relational database

Mandatory Skills :

Apache Spark, Databricks, Python for DATA, SparkSQL

Benefits/perks listed below may vary depending on the nature of your employment with LTIMindtree ("LTIM"):

Benefits and Perks:

• Comprehensive Medical Plan Covering Medical, Dental, Vision
• Short Term and Long-Term Disability Coverage
• 401(k) Plan with Company match
• Life Insurance
• Paid Paternity and Maternity Leave

The range displayed on each job posting reflects the minimum and maximum salary target for the position across all US locations. Within the range, individual pay is determined by work location and job level and additional factors including job-related skills, experience, and relevant education or training. Depending on the position offered, other forms of compensation may be provided as part of overall compensation like an annual performance-based bonus, sales incentive pay and other forms of bonus or variable compensation.

Disclaimer:

The compensation and benefits information provided herein is accurate as of the date of this posting.

LTIMindtree is an equal opportunity employer that is committed to diversity in the workplace. Our employment decisions are made without regard to race, color, creed, religion, sex (including pregnancy, childbirth or related medical conditions), gender identity or expression, national origin, ancestry, age, family-care status, veteran status, marital status, civil union status, domestic partnership status, military service, handicap or disability or history of handicap or disability, genetic information, atypical hereditary cellular or blood trait, union affiliation, affectional or sexual orientation or preference, or any other characteristic protected by applicable federal, state, or local law, except where such considerations are bona fide occupational qualifications permitted by law.