Remote Databricks Architect & Senior Data Engineer

LTM; Edison (NJ); Hybrid; Full time

Benefits offered by this job

Comprehensive Medical Plan

401(k) Plan with Company match

Paid Maternity Leave

Life Insurance

Job summary

A technology and consulting company seeks a Databricks Architect/Sr Data Engineer in Edison, NJ, with at least 6 years of experience in data workflows using Azure and Databricks. Responsibilities include developing data ingestion pipelines and optimizing Databricks jobs. Strong SQL skills are essential, along with understanding Azure components. Excellent benefits such as medical coverage, 401(k) matching, and paid leave are offered.

Qualifications

• 6+ years of experience in data workflow development in Azure.
• Proven skills in developing data ingestion pipelines in ADF.
• Strong understanding of Azure service components.

Responsibilities

• Develop and optimize Databricks notebooks and jobs.
• Coordinate with Microsoft for issue resolutions.
• Guide junior team members on design and development.

Skills

Experience with Azure stack

Databricks

SQL skills

ETL/ELT orchestration with ADF

Python, Spark, Scala

Tools

Azure DevOps

CI/CD tools

Job description

Location Edison NJ Rmote

Must Haves

1 Candidate should have at 6 yrs of experience working on data workflow development in Azure stack with Databricks and ADF as Primary skill

2 Strong understanding of Azure service components like SQL DB SQL Server Synapse Data Bricks ADLS Blob storage ADF

3 Candidate should have a good understanding of developing end to end data ingestion pipelines in ADF and using ADF for ETLELT orchestration

4 Very strong experience in Data Bricks Must be able to develop and optimize Data bricks notebooks and jobs Experience in Python Spark Scala would be great

5 Should have excellent SQL skills which includes knowledge of SQL Server DDLs to create the data models and complex SQL calculation scripts for manipulating data per business logic

6 Must have a working experience in Databricks Asset Builder Azure DevOps and CICD tools at each phase of the SDLC cycle

Good to have

7 Should be adept at using tools to migrate existing data structures into SQL Server Synapse for migration projects

8 Should understand data quality concepts and write SQL scripts for specific for DQ checks

9 Exposure to other Azure components like Blob storage Logic Apps AAS Power BI will be beneficial

10 Should be able to direct junior team members for proper design and development

11 Should have good communication skills Candidate if required need to coordinate with Microsoft for issue resolutions

Benefits/perks listed below may vary depending on the nature of your employment with LTIMindtree (“LTIM”):

Benefits and Perks:

• Comprehensive Medical Plan Covering Medical, Dental, Vision
• Short Term and Long-Term Disability Coverage
• 401(k) Plan with Company match
• Life Insurance
• Paid Paternity and Maternity Leave

The range displayed on each job posting reflects the minimum and maximum salary target for the position across all US locations. Within the range, individual pay is determined by work location and job level and additional factors including job-related skills, experience, and relevant education or training.Depending on the position offered, other forms of compensation may be provided as part of overall compensation like an annual performance-based bonus, sales incentive pay and other forms of bonus or variable compensation.

Role description

Role Databricks Architect Sr Data Engineer

Location Edison NJ Rmote

Must Haves

1 Candidate should have at 6 yrs of experience working on data workflow development in Azure stack with Databricks and ADF as Primary skill

2 Strong understanding of Azure service components like SQL DB SQL Server Synapse Data Bricks ADLS Blob storage ADF

3 Candidate should have a good understanding of developing end to end data ingestion pipelines in ADF and using ADF for ETLELT orchestration

4 Very strong experience in Data Bricks Must be able to develop and optimize Data bricks notebooks and jobs Experience in Python Spark Scala would be great

5 Should have excellent SQL skills which includes knowledge of SQL Server DDLs to create the data models and complex SQL calculation scripts for manipulating data per business logic

6 Must have a working experience in Databricks Asset Builder Azure DevOps and CICD tools at each phase of the SDLC cycle

Good to have

7 Should be adept at using tools to migrate existing data structures into SQL Server Synapse for migration projects

8 Should understand data quality concepts and write SQL scripts for specific for DQ checks

9 Exposure to other Azure components like Blob storage Logic Apps AAS Power BI will be beneficial

10 Should be able to direct junior team members for proper design and development

11 Should have good communication skills Candidate if required need to coordinate with Microsoft for issue resolutions

Other details

Benefits/perks listed below may vary depending on the nature of your employment with LTIMindtree (“LTIM”):

Benefits and Perks:

• Comprehensive Medical Plan Covering Medical, Dental, Vision


• Short Term and Long-Term Disability Coverage


• 401(k) Plan with Company match


• Life Insurance


• Vacation Time, Sick Leave, Paid Holidays


• Paid Paternity and Maternity Leave

The range displayed on each job posting reflects the minimum and maximum salary target for the position across all US locations. Within the range, individual pay is determined by work location and job level and additional factors including job-related skills, experience, and relevant education or training.Depending on the position offered, other forms of compensation may be provided as part of overall compensation like an annual performance-based bonus, sales incentive pay and other forms of bonus or variable compensation.

Disclaimer: The compensation and benefits information provided herein is accurate as of the date of
this posting.
LTIMindtree is an equal opportunity employer that is committed to diversity in the workplace. Our
employment decisions are made without regard to race, color, creed, religion, sex (including
pregnancy, childbirth or related medical conditions), gender identity or expression, national origin,
ancestry, age, family-care status, veteran status, marital status, civil union status, domestic
partnership status, military service, handicap or disability or history of handicap or disability, genetic
information, atypical hereditary cellular or blood trait, union affiliation, affectional or sexual orientation
or preference, or any other characteristic protected by applicable federal, state, or local law, except
where such considerations are bona fide occupational qualifications permitted by law.