Databricks & AWS Lead — Onsite Hartford

LTM; Hartford (CT); On-site; USD 110,000 - 150,000; Full time

Benefits offered by this job

Comprehensive Medical Plan Covering

Short/Long-Term Disability Coverage

401(k) Plan with Company match

Life Insurance

Vacation Time, Sick Leave, Holidays

Paid Paternity and Maternity Leave

Job summary

LTIMindtree is seeking a Databricks-focused data engineering role for our Hartford, CT onsite team. The candidate will implement Databricks-based solutions using AWS services such as S3, Lambda, and Glue, with PySpark and Python libraries to handle data engineering tasks.

The role emphasizes ETL concepts, data pipeline architecture, and end-to-end data warehousing. Collaboration with business stakeholders and mentoring of junior engineers are key responsibilities.

Qualifications

• Experience delivering Databricks-based solutions using AWS services.
• Proficiency with PySpark and Python libraries for data engineering tasks.
• Strong SQL development skills including stored procedures and data marts.

Responsibilities

• Collaborate with business users to understand challenges and provide Databricks-based solutions.
• Research and evaluate new Databricks features; conduct POCs and document best practices.
• Provide support for Spark-related issues and participate in code reviews with recommendations.
• Lead and mentor junior team members in development and troubleshooting activities.
• Oversee mid-sized teams and ensure quality and timely delivery in an Agile environment.
• Contribute to solution design discussions and produce design documents.
• Drive job cost optimization and performance tuning to enhance system efficiency.
• Support CI/CD processes and infrastructure automation to streamline deployments.
• Actively participate in Agile ceremonies and improve team collaboration and productivity.

Skills

Databricks

AWS services

PySpark

Python libraries

SQL development

ETL concepts

Agile SDLC

CI/CD

Communication skills

Tools

Terraform

GitHub

Job description

LTIMindtree is seeking a Databricks-focused data engineering role for our Hartford, CT onsite team. The candidate will implement Databricks-based solutions using AWS services such as S3, Lambda, and Glue, with PySpark and Python libraries to handle data engineering tasks.

The role emphasizes ETL concepts, data pipeline architecture, and end-to-end data warehousing. Collaboration with business stakeholders and mentoring of junior engineers are key responsibilities.