Senior Data Engineer - Databricks (No Sponsorship Available)

Thgrp; Indianapolis (IN); On-site; USD 110,000 - 150,000; Full time

Job summary

A leading company in road construction is seeking a Senior Data Engineer to develop and implement strategic data initiatives. The role involves building data pipelines, optimizing performance, and collaborating across functional teams to enhance data governance using platforms like Databricks. Ideal candidates will possess strong programming skills and a relevant degree.

Qualifications

• 5+ years of experience in data engineering or a related field.
• Hands-on experience with Databricks or Snowflake Cloud Data Platforms Required.
• Strong analytical and problem-solving skills.

Responsibilities

• Develop and support data pipelines within a Cloud Data Platform.
• Monitor and optimize Databricks cluster performance.
• Integrate Databricks with other Azure services.

Skills

Python

SQL

Problem-solving

Data analysis

Education

Bachelor's Degree in Computer Science

Master's Degree in Computer Science

Tools

Databricks

Snowflake

PowerBI

Azure

Job description

Senior Data Engineer - Databricks (No Sponsorship Available) page is loaded

Senior Data Engineer - Databricks (No Sponsorship Available)

Apply locations Indianapolis, IN time type Full time posted on Posted 30+ Days Ago job requisition id R-659

Build Your Career at Heritage Construction + Materials!

The Senior Data Engineer will help develop and implement strategic data initiatives. They will be responsible for developing and maintaining data pipelines, promoting sustainable data governance, and serving as the organization’s cloud data platform expert.

This position requires U.S. work authorization

Essential Functions

• Develop and support data pipelines within a Cloud Data Platform, such as Databricks or Snowflake
• Monitor and optimize Databricks cluster performance, ensuring cost-effective scaling and resource utilization
• Implement and maintain Delta Lake for optimized data storage, ensuring data reliability, performance, and versioning
• Automate CI/CD pipelines for data workflows using Azure DevOps
• Integrate Databricks with other Azure services, such as Azure Data Factory, Azure Synapse, and ADLS
• Design and implement monitoring solutions, leveraging Databricks monitoring tools, Azure Log Analytics, or custom dashboards for cluster and job performance
• Collaborate with cross-functional teams to support data governance through the use of Databricks Unity Catalog

Education Qualifications

• Required Bachelor's Degree in Computer Science, Engineering, Data Science, Business Analytics, or a related field
• Preferred Master's Degree in Computer Science, Engineering, Data Science, Business Analytics, or a related field

Experience Qualifications

• 5+ years of experience in data engineering or a related field
• Expertise with programming languages such as Python/PySpark, SQL, or Scala
• Experience working in a cloud environment (Azure preferred) with strong understanding of cloud data architecture
• Hands-on experience with Databricks or Snowflake Cloud Data Platforms Required
• Experience with workflow orchestration (e.g., Databricks Jobs, or Azure Data Factory pipelines) Required

Skills and Abilities

• Strong analytical and problem-solving skills
• Experience with programming languages such as Python, Java, R, or SQL
• Experience with Databricks or Snowflake Cloud Data Platforms Required
• Knowledge of statistical analysis and data visualization tools, such as PowerBI or Tableau
• Understanding of business financials and NPV analysis
• Proficient in Microsoft Office
• Creative thinker that is open to working collaboratively with a team

About Heritage Construction + Materials

Heritage Construction + Materials (HC+M) is part of The Heritage Group, a privately held, family-owned business headquartered in Indianapolis. HC+M has core capabilities in infrastructure building. Its collection of companies provides innovative road construction and materials services across the Midwest. HC+M companies, including Asphalt Materials, Inc., Evergreen Roadworks, Milestone Contractors and US Aggregates, proudly employ 3,000 people at 68 locations across seven states. Learn more at www.heritagebuilds.com.

All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.

#HeritageConstruction+Materials

About Us

Heritage Construction + Materials provides diverse careers in road construction and material supply throughout the Midwest. Here you can define your own path to success and build a career made to last.

Heritage Construction and Materials is a proud member of The Heritage Group family of companies. Explore all Heritage Group career opportunities here .