Senior Data Engineer

Addison Group; Dallas (TX); On-site; USD 120,000 - 140,000; Full time

Job summary

The Addison Group in Coppell, TX is seeking a Senior Data Engineer to design, build, maintain, and automate enterprise data pipelines in a cloud environment. You will focus on Azure and Databricks with SQL ETL/SSIS, PySpark or Scala, and CI/CD practices.

Expect to work on multiple initiatives for the New Development and Data Reporting teams, with a strong emphasis on autonomous problem solving and collaboration to define and achieve data success metrics.

Qualifications

• 8+ years in data engineering with Azure and Databricks expertise.
• 5+ years with Azure Databricks (Unity Catalog updates noted).
• Cloud-focused architecture, pipelines, and data modeling.
• Proficient in SQL ETL/SSIS and Python PySpark or Scala automation.

Responsibilities

• Design, build, and maintain enterprise cloud data pipelines.
• Automate data architecture and deployment in Azure/AWS.
• Collaborate with Data Reporting and New Development teams.

Skills

Data engineering

Databricks

Azure

PySpark

Scala

SQL

CI/CD

Tools

Azure Databricks

Azure Data Factory

Azure DevOps

SSIS

PySpark

Scala

Job description

Salary Range: $120K-$140KWe are looking to bring on a Senior Data Engineer to our team due to growth. What we need is someone who comes 8+ years of experience in the Data Engineering space who specializes in Microsoft Azure and Databricks. This person will be a part of multiple initiatives for the \"New Development\" and \"Data Reporting\" teams but will be primarily tasked with designing, building, maintaining, and automating their enterprise data architecture/pipelines within the cloud.

Title: Senior Data Engineer

Location: Coppell, TX

Salary Range: $120K-$140K

We are looking to bring on a Senior Data Engineer to our team due to growth. What we need is someone who comes 8+ years of experience in the Data Engineering space who specializes in Microsoft Azure and Databricks. This person will be a part of multiple initiatives for the \"New Development\" and \"Data Reporting\" teams but will be primarily tasked with designing, building, maintaining, and automating their enterprise data architecture/pipelines within the cloud.

Technology-wise we are needing to come with skills in Azure Databricks (5+ years), cloud-based environment (Azure and/or AWS), Azure DevOps (ADO), SQL (ETL, SSIS packages), and PySpark or Scala automation. Architecture experience in building pipelines, data modeling, data pipeline deployment, data mapping, etc.

Personality-wise we need an Engineer who is able to assess, breakdown, and complete tasks without them needing too much direction. There is a lot of ambiguous data that they need to help with define, uncover, and resolve. Most of the work will be done from a solo capacity but collaboration for the data and what defines success is crucial.

Top Skills

• 8+ Years of Data Engineer/Business Intelligence
• Databricks and Azure Data Factory (ADF) (Need version on resume): *Most updates is Unity Catalog for Databricks*
• Cloud-based environments (Azure or AWS)
• Data Pipeline Architecture and CI/CD methodology
• SQL
• Automation (Python (PySpark), Scala)