Senior Data Engineer

Addison Group; Dallas (TX); On-site; USD 120,000 - 140,000; Full time

Job summary

Addison Group in Coppell, TX is seeking a Senior Data Engineer with 8+ years in data engineering, specializing in Microsoft Azure and Databricks to design and automate enterprise data pipelines.

You will work on New Development and Data Reporting initiatives, mostly solo with collaborative input, using PySpark/Scala, SQL ETL, and CI/CD in a cloud environment.

Qualifications

• 8+ years of Data Engineer/BI experience.
• Expertise with Azure Databricks and Unity Catalog.
• Experience in cloud environments (Azure and/or AWS).
• Design, build, and automate enterprise data pipelines.
• SQL ETL / SSIS; data modeling and mapping.

Responsibilities

• Design, build, maintain, and automate enterprise data pipelines in the cloud.
• Lead data architecture tasks with minimal direction, collaborating with teams as needed.
• Work on New Development and Data Reporting initiatives.
• Utilize PySpark or Scala for automation.

Skills

8+ Years Data Eng

Databricks & ADF

Cloud: Azure/AWS

Data Pipeline Architecture

SQL

Python PySpark

Scala

Job description

Title: Senior Data Engineer

Location: Coppell, TX

Salary Range: $120K-$140K

We are looking to bring on a Senior Data Engineer to our team due to growth. What we need is someone who comes 8+ years of experience in the Data Engineering space who specializes in Microsoft Azure and Databricks. This person will be a part of multiple initiatives for the "New Development" and "Data Reporting" teams but will be primarily tasked with designing, building, maintaining, and automating their enterprise data architecture/pipelines within the cloud.

Technology-wise we are needing to come with skills in Azure Databricks (5+ years), cloud-based environment (Azure and/or AWS), Azure DevOps (ADO), SQL (ETL, SSIS packages), and PySpark or Scala automation. Architecture experience in building pipelines, data modeling, data pipeline deployment, data mapping, etc.

Personality-wise we need an Engineer who is able to assess, breakdown, and complete tasks without them needing too much direction. There is a lot of ambiguous data that they need to help with define, uncover, and resolve. Most of the work will be done from a solo capacity but collaboration for the data and what defines success is crucial.

Top Skills:

• 8+ Years of Data Engineer/Business Intelligence
• Databricks and Azure Data Factory (ADF) (Need version on resume): *Most updates is Unity Catalog for Databricks*
• Cloud-based environments (Azure or AWS)
• Data Pipeline Architecture and CI/CD methodology
• SQL
• Automation (Python (PySpark), Scala)