Senior Data Engineer

Addison Group; Dallas (TX); On-site; USD 120,000 - 140,000; Full time

Job summary

A leading staffing firm is searching for a Senior Data Engineer in Coppell, TX. This role is for an experienced professional with over 8 years in Data Engineering, specializing in Microsoft Azure and Databricks. The responsibilities include designing and automating data pipelines while addressing ambiguous data. The ideal candidate possesses strong SQL skills and experience in cloud environments such as Azure or AWS. This position emphasizes independent work, with collaboration being key to success.

Qualifications

• 8+ years of experience in Data Engineering or Business Intelligence.
• Specializes in Microsoft Azure and Databricks.
• Experience with Azure DevOps and SQL (ETL/SSIS).

Responsibilities

• Design, build, maintain, and automate enterprise data architecture/pipelines.
• Collaborate on data definitions and success criteria.
• Work independently to resolve ambiguous data issues.

Skills

Data Pipeline Architecture

SQL

Automation (Python, PySpark, Scala)

Databricks

Azure Data Factory

Cloud-based environments (Azure or AWS)

Job description

Title: Senior Data Engineer

Location: Coppell, TX

Salary Range: $120K-$140K

We are looking to bring on a Senior Data Engineer to our team due to growth. What we need is someone who comes 8+ years of experience in the Data Engineering space who specializes in Microsoft Azure and Databricks. This person will be a part of multiple initiatives for the "New Development" and "Data Reporting" teams but will be primarily tasked with designing, building, maintaining, and automating their enterprise data architecture/pipelines within the cloud.

Technology-wise we are needing to come with skills in Azure Databricks (5+ years), cloud-based environment (Azure and/or AWS), Azure DevOps (ADO), SQL (ETL, SSIS packages), and PySpark or Scala automation. Architecture experience in building pipelines, data modeling, data pipeline deployment, data mapping, etc.

Personality-wise we need an Engineer who is able to assess, breakdown, and complete tasks without them needing too much direction. There is a lot of ambiguous data that they need to help with define, uncover, and resolve. Most of the work will be done from a solo capacity but collaboration for the data and what defines success is crucial.

Top Skills

• 8+ Years of Data Engineer/Business Intelligence
• Databricks and Azure Data Factory (ADF) (Need version on resume): Most updates is Unity Catalog for Databricks
• Cloud-based environments (Azure or AWS)
• Data Pipeline Architecture and CI/CD methodology
• SQL
• Automation (Python (PySpark), Scala)