Senior Data Engineer (Azure, Databricks, PySpark)

The Planet Group; Addison (TX); On-site; USD 194,848,000 - 209,175,000; Full time

Job summary

The Planet Group is seeking an experienced data engineer to design and support scalable database and data engineering solutions using SQL Server, Azure, Python, Databricks, and Spark. The role emphasizes building ETL/ELT pipelines, data models, and cloud-based platforms that enable analytics, reporting, and AI/ML initiatives.

You will collaborate with cross-functional teams including data science, BI, and application development to deliver secure, high-quality data solutions, while adhering to

Qualifications

• 7+ years of experience in database development, data engineering, or related disciplines.
• Strong experience with SQL Server and/or Azure SQL, including advanced T-SQL development, query optimization, performance tuning, and database support.
• Hands-on experience with Python for data processing, analytics, and data engineering workflows.
• Experience with Databricks, Apache Spark, or similar distributed data processing platforms.
• Solid understanding of data warehousing, dimensional modeling, and ETL/ELT pipeline development.
• Experience working within Azure cloud environments.
• Experience with .NET, C#, .NET Core, Angular, and AI/ML technologies is preferred.
• Strong analytical, problem-solving, and written/verbal communication skills.
• Bachelor's in Computer Science, Information Systems, or a related field preferred.

Responsibilities

• Design, develop, and optimize SQL Server and Azure SQL database solutions, including data models, stored procedures, and performance tuning.
• Build and maintain scalable ETL/ELT pipelines and data workflows using Python, Databricks, Spark, and Azure technologies.
• Develop relational and dimensional data models to support analytics and reporting.
• Support AI/ML initiatives by creating and maintaining data pipelines, feature datasets, and machine learning workflows.
• Collaborate with data science, engineering, BI, and application development teams to deliver integrated solutions.
• Participate in solution design, code reviews, Agile processes, and continuous improvement efforts.
• Troubleshoot production issues and implement sustainable solutions.
• Ensure adherence to data governance, security, quality, and compliance standards.

Skills

SQL Server

Azure SQL

Python

Databricks

Apache Spark

ETL/ELT pipelines

Data warehousing

Azure

.NET/C#

Angular

AI/ML

Data governance

Education

Bachelor's in Computer Science or Information Systems

Tools

Databricks

Apache Spark

Job description

Pay rate: $68-73 per hour

Employment status: W2 or C2C

Location: DFW area, must be onsite Tues, Wed, Thursday from week one

Contract: 6+ months to start with extensions expected (average total contract duration at 1-2 years)

Design and support scalable database and data engineering solutions using SQL Server, Azure, Python, Databricks, and Spark. Build and optimize ETL/ELT pipelines, data models, and cloud-based platforms that enable analytics, reporting, and AI/ML initiatives while collaborating with cross-functional teams to deliver secure, high-quality data solutions.

Responsibilities

• Design, develop, and optimize SQL Server and Azure SQL database solutions, including data models, stored procedures, and performance tuning.
• Build and maintain scalable ETL/ELT pipelines and data workflows using Python, Databricks, Spark, and Azure technologies.
• Develop relational and dimensional data models to support analytics and reporting.
• Support AI/ML initiatives by creating and maintaining data pipelines, feature datasets, and machine learning workflows.
• Collaborate with data science, engineering, BI, and application development teams to deliver integrated solutions.
• Participate in solution design, code reviews, Agile processes, and continuous improvement efforts.
• Troubleshoot production issues and implement sustainable solutions.
• Ensure adherence to data governance, security, quality, and compliance standards.

Required Skills

• 7+ years of experience in database development, data engineering, or related disciplines.
• Strong experience with SQL Server and/or Azure SQL, including advanced T-SQL development, query optimization, performance tuning, and database support.
• Hands-on experience with Python for data processing, analytics, and data engineering workflows.
• Experience with Databricks, Apache Spark, or similar distributed data processing platforms.
• Solid understanding of data warehousing, dimensional modeling, and ETL/ELT pipeline development.
• Experience working within Azure cloud environments.
• Experience with .NET, C#, .NET Core, Angular, and AI/ML technologies is preferred.
• Strong analytical, problem-solving, and written/verbal communication skills.
• Bachelor's in Computer Science, Information Systems, or a related field preferred.