Senior Python/Data Engineer — Databricks, Azure & Spark

Largeton Group; Fort Worth (TX); On-site; USD 140,000 - 175,000; Full time

Job summary

Largeton Group in Fort Worth, TX seeks a senior data engineer with 7–10 years in Python, ETL, SQL, Spark, and Databricks to design scalable data solutions using Azure ML. You will build and optimize ETL/ELT processes, implement data governance, and lead CI/CD pipelines with Azure DevOps, GitHub Actions, or Jenkins in a pod-based agile team.

In-person interview and local presence near Fort Worth, TX are required; experience with Azure Cloud and monitoring/alerting is essential.

Qualifications

• 7–10+ years in Python, ETL data handling, and SQL.
• Design scalable data solutions with Python and Azure ML.
• Develop and optimize ETL/ELT with Spark and Python.
• Improve Python job performance and cost-efficiency with optimization.
• Collaborate with data scientists, analysts, and stakeholders.
• Implement data security, governance frameworks (Unity Catalog, access controls, encryption, data lineage).
• Champion DevOps and automation with CI/CD pipelines (Azure DevOps, GitHub Actions, Jenkins).
• Develop monitoring, logging, and alerting for production pipelines.

Responsibilities

• Develop scalable data and application solutions using Python and Azure ML.
• Maintain CI/CD pipelines for code deployment, preferably on Azure.
• Work in pod-based agile teams supporting multiple projects.
• Ensure reliability with robust monitoring, logging, and alerts.

Skills

Python

SQL

ETL

Spark

Databricks

Azure Cloud

Azure ML

CI/CD

Azure DevOps

GitHub Actions

Jenkins

Monitoring

Logging

Unity Catalog

Data governance

Java

Spring

AI tools

Tools

Databricks

Spark

Azure DevOps

GitHub Actions

Jenkins

Azure ML

Unity Catalog

Job description

Largeton Group in Fort Worth, TX seeks a senior data engineer with 7–10 years in Python, ETL, SQL, Spark, and Databricks to design scalable data solutions using Azure ML. You will build and optimize ETL/ELT processes, implement data governance, and lead CI/CD pipelines with Azure DevOps, GitHub Actions, or Jenkins in a pod-based agile team.

In-person interview and local presence near Fort Worth, TX are required; experience with Azure Cloud and monitoring/alerting is essential.