Python Developer - Databricks and Azure

Largeton Group; Fort Worth (TX); On-site; USD 140,000 - 175,000; Full time

Job summary

Largeton Group in Fort Worth, TX seeks a senior data engineer with 7–10 years in Python, ETL, SQL, Spark, and Databricks to design scalable data solutions using Azure ML. You will build and optimize ETL/ELT processes, implement data governance, and lead CI/CD pipelines with Azure DevOps, GitHub Actions, or Jenkins in a pod-based agile team.

In-person interview and local presence near Fort Worth, TX are required; experience with Azure Cloud and monitoring/alerting is essential.

Qualifications

• 7–10+ years in Python, ETL data handling, and SQL.
• Design scalable data solutions with Python and Azure ML.
• Develop and optimize ETL/ELT with Spark and Python.
• Improve Python job performance and cost-efficiency with optimization.
• Collaborate with data scientists, analysts, and stakeholders.
• Implement data security, governance frameworks (Unity Catalog, access controls, encryption, data lineage).
• Champion DevOps and automation with CI/CD pipelines (Azure DevOps, GitHub Actions, Jenkins).
• Develop monitoring, logging, and alerting for production pipelines.

Responsibilities

• Develop scalable data and application solutions using Python and Azure ML.
• Maintain CI/CD pipelines for code deployment, preferably on Azure.
• Work in pod-based agile teams supporting multiple projects.
• Ensure reliability with robust monitoring, logging, and alerts.

Skills

Python

SQL

ETL

Spark

Databricks

Azure Cloud

Azure ML

CI/CD

Azure DevOps

GitHub Actions

Jenkins

Monitoring

Logging

Unity Catalog

Data governance

Java

Spring

AI tools

Tools

Databricks

Spark

Azure DevOps

GitHub Actions

Jenkins

Azure ML

Unity Catalog

Job description

Summary

• Minimum 7 10 years of experience in Python, ETL data handling, and SQL.
• Design and implement scalable data and application solutions using Python and Azure ML.
• Develop and optimize complex ETL/ELT processes for large-scale datasets using Spark and Python.
• Enhance Python job performance and cost-efficiency through advanced optimization techniques.
• Collaborate with data scientists, analysts, and business stakeholders to create technical solutions for business problems.
• Implement data security, compliance, and governance frameworks (e.g., Unity Catalog, access controls, encryption, data lineage).
• Champion DevOps and automation by building CI/CD pipelines using Azure DevOps, GitHub Actions, or Jenkins.
• Develop robust monitoring, logging, and alerting for production pipelines to ensure reliability.
• Must have strong experience in Databricks, Azure Cloud, Spark, and application development.
• Experience with software development life cycle (SDLC) and agile methodologies.
• Design and develop CI/CD pipelines for code deployment, preferably to Azure, using Git-based tools.
• At least 5 years of hands-on experience with Spark, Databricks, and monitoring/alerting systems.
• Nice to have: Java, Spring, comprehensive Azure services knowledge, and excellent communication skills.
• Experience using AI tools for enhanced productivity is a plus.
• Will work in a pod-based agile team structure, supporting multiple projects and ensuring consistent agile practices.
• Local candidates (within 50 miles of Fort Worth, TX) required; in-person interview and coding assignment mandatory.