Senior Data Engineer: Azure Databricks & Data Pipelines

Capstone Logistics, LLC; Peachtree Corners (GA); Hybrid; USD 120,000 - 150,000; Full time

Benefits offered by this job

Quarterly bonus

Medical, dental, vision benefits

401(k) retirement plan

Paid Time Off

Job summary

Capstone Logistics, LLC seeks a Senior Data Engineer to design, develop, and optimize enterprise data infrastructure focused on Azure Databricks, ADLS, and Power BI. You will translate business needs into scalable data solutions and lead technical initiatives as an individual contributor with mentorship responsibilities.

You will collaborate across teams to establish standards, drive continuous improvement, and support AI/ML data workloads while ensuring data governance and security best

Qualifications

• Bachelor's degree in a related technical field.
• 4+ years of hands-on data engineering experience.
• 2+ years with cloud-based data technologies, preferably Azure.
• Experience designing and supporting enterprise-scale data platforms and architectures.
• Strong ETL/ELT development, data transformation, and modeling.

Responsibilities

• Design, build, and maintain scalable batch and streaming data pipelines with Azure Databricks and Data Factory.
• Develop data ingestion, transformation, and integration processes (ETL/ELT).
• Architect and support enterprise data platforms, data lakes, and data warehousing.
• Integrate Azure Databricks with ADLS, Power BI, Azure DevOps, and Key Vault.
• Develop efficient data models, ensure data quality, reliability, and accessibility.
• Optimize Spark jobs, cluster configs, and cloud infrastructure for performance and cost.

Skills

Data engineering

Cloud architecture

Leadership

Collaboration

Problem solving

Communication

Mentoring

Education

Bachelor's degree in CS/IT/Engineering

Tools

Azure Databricks

Azure Data Factory

PySpark

Python

SQL

Delta Lake

Azure DevOps

Terraform

Job description

Capstone Logistics, LLC seeks a Senior Data Engineer to design, develop, and optimize enterprise data infrastructure focused on Azure Databricks, ADLS, and Power BI. You will translate business needs into scalable data solutions and lead technical initiatives as an individual contributor with mentorship responsibilities.

You will collaborate across teams to establish standards, drive continuous improvement, and support AI/ML data workloads while ensuring data governance and security best