Senior Data Platform Architect - Azure Databricks

Mogi I/O : OTT/Podcast/Short Video Apps for you; Dunwoody (GA); On-site; USD 82,000 - 123,000; Full time

Benefits offered by this job

Medical, dental, vision insurance

Paid vacation, sick leave, holidays

Employer‑matched 401(k)

Life and Disability Insurance

Job summary

A leading tech company in Georgia is seeking a Senior/Lead Data Engineer with at least 8 years of experience in building scalable data platforms. This role involves architecting and implementing solutions on Azure and Databricks, optimizing data ingestion processes, and mentoring junior engineers. Candidates should possess strong experience with data engineering, cloud-native architectures, and ETL processes. A comprehensive benefits package is offered, including health insurance and a 401(k) plan.

Qualifications

• 8+ years of enterprise data engineering experience.
• Strong hands-on experience with Azure Databricks and Apache Spark (PySpark).
• Expertise in ETL/ELT and cloud-native architecture.

Responsibilities

• Architect and implement scalable data platforms on Azure and Databricks.
• Build and optimize batch & real-time data ingestion.
• Develop robust ETL/ELT workflows ensuring reliability.

Skills

Azure Databricks

Apache Spark (PySpark)

SQL & performance tuning

ETL/ELT

data modeling

streaming frameworks (Kafka, Event Hub)

CI/CD using Azure DevOps

IaC tools (Terraform/ARM)

Job description

A leading tech company in Georgia is seeking a Senior/Lead Data Engineer with at least 8 years of experience in building scalable data platforms. This role involves architecting and implementing solutions on Azure and Databricks, optimizing data ingestion processes, and mentoring junior engineers. Candidates should possess strong experience with data engineering, cloud-native architectures, and ETL processes. A comprehensive benefits package is offered, including health insurance and a 401(k) plan.