Azure Databricks Data Platform Lead

Mogi I/O : OTT/Podcast/Short Video Apps for you; Decatur (GA); On-site; USD 82,000 - 123,000; Full time

Benefits offered by this job

Medical, dental, vision insurance

Paid vacation, sick leave, holidays

Employer-matched 401(k)

Life and disability insurance

Job summary

A leading software development company in Decatur, Georgia is seeking a Senior/Lead Data Engineer with at least 8 years of experience in data engineering. The role requires expertise in Azure and Databricks, along with strong skills in data modeling and performance tuning. Responsibilities include architecting scalable data platforms and collaborating with teams to create technical solutions. The position offers comprehensive benefits including health insurance and a 401(k) plan.

Qualifications

• 8+ years of enterprise data engineering experience.
• Strong hands-on experience with Azure Databricks and performance tuning.
• Experience with data modeling and streaming frameworks.

Responsibilities

• Architect and implement scalable data platforms on Azure and Databricks.
• Build and optimize batch & real-time data ingestion and transformation.
• Collaborate with cross-functional teams to convert requirements.

Skills

Azure Databricks

Apache Spark (PySpark)

Data modeling

SQL

Performance tuning

Tools

Azure Functions

Terraform

CI/CD using Azure DevOps

Job description

A leading software development company in Decatur, Georgia is seeking a Senior/Lead Data Engineer with at least 8 years of experience in data engineering. The role requires expertise in Azure and Databricks, along with strong skills in data modeling and performance tuning. Responsibilities include architecting scalable data platforms and collaborating with teams to create technical solutions. The position offers comprehensive benefits including health insurance and a 401(k) plan.