Senior Data Engineer - Databricks

ACI Infotech; Atlanta (GA); Hybrid; USD 100,000 - 130,000; Full time

Job summary

A leading tech firm is hiring a Senior Data Engineer in Atlanta, GA. In this role, you'll build and optimize data platforms with Databricks, work closely with Fortune 500 companies to design data solutions, and mentor junior engineers. Ideal candidates will have over 5 years of experience in data engineering and strong expertise in tools like Databricks and Apache Spark. A hybrid work environment offers flexibility and collaboration opportunities.

Qualifications

• 5+ years of experience in data engineering.
• Strong expertise in Databricks, Apache Spark, and Delta Lake.
• Proficient in Python and SQL.

Responsibilities

• Design and implement scalable data pipelines using Databricks and Delta Lake.
• Architect lakehouse solutions for enterprise clients.
• Optimize Spark jobs for performance and cost efficiency.

Skills

Databricks

Apache Spark

Python

SQL

Data modeling

Tools

AWS

Azure

GCP

Job description

Atlanta, GA (Hybrid) Full time Senior Level

About This Role

Join our Data Engineering team to build and optimize enterprise-scale data platforms using Databricks. You'll work directly with Fortune 500 clients to design lakehouse architectures, implement Delta Lake solutions, and drive data-driven decision making across their organizations.

Responsibilities

• Design and implement scalable data pipelines using Databricks and Delta Lake
• Architect lakehouse solutions for enterprise clients
• Optimize Spark jobs for performance and cost efficiency
• Collaborate with data scientists to productionize ML models
• Mentor junior engineers and establish best practices

Requirements

• 5+ years of experience in data engineering
• Strong expertise with Databricks, Apache Spark, and Delta Lake
• Proficiency in Python and SQL
• Experience with cloud platforms (AWS, Azure, or GCP)
• Strong understanding of data modeling and ETL best practices

Nice to Have

• + Databricks certifications
• + Experience with Unity Catalog
• + Knowledge of dbt or similar transformation tools
• + Experience with real-time streaming (Kafka, Kinesis)