Databricks Architect: Lead Data Platform Engineer

Rapid Eagle Inc; Atlanta (GA); On-site; USD 150,000 - 210,000; Full time

Benefits offered by this job

401(k) matching

Dental insurance

Health insurance

Job summary

Rapid Eagle Inc. is seeking a Databricks Architect in Atlanta, onsite, to design and optimize enterprise-level data lakehouse architectures. You will build pipelines with Apache Spark and Delta Lake, collaborating with engineers and analysts to align technical requirements with business goals.

The role requires 5+ years in data architecture/engineering, strong Python/Scala/SQL skills, and hands-on cloud experience across AWS, Azure, or GCP. Certification is a plus and mentorship is valued.

Qualifications

• 5+ years of experience in data architecture, data engineering, or a related field.
• Hands-on expertise with Databricks, Apache Spark, and Delta Lake.
• Proficiency in Python, Scala, or SQL for large-scale data processing.
• Experience with cloud platforms such as AWS, Microsoft Azure, or Google Cloud Platform.
• Strong understanding of data lakehouse, data warehouse, and ETL/ELT design patterns.
• Databricks Certified Associate or Professional certification is a plus.
• Excellent communication skills with the ability to translate complex technical concepts to stakeholders.

Responsibilities

• Design, build, and optimize enterprise-scale Databricks and data lakehouse architectures.
• Develop and maintain data pipelines using Apache Spark, Delta Lake, and related technologies.
• Collaborate with data engineers, analysts, and business stakeholders to define technical requirements.
• Establish best practices for data governance, security, and performance tuning within Databricks.
• Lead cloud data platform integrations across AWS, Azure, or GCP environments.
• Provide technical guidance and mentorship to junior data engineering team members.
• Monitor, troubleshoot, and continuously improve platform reliability and efficiency.

Skills

Leadership

Mentorship

Communication

Data architecture

ETL/ELT design

Cloud concepts

Tools

Databricks

Apache Spark

Delta Lake

Python

Scala

SQL

AWS

Azure

GCP

Job description

Rapid Eagle Inc. is seeking a Databricks Architect in Atlanta, onsite, to design and optimize enterprise-level data lakehouse architectures. You will build pipelines with Apache Spark and Delta Lake, collaborating with engineers and analysts to align technical requirements with business goals.

The role requires 5+ years in data architecture/engineering, strong Python/Scala/SQL skills, and hands-on cloud experience across AWS, Azure, or GCP. Certification is a plus and mentorship is valued.