Senior Databricks Lakehouse Architect on AWS

Robotics Technologies LLC; Atlanta (GA); Presencial; USD 140.000 - 210.000; Jornada completa

Descripción de la vacante

Robotics Technologies LLC is seeking a highly experienced Databricks Architect to design, develop, and optimize enterprise-scale Databricks solutions on AWS. The role requires hands-on expertise spanning Lakehouse architecture, Delta Lake, Unity Catalog, Apache Spark, and Databricks Workflows.

You will lead data platform initiatives, build scalable pipelines, and collaborate with data engineering, cloud, and architecture teams to deliver high-performance, secure data architectures.

Formación

• Must have extensive hands-on Databricks development and architecture experience.
• Must have strong Databricks Lakehouse, Delta Lake, and PySpark expertise.
• Must have experience architecting and implementing enterprise-scale Databricks solutions on AWS.

Responsabilidades

• Design end-to-end Databricks Lakehouse architecture on AWS.
• Build and optimize scalable data pipelines with Databricks and Spark.
• Develop ETL/ELT workflows using PySpark and Spark SQL.
• Implement Delta Lake architecture with Delta Tables and Delta Live Tables.
• Design Unity Catalog for centralized data governance and access control.
• Optimize Spark jobs, cluster configs, partitioning, caching, and performance.
• Implement Databricks Workflows for orchestration and scheduling.
• Develop scalable batch and streaming data processing solutions.
• Implement Medallion Architecture (Bronze/Silver/Gold).
• Integrate Databricks with AWS S3, IAM, Glue and other data services.
• Establish best practices for data quality, reliability, monitoring, and performance.
• Lead Databricks platform architecture, design, and implementation.

Conocimientos

Databricks on AWS

Spark PySpark

Lakehouse Architecture

Delta Lake

Unity Catalog

Databricks Workflows

ETL/ELT pipelines

Batch & streaming processing

Python

SQL

Herramientas

Delta Live Tables

Lakeflow Declarative Pipelines

Descripción del empleo

Robotics Technologies LLC is seeking a highly experienced Databricks Architect to design, develop, and optimize enterprise-scale Databricks solutions on AWS. The role requires hands-on expertise spanning Lakehouse architecture, Delta Lake, Unity Catalog, Apache Spark, and Databricks Workflows.

You will lead data platform initiatives, build scalable pipelines, and collaborate with data engineering, cloud, and architecture teams to deliver high-performance, secure data architectures.