Databricks Lakehouse Architect (AWS Data Platforms)

Newt Global; Irving (TX); On-site; USD 120,000 - 180,000; Full time

Job summary

Newt Global seeks a highly skilled Databricks Engineer with AWS expertise to design, develop, and optimize enterprise-scale data platforms, pipelines, and analytics solutions. You will collaborate with data architects, application teams, business stakeholders, and platform engineering to deliver scalable, secure, and high-performance data solutions.

You will design and maintain scalable pipelines using Databricks, PySpark, and Delta Lake, build lakehouse solutions on AWS, and implement CI/CD

Qualifications

• Proficient in designing scalable data pipelines with Databricks and PySpark.
• Strong knowledge of data lakehouse architectures on AWS.
• Experience with data modeling, data quality, and CI/CD for data platforms.
• Familiarity with batch and real-time data processing and performance tuning.

Responsibilities

• Design, develop, and maintain scalable data pipelines using Databricks, PySpark, Spark SQL, and Delta Lake.
• Build and support enterprise data lake and Lakehouse solutions on AWS.
• Develop ingestion pipelines from multiple sources (batch and streaming).
• Implement data transformation, enrichment, cleansing, and validation processes.

Skills

PySpark

Python

SQL

Data Modeling

Data Quality

Batch & RealTime Processing

Data Warehousing Concepts

ETL/ELT Design

Education

Bachelor's or Master's in Computer Science / Engineering / Information Systems

AWS Certified Data Analytics or AWS Solution Architect (Preferred)

Tools

Databricks

Databricks Lakehouse Architecture

Databricks Workflows

Unity Catalog

Databricks SQL

Auto Loader

Structured Streaming

Terraform

AWS

Amazon S3

AWS Glue

AWS Lambda

AWS IAM

Amazon Redshift

AWS CloudWatch

EventBridge

KMS

Secrets Manager

Job description

Newt Global seeks a highly skilled Databricks Engineer with AWS expertise to design, develop, and optimize enterprise-scale data platforms, pipelines, and analytics solutions. You will collaborate with data architects, application teams, business stakeholders, and platform engineering to deliver scalable, secure, and high-performance data solutions.

You will design and maintain scalable pipelines using Databricks, PySpark, and Delta Lake, build lakehouse solutions on AWS, and implement CI/CD