Data Platform Lead — AWS, Databricks & Cloud Migration

Prodapt; Richardson (TX); On-site; USD 120,000 - 160,000; Full time

Job summary

Prodapt is seeking an experienced Data Lead to architect and modernize enterprise data platforms using AWS and Databricks. The role guides data engineers and collaborates with stakeholders to deliver scalable data solutions.

The ideal candidate has 8+ years in data engineering, strong Spark/Delta Lake expertise, and hands-on AWS skills, with Azure-to-AWS migration exposure and CI/CD/DevOps experience.

Qualifications

• 8+ years in Data Engineering or related roles.
• Bachelor's degree in a technical field.
• Strong hands-on AWS data services experience.
• Extensive Databricks, Spark, and Delta Lake experience.
• SQL and Python proficiency.
• Experience designing enterprise data pipelines.
• Knowledge of data warehouses and data lakes.
• Leadership and stakeholder management skills.
• Azure data services experience and Azure-to-AWS migration exposure.
• CI/CD, IaC, and DevOps familiarity.
• Airflow or similar orchestration tools used.

Responsibilities

• Lead design and implementation of modern data platforms on AWS and Databricks.
• Architect scalable, secure data pipelines and data lake architectures.
• Drive migration from Azure to AWS.
• Collaborate with stakeholders, architects, and engineers on data strategy.
• Mentor data engineers and enforce best practices.
• Optimize ETL/ELT processes and data models.
• Ensure data quality, governance, and performance across platforms.
• Support Agile delivery and solution design.

Skills

AWS data services

Databricks

Apache Spark

Delta Lake

SQL

Python

Data pipelines

CI/CD

IaC

DevOps

Airflow

AWS/Databricks certs

Education

Bachelor's degree in CS/IT/SE/Data Science

Tools

AWS

Databricks

Job description

Prodapt is seeking an experienced Data Lead to architect and modernize enterprise data platforms using AWS and Databricks. The role guides data engineers and collaborates with stakeholders to deliver scalable data solutions.

The ideal candidate has 8+ years in data engineering, strong Spark/Delta Lake expertise, and hands-on AWS skills, with Azure-to-AWS migration exposure and CI/CD/DevOps experience.