Lead Data Architect – Databricks Migration

Prodapt; Dallas (TX); On-site; USD 180,000 - 240,000; Full time

Job summary

Prodapt is seeking a hands-on Technical Architect to lead enterprise-scale migrations to the Databricks Lakehouse in Dallas, TX. This builder and technical leadership role owns architecture, migration strategy, deployment, performance and key technology decisions while collaborating with customer stakeholders and engineering teams.

You’ll design Lakehouse architectures with Delta Lake, Unity Catalog, Databricks SQL, Workflows and DLT, assess Palantir Foundry and legacy platforms, drive cloud

Qualifications

• 12+ years in data engineering or data warehousing/architecture
• 5+ years hands-on Databricks experience
• Strong PySpark, Spark SQL, Python and SQL skills
• Deep knowledge of Delta Lake, Unity Catalog, Databricks Workflows/DLT and Databricks SQL
• Experience migrating from Teradata, Oracle, Netezza, SQL Server, Hadoop/Cloudera or Informatica
• Experience with AWS, Azure or GCP and modern DevOps practices

Responsibilities

• Lead end-to-end enterprise migrations to Databricks, including architecture, migration strategy, cutover and validation.
• Design Lakehouse architectures using Delta Lake, Unity Catalog, Databricks SQL, Workflows and DLT.
• Analyze Palantir Foundry and legacy data platforms and define migration strategies to Databricks.
• Make technology decisions across data engineering, governance, security, performance and cloud.
• Design CI/CD using Databricks Asset Bundles, Git and Terraform.
• Drive Spark performance, scalability and DBU cost optimization.
• Translate business requirements into technical solutions and work directly with US customer stakeholders.
• Mentor and guide data engineers through architecture and code reviews.

Job description

Prodapt is the largest and fastest-growing specialized player in the Connectedness industry, recognized by Gartner as a Large, Telecom-Native, Regional IT Service Provider across North America, Europe and Latin America. With its singular focus on the domain, Prodapt has built deep expertise in the most transformative technologies that connect our world. Prodapt is a trusted partner for enterprises across all layers of the Connectedness vertical. Prodapt designs, configures, and operates solutions across their digital landscape, network infrastructure, and business operations – and craft experiences that delight their customers. Today, Prodapt’s clients connect 1.1 billion people and 5.4 billion devices, and are among the largest telecom, media, and internet firms in the world. Prodapt works with Google, Amazon, Verizon, Vodafone, Liberty Global, Liberty Latin America, Claro, Lumen, Windstream, Rogers, Telus, KPN, Virgin Media, British Telecom, Deutsche Telekom, Adtran, Samsung, and many more. A “Great Place To Work® Certified™” company, Prodapt employs over 6,000 technology and domain experts in 30+ countries across North America, Latin America, Europe, Africa, and Asia. Prodapt is part of the 130-year-old business conglomerate The Jhaver Group, which employs over 30,000 people across 80+ locations globally.

We’re looking for a hands-on Technical Architect to lead enterprise-scale migrations to the Databricks Lakehouse in Dallas, TX. This is a builder and technical leadership role — you’ll own architecture, design, migration strategy, deployment, performance, and key technology decisions while working directly with customer stakeholders and engineering teams.

What You’ll Do

• Lead end-to-end enterprise migrations to Databricks, including architecture, migration strategy, cutover and validation.
• Design Lakehouse architectures using Delta Lake, Unity Catalog, Databricks SQL, Workflows and DLT.
• Analyze existing Palantir Foundry and legacy data platforms and define migration strategies to Databricks.
• Make technology decisions across data engineering, governance, security, performance and cloud.
• Design CI/CD using Databricks Asset Bundles, Git and Terraform.
• Drive Spark performance, scalability and DBU cost optimization.
• Translate business requirements into technical solutions and work directly with US customer stakeholders.
• Mentor and guide data engineers through architecture and code reviews.

What We’re Looking For

• 12+ years in data engineering, data architecture or data warehousing.
• Bachelor's degree in Computer Science, Engineering, Information Technology or related discipline.
• 5+ years of hands-on Databricks experience.
• Proven experience leading at least one large-scale enterprise Databricks migration.
• Strong PySpark, Spark SQL, Python and SQL skills.
• Deep knowledge of Delta Lake, Unity Catalog, Databricks Workflows/DLT and Databricks SQL.
• Experience migrating from platforms such as Teradata, Oracle, Netezza, SQL Server, Hadoop/Cloudera or Informatica.
• Strong architecture, stakeholder management, communication and technical leadership skills.
• Experience with AWS, Azure or GCP and modern DevOps practices.

Nice to Have

• Certifications: Databricks Certified Data Engineer Professional, Databricks Solutions Architect Champion, or cloud architect certifications
• Snowflake experience
• Pre-sales and solution design experience
• AI/ML and GenAI experience on Databricks