Data Engineering Lead

LatentView Analytics; Atlanta (GA); On-site; USD 140,000 - 210,000; Full time

Job summary

LatentView Analytics is seeking a Databricks Platform Architect to design and implement scalable Lakehouse architectures across cloud environments. You will define standards for ingestion, governance, security, and performance, and lead migration and modernization initiatives using Databricks on Azure.

You will provide technical leadership for AI/ML and Enterprise AI projects, mentor teams, and ensure delivery aligns with enterprise architecture standards.

Qualifications

• Design and implement enterprise-scale Databricks Lakehouse architectures and platform capabilities.
• Define architecture standards for data ingestion, transformation, governance, security, and performance.
• Lead cloud migration and data modernization initiatives leveraging Databricks on Azure.

Responsibilities

• Design and implement enterprise-scale Databricks Lakehouse architectures and platform capabilities.
• Define architecture standards for data ingestion, transformation, governance, security, and performance optimization.
• Lead cloud migration and data modernization initiatives leveraging Databricks on Azure.
• Enable AI/ML, MLOps, and Enterprise AI solutions using Databricks native services and best practices.
• Mentor engineering teams, perform architecture reviews, and collaborate with stakeholders to ensure successful project delivery.
• Lead and coordinate offshore delivery teams, ensuring effective collaboration, timely execution, and adherence to project quality, schedule, and architectural standards.

Skills

Databricks Lakehouse

Lakehouse Architecture

Data Engineering

MLOps

Enterprise AI

Unity Catalog

Delta Lake

Multi-Cloud (Azure AWS GCP)

Job description

LatentView Analytics is a leading global analytics and decision sciences provider, delivering solutions that help companies drive digital transformation and use data to gain a competitive advantage. With analytics solutions that provide a 360-degree view of the digital consumer, fuel machine learning capabilities and support artificial intelligence initiatives., LatentView Analytics enables leading global brands to predict new revenue streams, anticipate product trends and popularity, improve customer retention rates, optimize investment decisions, and turn unstructured data into valuable business assets.

Please note: Visa sponsorship will not be provided for this opportunity

Job Role

Lead the design and implementation of scalable, secure, and high-performance Databricks Lakehouse platforms across cloud environments. Define enterprise data architecture, modernization strategies, and best practices for data engineering, analytics, AI/ML, and governance. Collaborate with business and technical stakeholders to translate requirements into scalable platform solutions. Drive cloud migration and platform optimization initiatives while ensuring alignment with enterprise architecture standards. Provide technical leadership and guidance throughout the project lifecycle.

Responsibilities

• Design and implement enterprise-scale Databricks Lakehouse architectures and platform capabilities.
• Define architecture standards for data ingestion, transformation, governance, security, and performance optimization.
• Lead cloud migration and data modernization initiatives leveraging Databricks on Azure.
• Enable AI/ML, MLOps, and Enterprise AI solutions using Databricks native services and best practices.
• Mentor engineering teams, perform architecture reviews, and collaborate with stakeholders to ensure successful project delivery.
• Lead and coordinate offshore delivery teams, ensuring effective collaboration, timely execution, and adherence to project quality, schedule, and architectural standards.

Required Skills

Databricks Platform Architect specializing in Lakehouse Architecture, Data Engineering, MLOps, Enterprise AI, Unity Catalog, Delta Lake, and Multi-Cloud (Azure, AWS, GCP) implementations.

At LatentView Analytics, we value a diverse, inclusive workforce and provide equal employment opportunities for all applicants and employees. All qualified applicants for employment will be considered without regard to an individual's race, color, sex, gender identity, gender expression, religion, age, national origin or ancestry, citizenship, physical or mental disability, medical condition, family care status, marital status, domestic partner status, sexual orientation, genetic information, military or veteran status, or any other basis protected by federal, state or local laws.