DT Lead, Commercial Data Engineering & Data Products

UCB; Atlanta (GA); Hybrid; USD 148,000 - 194,000; Full time

Job summary

UCB seeks a DT Lead, Commercial Data Engineering & Data Products in Atlanta, GA, to define and drive the strategy, delivery, and operation of U.S. Commercial data assets on the NextGen platform.

You will own data product lifecycles, establish standards for quality, contracts, lineage, and observability, and enable scalable Azure & Databricks solutions across reporting, analytics, and AI. You will lead a team and partner with stakeholders to ensure trusted, compliant data assets, reusable data

Qualifications

• Bachelor's degree in Computer Science, Engineering, Information Systems, Mathematics, Data Engineering, or a related field, or equivalent practical experience.
• 10+ years of progressive data engineering or cloud data platform experience, including technical leadership of complex enterprise delivery and operations.
• Prior experience in pharmaceuticals, life sciences, healthcare, or another regulated industry.
• Prior experience across commercial data domains such as claims, HCP/customer, payer, patient services, specialty pharmacy, omnichannel, territory, or master data.
• Hands-on experience with Azure and Databricks (or AWS/ Google Cloud), including Python, SQL, Spark, Delta Lake or lakehouse patterns, orchestration, performance tuning, and production troubleshooting
• Experience delivering trusted data products for Power BI/Fabric, advanced analytics, machine learning, RAG, copilots, or agent-enabled applications.
• Experience designing scalable ETL/ELT pipelines, metadata-driven ingestion, reusable transformation frameworks, and automated data-quality controls.
• Demonstrated data product experience, including product definition, ownership, consumer alignment, data contracts, quality and service measures, roadmap management, adoption, and lifecycle decisions.
• Experience with Unity Catalog or comparable governance capabilities, including access controls, metadata, lineage, classification, and environment promotion.
• Experience with Git-based development, CI/CD, release controls, automated testing, observability, and incident management.
• Working knowledge of AI/ML and GenAI data requirements, including features, RAG or vector data, model and agent integration, telemetry, security, and supportability.
• Experience leading engineers and third-party partners and communicating technical risks and tradeoffs to business and senior stakeholders.

Responsibilities

• Own the lifecycle of Commercial data products from onboarding through retirement.
• Define product ownership, consumer needs, data contracts, quality standards, service levels, and roadmaps.
• Drive adoption of certified, reusable data products across reporting, analytics, AI, and business teams.
• Lead the Commercial Data Engineering team responsible for data onboarding, integration, transformation, publishing, and production support.
• Define engineering standards across the NextGen platform, including architecture, data quality, lineage, security, testing, and operational readiness.
• Deliver scalable Azure and Databricks solutions using modern engineering practices, automation, and reusable frameworks.
• Establish enterprise-aligned semantic models, reusable business definitions, and certified metrics that support analytics, reporting, and AI solutions.
• Ensure interoperability between Databricks, Fabric, Snowflake, Power BI, and future enterprise platforms.
• Serve as the technology lead for Commercial data domains including customer, HCP/HCO, claims, payer, specialty pharmacy, patient services, omnichannel, territory, and master data.
• Partner with business stakeholders, Data Management, Data Governance, and external vendors to ensure trusted, compliant, and fit-for-purpose commercial data assets.
• Oversee onboarding, lifecycle management, quality, and operational support of internal and third-party commercial data sources.
• Drive standardization and reuse of commercial data assets and data products across Reporting, Analytics, AI, and Commercial Operations teams.
• Ensure the reliability, performance, observability, and cost efficiency of Commercial data products and pipelines.
• Lead incident, problem, change, and release management while driving automation and continuous improvement.
• Establish support models, operational runbooks, service-level expectations, and build-to-run governance.
• Enable trusted data products for Machine Learning, RAG, Databricks Genie, copilots, agents, and future AI capabilities.
• Partner with AI and Data Science teams to support feature engineering, retrieval pipelines, model inputs, and operational requirements.
• Ensure AI solutions leverage governed, secure, traceable, and high-quality data assets.
• Lead internal teams and delivery partners while building long-term organizational capability.
• Own the Commercial Data Engineering and Data Product roadmap, balancing business priorities, platform modernization, reliability, and future AI enablement.

Skills

Azure Databricks

Python

SQL

Spark

Delta Lake

Orchestration

CI/CD

Observability

Production troubleshooting

Education

Bachelor's degree in Computer Science, Engineering, Information Systems, Mathematics, Data Engineering, or a related field

Tools

Unity Catalog

Git

Power BI

Fabric

Databricks

Job description

UCB seeks a DT Lead, Commercial Data Engineering & Data Products in Atlanta, GA, to define and drive the strategy, delivery, and operation of U.S. Commercial data assets on the NextGen platform.

You will own data product lifecycles, establish standards for quality, contracts, lineage, and observability, and enable scalable Azure & Databricks solutions across reporting, analytics, and AI. You will lead a team and partner with stakeholders to ensure trusted, compliant data assets, reusable data