Principal Databricks Architect

Reinsurance Group of America, Incorporated

Kentucky

On-site

USD 127,000 - 189,000

Full time

Just now
Be an early applicant
Application generator

Stand out for this role — generate a tailored resume and cover letter in about a minute.

Get past ATS filters

Job summary

RGA seeks a Principal Databricks Architect to shape and scale its Databricks-based data science and AI platform, leading governance, self-service capabilities, and production-ready features for actuarial, data science, and analytics teams.

The role focuses on platform modernization with Unity Catalog, Snowflake interoperability, and end-to-end ModelOps, while guiding teams across regions to ensure scalable, cost-efficient deployments and responsible AI practices.

Qualifications

  • Bachelor’s Degree in Arts/Sciences (BA/BS) Computer Science or equivalent education and experience - Required
  • 10+ years progressive experience in enterprise-level IT functions - Required
  • 7+ years experience in managing large enterprise data initiatives and teams - Required
  • 5+ years architecting and operating enterprise-grade data and AI/ML platforms, with hands-on Databricks and Apache Spark experience on a major cloud (AWS preferred; Azure or GCP). - Required
  • Modern Databricks Expertise—Unity Catalog, Delta Lake/Iceberg, Lakeflow/Delta Live Tables, MLflow, Model Serving, AI Agent Framework/Agent Bricks, Lakebase, Genie
  • Data Science Enablement—self-service platform capabilities and developer experiences with ModelOps lifecycle
  • Consulting & Communication—stakeholder management and adoption of tech by leadership
  • Innovation & Initiative—drive technology transformations
  • Thought Leadership—architecture vision and roadmaps
  • Interoperability Experience—Databricks with Snowflake and open standards
  • Availability for cross-time-zone meetings

Responsibilities

  • Platform Vision & Architecture: Define end-to-end Databricks architecture across a global topology.
  • Governance & Compliance: Lead Unity Catalog governance with least-privileged access and data sovereignty compliance.
  • Interoperability & Data Integration: Architect Databricks-Snowflake integration using Iceberg and federation.
  • Data Science Enablement & Self-Service: Create frameworks and templates for independent model development and deployment.
  • ModelOps & Agent Operations: Mature model lifecycle governance and deployment via MLflow and AI Agent Framework.
  • Performance, Observability & FinOps: Optimize compute, cost, and operational visibility.
  • Consulting, Enablement & Innovation: Lead workshops and community of practice to propagate best practices.
  • Team Building & Mentorship: Grow cross-functional teams and upskill members.

Skills

Databricks expertise
Data science enablement
Consulting & communication
Innovation & initiative
Thought leadership
Continuous improvement
Platform-as-a-Product
Interoperability with Snowflake
Cross-timezone availability

Education

BA/BS Computer Science or equivalent
10+ years enterprise IT experience
7+ years large data initiatives leadership
5+ years architecting data/AI platforms

Job description

RGA ready

RGA is a purpose-driven organization working to solve today’s challenges through innovation and collaboration. A Fortune 200 Company and listed among its

You desire impactful work.

You’re RGA ready

RGA is a purpose-driven organization working to solve today’s challenges through innovation and collaboration. A Fortune 200 Company and listed among its World’s Most Admired Companies, we’re the only global reinsurance company to focus primarily on life- and health-related solutions. Join our multinational team of intelligent, motivated, and collaborative people, and help us make financial protection accessible to all.

The Principal Databricks Architect will shape and scale our Databricks-based data science and AI platform, and to lead where our practice is heading a governed, self-service environment that lets data science teams move from idea to production with minimal friction. As the technical leader of the platform, this individual brings design thinking to mature the platform as a product—designing reusable capabilities, patterns, and guardrails that empower actuarial, data science, and analytics teams to independently develop, train, deploy, and operate models and AI agents. The ideal candidate pairs deep architectural expertise with a strong enablement mindset, engaging directly with diverse data science communities to understand their workflows and remove barriers to adoption. They will modernize our platform around the latest Databricks capabilities—Unity Catalog governance, Mosaic AI and Agent Bricks, Genie, Lakeflow, and Lakebase—while ensuring interoperability with our Snowflake enterprise data platform through open formats such as Apache Iceberg. This is a highly visible role that sets technical direction, champions frictionless developer experience, enforces least-privileged access and data governance, and enables global, cost-efficient deployment of AI in compliance with data sovereignty requirements.

Principle Duties
  • Platform Vision & ArchitectureDefine and champion the end-to-end architecture for the Databricks data science and AI platform across a global topology — ensuring scalability, security, cost efficiency, resilience, and compliance with regional data sovereignty laws. Establish reference architectures, patterns, and blueprints that encourage enterprise-wide reuse and standardization.
  • Governance & ComplianceLead the design and adoption of Unity Catalog as the central governance plane—defining catalog hierarchies, fine-grained (row/column) access, dynamic data masking, lineage, and classification. Partner with infrastructure, security, and compliance teams to enforce least-privileged access, responsible AI, and regulatory requirements including data sovereignty across US, EMEA, and APAC.
  • Interoperability & Data IntegrationArchitect robust, low-duplication integration between Databricks and the enterprise data platform (Snowflake) using open formats such as Apache Iceberg and Unity Catalog federation. Enable seamless bi-directional data access and feature sharing so teams can choose the right tool without paying a tax to deploy across environments.
  • Data Science Enablement & Self-ServicePartner directly with actuarial, data science, and analytics teams to understand their workflows and build frameworks, templates, IDE/notebook experiences, and documentation that let them independently develop, train, and deploy models and AI agents.
  • ModelOps & Agent Operations Mature the ModelOps strategy spanning model lifecycle, governance, versioning, and deployment at scale using MLflow, Model Serving, and the AI Agent Framework.
  • Performance, Observability & FinOpsOptimize compute, clusters, and jobs (classic and serverless) for performance, reliability, and cost. Establish platform and solution-level observability, tagging coverage, chargeback/show back, and self-service cost and usage analytics so teams can consume responsibly with predictable spend.
  • Consulting, Enablement & InnovationServe as a trusted advisor and enablement partner to data science and business teams—running discovery workshops, proofs-of-concept, and technology evaluations. Curate a community of practice, promote sanctioned patterns, and continuously bring contemporary Databricks best practices to complex data and AI challenges.
  • Team Building & MentorshipMentor and upskill team members, promote knowledge sharing, and build high-performing, cross-functional teams focused on excellence in data and AI.
Education
  • Bachelor’s Degree in Arts/Sciences (BA/BS) Computer Science or equivalent education and experience - Required
Work Experience
  • 10+ years progressive experience in enterprise-level IT functions - Required
  • 7+ years experience in managing large enterprise data initiatives and teams - Required
  • 5+ years architecting and operating enterprise-grade data and AI/ML platforms, with hands-on Databricks and Apache Spark experience on a major cloud (AWS preferred; Azure or GCP). - Required
Skills And Abilities
  • Modern Databricks ExpertiseDeep knowledge of the Databricks Data Intelligence Platform—Unity Catalog, Delta Lake/Iceberg, Lakeflow/Delta Live Tables, MLflow, Model Serving, AI Agent Framework/Agent Bricks, Lakebase, and Genie—plus lakehouse architecture, ETL/ELT, and infrastructure-as-code (Terraform, Databricks Asset Bundles). - Required
  • Data Science EnablementDemonstrated success building self-service platform capabilities and developer experiences that empower data science teams, along with a ModelOps track record covering lifecycle management, versioning, governance, and deployment automation. - Required
  • Consulting & CommunicationStrong consulting, stakeholder management, and communication skills, with a track record of influencing senior leadership and driving technology adoption. - Required
  • Innovation & InitiativeDemonstrated ability to drive innovation, introduce contemporary practices, and lead technology transformations. - Required
  • Thought LeadershipAbility to define and communicate architecture vision, roadmaps, and best practices to both technical and non-technical audiences. - Preferred
  • Continuous ImprovementPassion for learning, sharing knowledge, and staying ahead of industry trends in data and AI. - Preferred
  • Platform-as-a-Product MindsetPassion for delivering frictionless, self-service experiences and measurable business value—treating internal data science teams as customers and continuously improving their journey from prototype to production. - Preferred
  • Interoperability ExperienceFamiliarity integrating Databricks with Snowflake and other engines via open standards (Apache Iceberg, Unity Catalog/Lakehouse federation) to minimize data duplication and governance gaps. - Preferred
  • Availability for cross-time-zone meetings. - Preferred
What you can expect from RGA
  • Gain valuable knowledge from and experience with diverse, caring colleagues around the world.
  • Enjoy a respectful, welcoming environment that fosters individuality and encourages pioneering thought.
  • Join the bright and creative minds of RGA, and experience vast, endless career potential.

We’re excited to get to know you and connect your unique skills with our global opportunities. To create a modern and seamless experience, we use artificial intelligence (AI) in parts of our preliminary screening process. This technology helps us personalize job recommendations, automate interview scheduling, evaluate candidates based solely on experience—without considering name, gender, or other personal details—and provide real-time answers through our chatbot. AI is used only during early screening and never makes hiring decisions. Your RGA recruiter will work closely with you every step of the way to ensure the process feels personal, thoughtful, and focused on you.

Compensation Range

$126,710.00 - $188,840.00 Annual

Base pay varies depending on job-related knowledge, skills, experience and market location. In addition, RGA provides an annual bonus plan that includes all roles and some positions are eligible for participation in our long-term equity incentive plan. RGA also maintains a full range of health, retirement, and other employee benefits.

RGA is an equal opportunity employer. Qualified applicants will be considered without regard to race, color, age, gender identity or expression, sex, disability, veteran status, religion, national origin, or any other characteristic protected by applicable equal employment opportunity laws.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Executive Director, Data Governance Lead
Executive Director, Data Governance Lead

RGA • Chesterfield (MO)

Remote
USD 127,000 - 189,000
Lead Software Engineer
Lead Software Engineer

RGA • Town of Florida (NY)

Hybrid
USD 107,000 - 159,000
Senior Software Engineering Architect — Investment Technologies
Senior Software Engineering Architect — Investment Technologies

Reinsurance Group of America, Incorporated • Missouri

On-site
USD 151,000 - 225,000
Lead Software Engineer
Lead Software Engineer

Reinsurance Group of America, Incorporated • Town of Florida (NY)

On-site
USD 107,000 - 159,000
Senior Engineer, Cloud Services
Senior Engineer, Cloud Services

Reinsurance Group of America, Incorporated • St. Louis (MO)

On-site
USD 107,000 - 159,000
SVP, Chief Operating Officer Global Finance
SVP, Chief Operating Officer Global Finance

Reinsurance Group of America, Incorporated • Chesterfield (MO)

On-site
USD 324,000 - 480,000
Lead IT Automation Engineer
Lead IT Automation Engineer

Reinsurance Group of America, Incorporated • St. Louis (MO)

On-site
USD 107,000 - 159,000
Senior Engineer, Cloud Services
Senior Engineer, Cloud Services

RGA • Creve Coeur (MO)

On-site
USD 107,000 - 159,000
Annual bonus plan
Equity incentive plan
Health benefits
+1
Senior Software Engineering Architect — Investment Technologies
Senior Software Engineering Architect — Investment Technologies

RGA • Missouri

Remote
USD 151,000 - 225,000
Health benefits
Retirement plan
Annual bonus and equity incentives
Director, Software Engineering Manager
Director, Software Engineering Manager

Reinsurance Group of America, Incorporated • St. Louis (MO)

On-site
USD 107,000 - 159,000