Senior Data Architect

100 CRC Insurance Group, LLC; Charlotte (NC); On-site; USD 150,000 - 210,000; Full time

Benefits offered by this job

Health insurance

Dental insurance

Vision insurance

Life insurance

Disability insurance

AD&D

401(k) with company match

Paid time off

Job summary

CRC Group is seeking an experienced Data Architect to lead enterprise data architecture initiatives using Databricks Lakehouse, Delta Lake, and Azure services. You will define data integration and governance across agency, carrier, policy, claims, and underwriting domains, building scalable pipelines for analytics-ready datasets.

The role requires 7+ years in data architecture or data engineering, with at least 4 years in Databricks, and strong insurance data model experience.

Qualifications

• 7+ years of experience in data architecture or data engineering.
• 4+ years in Databricks.
• Strong experience with insurance data models (policy, claims, underwriting, etc).
• Proficiency in cloud platforms (AWS/Azure/GCP) and modern data lakehouse architectures.
• SQL, PySpark, Delta Lake, and Databricks SQL expertise.
• Experience integrating with BI tools and data governance solutions.

Responsibilities

• Data Architecture & Strategy: design and implement enterprise data architecture using Databricks Lakehouse, Delta Lake, and Azure services.
• Define data integration, modeling, and governance for insurance data domains.
• Create scalable data pipelines for structured and unstructured data.
• Lead technological roadmap alignment with business capabilities.
• Enable AI/ML analytics with clean, governed data sets.
• Collaborate with actuarial, underwriting, and BI teams for analytics-ready datasets.
• Optimize Databricks performance and cost.

Skills

Communication

Stakeholder management

Leadership

Data architecture

Databricks

PySpark

SQL

Delta Lake

Azure cloud

Insurance data models

Education

Bachelor’s or Master’s degree in Computer Science/Data Engineering/Information Systems or related field

Tools

Databricks

Delta Lake

Azure

DBT

Databricks SQL

Lakehouse

Job description

Regular or Temporary: Regular Language Fluency: English (Required) Work Shift: 1st Shift (United States of America)

We are seeking an experienced Data Architect with deep expertise in Databricks and a strong understanding of the insurance industry. The ideal candidate will design and implement scalable data architectures that support advanced analytics, reporting, and AI/BI/ML initiatives across Broking, Binding, underwriting, claims, actuarial, and policy management functions.

Key Responsibilities

• Data Architecture & Strategy Design and implement enterprise data architecture leveraging Databricks Lakehouse, Delta Lake, and Azure cloud-native services
• Define data integration, modeling, and governance frameworks tailored for insurance data domains such as agency, carrier, policy, claims, Invoicing & billing, and reinsurance.
• Create scalable and secure data pipelines that handle structured and unstructured data from internal and external sources.
• Author and maintain technological roadmap with mappings to business capabilities
• Experiment and establish adoption blueprint for emerging capabilities within Databrick and in data technology
• Secure the data with appropriate NIST cyber controls
• Data Engineering & Analytics Enablement Lead the design of ETL/ELT pipelines using PySpark, SQL, Delta Live Tables, Lakeflow connect, Autoloader, Lake flow declarative pipelines, DBT, and Databricks Workflows.
• Partner with actuarial, underwriting, and BI teams to design semantic layers and analytics-ready datasets.
• Optimize performance and cost of Databricks clusters and workflows.
• Enable machine learning and predictive analytics by providing clean, governed, and feature-rich data sets.
• Governance & Quality Review solution developed by the divisional teams and vendors to ensure the solution uses modern technology, built to scale, has resilience, and is cost effective to operate.
• Implement data quality, lineage, and metadata management frameworks using tools like Unity Catalog, Collibra, or Alation.
• Establish and enforce data security and compliance policies aligned with insurance regulations (e.g., NAIC, Privacy, HIPAA, GDPR, CFIUS).
• Ensure consistency of master data across operational and analytical systems.
• Collaboration & Leadership Collaborate with business leaders, data engineers, divisional data teams, data visualization experts, and platform head to align architecture with organizational goals.
• Mentor teams on best practices for data modeling, Databricks optimization, and cloud data architecture.
• Evaluate new technologies to continuously improve data strategy and capabilities.

Required Qualifications

• Bachelor’s or master’s degree in computer science, Data Engineering, Information Systems, or related field.
• 7+ years of experience in data architecture or data engineering, with at least 4 years in Databricks.
• Strong experience with insurance data models, including policy, claims, premium, fees, agency, underwriting, accounting, and insured domains.
• Expertise in cloud platforms (AWS, Azure, or GCP) and modern data lakehouse architecture.
• Proficiency in SQL, PySpark, Delta Lake, and Databricks SQL.
• Experience integrating with BI tools (Power BI, Tableau, Looker) and data governance tools.
• Excellent communication and stakeholder management skills.

Preferred Skills

• Experience with streaming data frameworks (Kafka, Delta Live Tables).
• Familiarity with AI/ML pipelines in Databricks.

Certification(s)

• Databricks Certified Data Engineer Professional
• Azure/AWS Certified Data Architect
• Insurance Data Management Association (IDMA) certifications

General Description of Available Benefits for Eligible Employees of CRC Group

Eligible full-time teammates enjoy access to medical, dental, vision, life, disability, and AD&D insurance; tax-advantaged savings accounts; and a 401(k) plan with company match. CRC Group also offers generous paid time off programs, including company holidays, vacation and sick days, new parent leave, and more. Eligible positions may also qualify for restricted stock units and/or a deferred compensation plan.

CRC Group supports a diverse workforce and is an Equal Opportunity Employer that does not discriminate against individuals on the basis of race, gender, color, religion, citizenship or national origin, age, sexual orientation, gender identity, disability, veteran status or other classification protected by law.

CRC Group is a Drug Free Workplace.

Pay Transparency Nondiscrimination Provision E-Verify

We're a dynamic team dedicated to innovation, collaboration, and excellence.

Why CRC Group?

• Growth: Advance your career with our learning and leadership development programs.
• Innovation: Work in a forward-thinking environment that values new ideas.
• Community: Be part of a supportive team that celebrates success together.
• Benefits: Enjoy competitive compensation, health benefits, and retirement plans.

Who We’re Looking For

We seek passionate individuals who thrive in a fast-paced, collaborative environment. If you value integrity and are driven to succeed, CRC Group is the place for you.