Senior Data Architect

CRC Group; Charlotte (NC); On-site; USD 110,000 - 150,000; Full time

Benefits offered by this job

Health and dental insurance

401(k) plan with company match

Generous paid time off programs

Job summary

A leading specialty insurance firm in Charlotte, NC, seeks an experienced Senior Data Architect to design scalable data architectures utilizing Databricks. The ideal candidate will have over 7 years of experience in data engineering and a strong background in insurance data models. Responsibilities include leading ETL/ELT pipeline design and collaborating with various teams to optimize data strategies. This role offers a comprehensive benefits package including health insurance and retirement plans.

Qualifications

• 7+ years of experience in data architecture or data engineering.
• Experience with insurance data models such as policy and claims.
• Strong understanding of modern data lakehouse architecture.

Responsibilities

• Design and implement enterprise data architecture leveraging Databricks.
• Lead the design of ETL/ELT pipelines using PySpark.
• Collaborate with business leaders to align architecture with goals.

Skills

Databricks

SQL

PySpark

Data Architecture

Stakeholder Management

Education

Bachelor’s or master’s degree in computer science

Tools

Delta Lake

Azure

Power BI

Job description

Senior Data Architect page is loaded## Senior Data Architectlocations: Charlotte, NCtime type: Full timeposted on: Posted Todayjob requisition id: R0000001792**The position is described below. If you want to apply, click the Apply button at the top or bottom of this page. You'll be required to create an account or sign in to an existing one.****If you have a disability and need assistance with the application, you can request a reasonable accommodation. Send an email to** Accessibility **(accommodation requests only; other inquiries won't receive a response).****Regular or Temporary:**Regular**Language Fluency:** English (Required)**Work Shift:**1st Shift (United States of America)**Please review the following job description:**We are seeking an experienced Data Architect with deep expertise in Databricks and a strong understanding of the insurance industry. The ideal candidate will design and implement scalable data architectures that support advanced analytics, reporting, and AI/BI/ML initiatives across Broking, Binding, underwriting, claims, actuarial, and policy management functions.**Key Responsibilities:****Data Architecture & Strategy*** Design and implement enterprise data architecture leveraging **Databricks Lakehouse**, Delta Lake, and Azure cloud-native services* Define data integration, modeling, and governance frameworks tailored for **insurance data domains** such as agency, carrier, policy, claims, Invoicing & billing, and reinsurance.* Create scalable and secure data pipelines that handle structured and unstructured data from internal and external sources.* Author and maintain technological roadmap with mappings to business capabilities* Experiment and establish adoption blueprint for emerging capabilities within Databrick and in data technology* Secure the data with appropriate NIST cyber controls**Data Engineering & Analytics Enablement*** Lead the design of ETL/ELT pipelines using PySpark, SQL, Delta Live Tables, Lakeflow connect, Autoloader, Lake flow declarative pipelines, DBT, and Databricks Workflows.* Partner with actuarial, underwriting, and BI teams to design semantic layers and analytics-ready datasets.* Optimize performance and cost of Databricks clusters and workflows.* Enable machine learning and predictive analytics by providing clean, governed, and feature-rich data sets.**Governance & Quality*** Review solution developed by the divisional teams and vendors to ensure the solution uses modern technology, built to scale, has resilience, and is cost effective to operate.* Implement data quality, lineage, and metadata management frameworks using tools like Unity Catalog, Collibra, or Alation.* Establish and enforce data security and compliance policies aligned with insurance regulations (e.g., NAIC, Privacy, HIPAA, GDPR, CFIUS).* Ensure consistency of master data across operational and analytical systems.**Collaboration & Leadership*** Collaborate with business leaders, data engineers, divisional data teams, data visualization experts, and platform head to align architecture with organizational goals.* Mentor teams on best practices for data modeling, Databricks optimization, and cloud data architecture.* Evaluate new technologies to continuously improve data strategy and capabilities.**Required Qualifications:*** Bachelor’s or master’s degree in computer science, Data Engineering, Information Systems, or related field.* 7+ years of experience in data architecture or data engineering, with at least 4 years in Databricks.* Strong experience with insurance data models, including policy, claims, premium, fees, agency, underwriting, accounting, and insured domains.* Expertise in cloud platforms (AWS, Azure, or GCP) and modern data lakehouse architecture.* Proficiency in SQL, PySpark, Delta Lake, and Databricks SQL.* Experience integrating with BI tools (Power BI, Tableau, Looker) and data governance tools.* Excellent communication and stakeholder management skills.**Preferred Skills:*** Experience with streaming data frameworks (Kafka, Delta Live Tables).* Familiarity with AI/ML pipelines in Databricks.* Certification(s): + Databricks Certified Data Engineer Professional + Azure/AWS Certified Data Architect + Insurance Data Management Association (IDMA) certifications**General Description of Available Benefits for Eligible Employees of CRC Group:** At CRC Group, we're committed to supporting every aspect of teammates' well-being – physical, emotional, financial, social, and professional. Our best-in-class benefits program is designed to care for the whole you, offering a wide range of coverage and support. Eligible full-time teammates enjoy access to medical, dental, vision, life, disability, and AD&D insurance; tax-advantaged savings accounts; and a 401(k) plan with company match. CRC Group also offers generous paid time off programs, including company holidays, vacation and sick days, new parent leave, and more. Eligible positions may also qualify for restricted stock units and/or a deferred compensation plan.***CRC Group supports a diverse workforce and is an Equal Opportunity Employer that does not discriminate against individuals on the basis of race, gender, color, religion, citizenship or national origin, age, sexual orientation, gender identity, disability, veteran status or other classification protected by law. CRC Group is a Drug Free Workplace.***Join CRC Group, a leader in specialty wholesale insurance, and take your career to new heights. We're a dynamic team dedicated to innovation, collaboration, and excellence.• Growth: Advance your career with our learning and leadership development programs. • Innovation: Work in a forward-thinking environment that values new ideas. • Community: Be part of a supportive team that celebrates success together. • Benefits: Enjoy competitive compensation, health benefits, and retirement plans.Who We’re Looking For We seek passionate individuals who thrive in a fast-paced, collaborative environment. If you value integrity and are driven to succeed, CRC Group is the place for you.