Data Platform IT Manager — Databricks & AI

Markel Corporation; Richmond (VA); On-site; USD 109,000 - 227,000; Full time

Benefits offered by this job

Health insurance

Dental insurance

Vision insurance

401(k) with employer match

Employee Stock Purchase Plan

Job summary

Markel Corporation in the United States (Richmond, VA) seeks an experienced Senior Data Engineering Manager to lead multiple teams. You will guide design, build, and delivery of data platform components using Databricks within a medallion architecture across Raw, Refined, and Presentation layers.

The role requires 8–10 years in data engineering or related fields, strong leadership, and hands-on Databricks experience. Insurance industry background is a plus; remote work options are not specified.

Qualifications

• 8–10 years of software development, data engineering, or project delivery.
• Experience with agile software development methodologies.
• Hands-on Databricks experience.
• Experience with medallion architecture (Raw, Refined, Presentation).
• Practical experience applying AI/ML within data platforms.
• Knowledge of ETL tools and best practices.
• Experience managing multiple teams is preferred.
• Coaching and mentoring to staff.

Responsibilities

• Contributes to strategic, operational, and divisional goals as a management team member.
• Tracks team delivery, provides updates, and flags deviations affecting delivery.
• Plans performance appraisals and handles disciplinary actions.
• Drives discussions on raises, bonuses, and promotions within the team.
• Oversees recruitment, development, retention, and organization of staff including offshore resources.
• Defines team operating standards and ensures adherence to procedures.
• Trains, coaches, and mentors team members.
• Measures team health indicators and prioritizes milestones and deliverables.
• Reports key metrics to senior management and represents the Data Engineering teams to stakeholders.

Skills

Team leadership

Data engineering

Databricks

Medallion architecture

AI / ML in data

ETL best practices

Agile methodologies

Performance management

Communication

Mentoring

Education

Bachelor's degree in Computer Science, Information Systems, or related field

Tools

Databricks

Job description

Markel Corporation in the United States (Richmond, VA) seeks an experienced Senior Data Engineering Manager to lead multiple teams. You will guide design, build, and delivery of data platform components using Databricks within a medallion architecture across Raw, Refined, and Presentation layers.

The role requires 8–10 years in data engineering or related fields, strong leadership, and hands-on Databricks experience. Insurance industry background is a plus; remote work options are not specified.