Data Platform Engineering Manager — Databricks & AI

Markel; Richmond (VA); On-site; USD 109,000 - 227,000; Full time

Benefits offered by this job

Health insurance

Dental insurance

Vision insurance

Life insurance

Disability insurance

AD&D insurance

401(k) with match

Employee Stock Purchase Plan

PTO and holidays

Parental leave

Job summary

Markel is seeking an experienced Data Engineering Manager in the United States to lead multiple teams in designing, building, and delivering data platform components using Databricks across Raw, Refined, and Presentation layers. The role drives strategic goals, tracks delivery, and mentors staff to raise engineering excellence.

You will guide performance reviews, recruitment, and priority setting while balancing short-term needs with long-term architecture and data strategy.

Qualifications

• 8 to 10 years of software development, infrastructure, or project delivery experience, including data engineering or data platform work.
• Experience with agile software development methodologies.
• Hands-on experience with Databricks.
• Experience implementing or working within a medallion architecture (Raw, Refined, Presentation layers).
• Practical experience applying AI or machine learning technologies within a data engineering or data platform context.
• Knowledge of ETL tools and best practices in design.
• Experience managing multiple teams strongly preferred.
• Providing coaching and mentoring to team members.
• Capable of balancing immediate operational needs while making progress towards long-term engineering goals.
• Insurance industry background nice to have.

Responsibilities

• Contributes to strategic, operational, and divisional goals as a member of the management team.
• Tracks team delivery, provides project update/information, and informs management of any deviations which may impact the delivery.
• Plans and conducts performance appraisals for employees, and administers disciplinary action.
• Initiates discussions around raises, bonuses, and promotions within team.
• Involved with recruitment, development, retention, and organization of all managed staff in accordance with corporate budgetary and policy requirements, including offshore resources.
• Defines team operating standards and ensures essential procedures are followed at all times.
• Trains, coaches, and mentors employees on the team.
• Identify and measure team health indicators.
• Ensure proper team focus on priorities, milestones, and deliverables.
• Responsible for tracking and reporting key metrics and status updates to senior management.
• Represent the Data Engineering team(s) to stakeholders, customers, and internal delivery teams.
• Lead the design, build, and delivery of data platform components using Databricks and a medallion architecture across Raw, Refined, and Presentation layers.
• Manage one or more teams as assigned, balancing workload and priorities across teams.
• Occasionally required to work late evenings and weekends as needed.

Skills

Databricks

Medallion architecture

AI / ML in data eng.

Data engineering fundamentals

Leadership

Agile methodologies

Communication

Stakeholder collaboration

Education

Bachelor's degree in Computer Science, Information Systems, or related field

Job description

Markel is seeking an experienced Data Engineering Manager in the United States to lead multiple teams in designing, building, and delivering data platform components using Databricks across Raw, Refined, and Presentation layers. The role drives strategic goals, tracks delivery, and mentors staff to raise engineering excellence.

You will guide performance reviews, recruitment, and priority setting while balancing short-term needs with long-term architecture and data strategy.