Data Engineer (Scala Spark)

Sedgwick; Guin (AL); On-site; USD 111,000 - 200,000; Full time

Job summary

Sedgwick is seeking a Sr. Data Engineer to design and operate scalable data pipelines across batch and real-time workloads. You’ll work with Snowflake as the core platform and help shape data models, semantic layers, and CI/CD practices for trusted data products.

You will mentor a junior data engineer and collaborate with analytics teams to mature engineering practices, supporting cloud and on-prem environments. A Bachelor’s degree and 5+ years in data engineering are expected.

Qualifications

• Bachelor’s degree in computer science, information systems, data engineering, or related field preferred.
• Five or more years of dedicated data engineering experience building production-grade data pipelines.
• Advanced Snowflake architecture knowledge, performance tuning, and data sharing.
• Experience moving data across hybrid environments (on-prem to cloud).
• Experience with semantic layers and data for AI or NLP capabilities preferred.

Responsibilities

• Designs and maintains scalable data pipelines for batch, streaming, and event-driven movement.
• Core developer for Snowflake data platform; optimize performance and data sharing.
• Architects transformation pipelines for high-quality data inputs to Snowflake and dbt AI features.
• Develops semantic layers and metadata models to support Self-Service 2.0 NLP interfaces.
• Mentors one data engineer and guides analytics teams in engineering practices.

Skills

Leadership & mentoring

Analytical thinking

Problem solving

Communication

Team collaboration

Education

Bachelor’s degree in computer science or related field

Tools

Snowflake

dbt

Azure Data Factory

Azure Functions

Stream Analytics

Python

SQL

AWS data ecosystems

Job description

By joining Sedgwick, you'll be part of something truly meaningful. It’s what our 33,000 colleagues do every day for people around the world who are facing the unexpected. We invite you to grow your career with us, experience our caring culture, and enjoy work-life balance. Here, there’s no limit to what you can achieve.

Newsweek Recognizes Sedgwick as America’s Greatest Workplaces National Top Companies

Certified as a Great Place to Work®

Fortune Best Workplaces in Financial Services & Insurance

Sr. Data Engineer ESSENTIAL FUNCTIONS AND RESPONSIBILITIES

• Designs, builds, and maintains scalable data pipelines supporting batch, real-time streaming, and event-driven data movement from on-premises and cloud sources.
• Serves as a core developer for the Snowflake data platform and supports platform performance, data modeling, and storage structures.
• Architects and builds transformation pipelines that deliver high-quality data inputs to Snowflake and dbt AI features.
• Designs and maintains semantic layers and metadata models required to support Self-Service 2.0 natural-language user interfaces.
• Establishes reference architectures, reusable templates, and CI/CD best practices that enable decentralized line-of-business teams to build data products safely and consistently.
• Provides direct management and career mentorship to one data engineer, with potential for team growth, and guides decentralized data analysts in maturing their engineering practices.
• Drives adoption of dbt for data transformation and evaluates the integration of AWS and Azure cloud data tools, including Azure Data Factory, Azure Functions, and Stream Analytics, to optimize data flow.

ADDITIONAL FUNCTIONS and RESPONSIBILITIES

• Performs other duties as assigned.
• Supports the organization’s quality program(s).
• Travels as required.

SUPERVISORY RESPONSIBILITIES

• ~ Provides direct management and career mentorship to one data engineer, with potential for the team to grow.

QUALIFICATIONS

Education & Licensing

• Bachelor’s degree in computer science, information systems, data engineering, or a related field from an accredited college or university preferred.
• Equivalent combination of education, professional certifications, and relevant work experience will be considered.

Experience

• Five (5)+ years of dedicated data engineering experience, with a proven record of building production-grade data pipelines, required.
• Advanced hands‑on experience with Snowflake architecture, performance tuning, and data sharing required.
• Experience moving data across hybrid environments, including on-premises to cloud, using batch, streaming, and event‑driven patterns required.
• Experience building or maintaining semantic layers and structuring data for downstream AI, large language model, or natural-language search capabilities preferred.

Skills & Knowledge

• Advanced knowledge of Snowflake architecture, performance tuning, data modeling, storage structures, and secure data sharing.
• Strong knowledge of scalable batch, real‑time streaming, and event‑driven data pipeline architecture.
• Experience with semantic layers, including dbt Semantic Layer and Snowflake Cortex or semantic definitions.
• Strong Python skills, particularly in cloud environments and Azure Functions used for data workloads.
• Strong SQL capabilities.
• Experience with dbt highly preferred.
• Experience with Azure data tools, including Azure Data Factory, Azure Functions, and Stream Analytics, preferred.
• Familiarity with AWS data ecosystems preferred.
• Knowledge of reference architecture, reusable pipeline patterns, templates, and CI/CD practices.
• Collaborative coaching and leadership skills, with the ability to teach, establish governance, and strengthen engineering practices across cross-functional teams.
• Strong analytical, problem‑solving, organizational, and communication skills.
• Ability to meet or exceed performance competencies.

WORK ENVIRONMENT

When applicable and appropriate, consideration will be given to reasonable accommodations.

Mental: Clear and conceptual thinking ability; excellent judgment, troubleshooting, problem solving, analysis, and discretion; ability to handle work‑related stress; ability to handle multiple priorities simultaneously; and ability to meet deadlines

Physical: Computer keyboarding, travel as required

Auditory/Visual: Hearing, vision and talking

As required by law, Sedgwick provides a reasonable range of compensation for roles that may be hired in jurisdictions requiring pay transparency in job postings. Actual compensation is influenced by a wide range of factors including but not limited to skill set, level of experience, and cost of specific location. For the jurisdiction noted in this job posting only, the range of starting pay for this role is (110,956.00 - 155,338.00 - 199,720.00 USD Annual ). A comprehensive benefits package is offered including, but not limited to, medical, dental, vision, 401k and matching, PTO, disability and life insurance, employee assistance, flexible spending or health savings account, and other additional voluntary benefits. (Include: "Always accepting applications." - If evergreen nationwide, CO or onsite in CO.)

Sedgwick is an Equal Opportunity Employer and a Drug‑Free Workplace.

If you're excited about this role but your experience doesn't align perfectly with every qualification in the job description, consider applying for it anyway! Sedgwick is building a diverse, equitable, and inclusive workplace and recognizes that each person possesses a unique combination of skills, knowledge, and experience. You may be just the right candidate for this or other roles.