Senior Risk Data Engineer & Cloud Architect

Lincoln Financial Group; Radnor (Delaware County); Hybrid; USD 120,000 - 193,000; Full time

Job summary

Lincoln Financial Group seeks a Senior Data Engineer to migrate and modernize risk analytics platforms on AWS and Databricks. You will build data pipelines with Python, PySpark and SQL, and govern data with cataloging, lineage, and quality controls while collaborating with risk managers and data scientists.

This role emphasizes DevOps, CI/CD, and reliable production systems. You will also manage relational databases like MySQL, Aurora PostgreSQL and Redshift, ensuring performance and data

Qualifications

• Bachelor's degree in Computer Science, Information Systems, Engineering or related field.
• 5+ years of data engineering experience with on‑premises and cloud data management.
• Production experience with MySQL, SQL Server, and data integrity across apps.
• Strong AWS data storage/management expertise; SQL, Python, YAML and Bash are essential.
• Understanding SDLC, DevOps, CI/CD, resiliency and security practices.
• Excellent written/spoken communication for business audiences.
• Data governance experience with cataloging, lineage and quality controls is a plus.

Responsibilities

• Architect cloud‑native data solutions on AWS and Databricks to support risk analytics at scale.
• Build and optimize data pipelines using Python, PySpark, and SQL for mixed data sources.
• Migrate legacy on‑prem systems to cloud with minimal disruption to services.
• Implement data governance with cataloging, lineage, quality monitoring and access controls.
• Collaborate with data scientists and stakeholders to translate requirements into scalable tech.
• Develop production‑grade code with DevOps practices, CI/CD, automated tests, and CI toolchains.
• Manage relational databases (MySQL, Aurora PostgreSQL, Redshift) for performance and cost.
• Monitor systems, troubleshoot, and apply observability practices and tuning.

Skills

AWS S3/Redshift

Databricks

PySpark

SQL

Python

YAML

Bash

DevOps

CI/CD

Data governance

SDLC

Communication skills

AWS certifications

Education

Bachelor's degree in Computer Science / Information Systems / Engineering

Tools

MySQL

Aurora PostgreSQL

Redshift

SQL Server

Job description

Lincoln Financial Group seeks a Senior Data Engineer to migrate and modernize risk analytics platforms on AWS and Databricks. You will build data pipelines with Python, PySpark and SQL, and govern data with cataloging, lineage, and quality controls while collaborating with risk managers and data scientists.

This role emphasizes DevOps, CI/CD, and reliable production systems. You will also manage relational databases like MySQL, Aurora PostgreSQL and Redshift, ensuring performance and data