Lead Risk Data Engineer and Architect

Lincoln Financial Group; Radnor (Delaware County); Hybrid; USD 120,000 - 193,000; Full time

Job summary

Lincoln Financial Group seeks a Senior Data Engineer to migrate and modernize risk analytics platforms on AWS and Databricks. You will build data pipelines with Python, PySpark and SQL, and govern data with cataloging, lineage, and quality controls while collaborating with risk managers and data scientists.

This role emphasizes DevOps, CI/CD, and reliable production systems. You will also manage relational databases like MySQL, Aurora PostgreSQL and Redshift, ensuring performance and data

Qualifications

• Bachelor's degree in Computer Science, Information Systems, Engineering or related field.
• 5+ years of data engineering experience with on‑premises and cloud data management.
• Production experience with MySQL, SQL Server, and data integrity across apps.
• Strong AWS data storage/management expertise; SQL, Python, YAML and Bash are essential.
• Understanding SDLC, DevOps, CI/CD, resiliency and security practices.
• Excellent written/spoken communication for business audiences.
• Data governance experience with cataloging, lineage and quality controls is a plus.

Responsibilities

• Architect cloud‑native data solutions on AWS and Databricks to support risk analytics at scale.
• Build and optimize data pipelines using Python, PySpark, and SQL for mixed data sources.
• Migrate legacy on‑prem systems to cloud with minimal disruption to services.
• Implement data governance with cataloging, lineage, quality monitoring and access controls.
• Collaborate with data scientists and stakeholders to translate requirements into scalable tech.
• Develop production‑grade code with DevOps practices, CI/CD, automated tests, and CI toolchains.
• Manage relational databases (MySQL, Aurora PostgreSQL, Redshift) for performance and cost.
• Monitor systems, troubleshoot, and apply observability practices and tuning.

Skills

AWS S3/Redshift

Databricks

PySpark

SQL

Python

YAML

Bash

DevOps

CI/CD

Data governance

SDLC

Communication skills

AWS certifications

Education

Bachelor's degree in Computer Science / Information Systems / Engineering

Tools

MySQL

Aurora PostgreSQL

Redshift

SQL Server

Job description

Be Aware of Fraudulent Recruiting Activities: Lincoln values the privacy and security of every applicant and urges all applicants to diligently protect their sensitive personal information from scams targeting job seekers. These scams can take many forms including fake employment applications, bogus interviews and falsified offer letters.

Lincoln will not ask applicants to provide their social security numbers, date of birth, bank account information or other sensitive information in job applications. Additionally, our recruiters do not communicate with applicants through free e‑mail accounts (Gmail, Yahoo, Hotmail) or conduct interviews utilizing video chat rooms. We will never ask applicants to provide payment during the hiring process or extend an offer without conducting a phone, live video or in‑person interview. Please contact Lincoln's fraud team [e-mail] if you encounter a recruiter or see a job opportunity that seems suspicious.

Select how often (in days) to receive an alert:

Alternate Locations

Radnor, PA (Pennsylvania)

Work Arrangement

Hybrid : Employee will work 3 days a week in a Lincoln office

Relocation assistance: is not available for this opportunity.

Requisition #:76603

The Role at a Glance

You'll partner closely with risk analysts, quantitative researchers, and technology leaders to migrate business‑owned processes into robust, production‑controlled platforms while maintaining operational excellence.

What you'll be doing

• Architect cloud‑native data solutions using AWS services (S3, Redshift, Glue, EMR, Lambda, Athena) and Databricks (Unity Catalog, Workflows, MLflow) or similar technology to support risk analytics at scale.
• Build and optimize data pipelines using Python, PySpark, and SQL to integrate structured and unstructured data from internal and external sources.
• Drive modernization initiatives by migrating legacy on‑premises systems to cloud platforms while ensuring zero disruption to critical business services.
• Implement data governance frameworks including cataloging, lineage tracking, quality monitoring, and access controls aligned with internal controls and regulatory requirements.
• Collaborate cross‑functionally with data scientists, risk managers, and business stakeholders to translate requirements into scalable technical solutions, drive change management and process improvements.
• Develop production‑grade code following DevOps practices including CI/CD, automated testing, code reviews, and infrastructure‑as‑code.
• Manage and optimize relational databases (MySQL, Aurora PostgreSQL, Redshift) for performance, cost efficiency, and data integrity.
• Integrate structured and unstructured data from various internal and external sources.
• Mentor and influence technical standards and architectural decisions across the Risk, Investments Technology organization.
• Monitor and troubleshoot production systems, implementing observability practices and proactive performance tuning.

What we’re looking for

• Bachelor’s degree in Computer Science, Information Systems, Engineering or related field.
• 5+ years of experience in data engineering or similar role implementing with a variety of on‑premises and cloud data management, integration, and analytical technologies.
• Production experience with relational databases such as MySQL, and SQL Server, including designing schemas, writing complex queries, optimizing performance, and ensuring data integrity for a variety of business applications.
• Strong experience with end‑to‑end data architecture implementing systems that use AWS services related to data storage and management, must have advanced proficiency in SQL, Python, YAML and Bash.
• Thorough understanding of the Software Development Life Cycle (SDLC), including DevOps practices, CI/CD processes, application resiliency, and security measures.
• Excellent communication skills with ability to translate technical concepts for business audiences.
• Data governance experience: catalog tools, data quality frameworks, lineage tracking, and compliance controls is a plus.
• AWS certifications such as SAA, Associate Developer, Data Analytics Specialty, or Databricks certification is a plus.

Application Deadline

Applications for this position will be accepted through November 15th, 2026 subject to earlier closure due to applicant volume.

What’s it like to work here?

At Lincoln Financial, we love what we do. We make meaningful contributions each and every day to empower our customers to take charge of their lives. Working alongside dedicated and talented colleagues, we build fulfilling careers and stronger communities through a company that values our unique perspectives, insights and contributions and invests in programs that empower each of us to take charge of our own future.

What’s in it for you:

• Clearly defined career tracks and job levels, along with associated behaviors for each of Lincoln's core values andleadership attributes
• Leadership development and virtual training opportunities
• Free financial counseling, health coaching and employee assistance program
• Tuition assistance program
• Work arrangements that work for you
• Effective productivity/technology tools and training

The pay range for this position is$120,375 - $192,600with anticipated pay for new hires between the minimum and midpoint of the range and could vary above and below the listed range as permitted by applicable law. Pay is based on non‑discriminatory factors including but not limited to work experience, education, location, licensure requirements, proficiency and qualifications required for the role. The base pay is just one component of Lincoln’s total rewards package for employees. In addition, the role may be eligible for the Annual Incentive Program, which is discretionary and based on the performance of the company, business unit and individual. Other rewards may include long‑term incentives, sales incentives and Lincoln’s standard benefits package.

About The Company

Lincoln Financial (NYSE: LNC) helps people to confidently plan for their version of a successful future. We focus on identifying a clear path to financial security, with products including annuities, life insurance, group protection, and retirement plan services.

With our 120‑year track record of expertise and integrity, millions of customers trust our solutions and service to help put their goals in reach.

Lincoln Financial Distributors, a broker‑dealer, is the wholesale distribution organization of Lincoln Financial. Lincoln Financial is the marketing name for Lincoln Financial Corporation and its affiliates including The Lincoln National Life Insurance Company, Fort Wayne, IN, and Lincoln Life & Annuity Company of New York, Syracuse, NY. Lincoln Financial affiliates, their distributors, and their respective employees, representatives and/or insurance agents do not provide tax, accounting or legal advice.

Lincoln is committed to creating an inclusive environment and is proud to be an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status.

Lincoln Financial ("Lincoln" or "the Company") is an Equal Opportunity employer and, as such, is committed in policy and practice to recruit, hire, compensate, train and promote, in all job classifications, without regard to race, color, religion, sex, age, national origin or disability. Opportunities throughout Lincoln are available to employees and applicants are evaluated on the basis of job qualifications. If you are a person with a disability that impedes your ability to express your interest for a position through our online application process, or require TTY/TDD assistance, contact us by calling [phone].

Any unsolicited resumes or candidate profiles submitted through our web site or to personal e‑mail accounts of employees of Lincoln Financial are considered property of Lincoln Financial and are not subject to payment of agency fees.

This Employer Participates in E‑Verify. See the E‑Verify notices.