Lead Data Engineer - AWS Data Pipelines & Analytics

Lincoln National; Radnor (Delaware County); On-site; USD 120,000 - 193,000; Full time

Benefits offered by this job

PTO and parental leave

401(k) and comprehensive benefits

Tuition assistance program

Employee assistance program

Job summary

Lincoln Financial seeks a Lead Software Engineer to provide technical leadership for the Data Strategy and Delivery team. You will design, build, and maintain scalable data pipelines on AWS, optimize Aurora PostgreSQL and Redshift, and mentor a team of data engineers to deliver high-quality datasets for analytics and reporting.

You will own end-to-end data flows, integrate diverse data sources, and collaborate with data scientists, analysts and business partners to advance data governance,

Qualifications

• Bachelor's degree or equivalent in a related field.
• 7+ years in AWS data engineering or similar role (Lead level).
• Proven leadership: leading a team, owning delivery of complex projects, and communicating clearly with stakeholders.
• Strong expertise in Aurora PostgreSQL and Redshift including analysis, tuning, and advanced SQL.
• End-to-end data processing with source-to-consumption view and dependencies.
• Hands-on AWS: Glue, Lambda, S3, Athena, EC2, and IAM.
• Python / PySpark and SQL development for ETL and integration.
• DevOps and scheduling: Git, CI/CD, automated testing, CloudFormation, Stonebranch (or similar).
• Hands-on use of AI tools (GitHub Copilot or Claude Code) with Lincoln privacy rules.

Responsibilities

• Lead and prioritize work, own delivery, set standards and technical vision.
• Review code, mentor engineers, and grow future leaders.
• Design, build, and maintain robust batch and streaming data pipelines.
• Integrate structured and unstructured data from various sources.
• Develop ETL workflows using AWS Glue, Lambda, PySpark, and SQL scripts.
• Analyze workloads and optimize queries and storage for performance and cost.
• Build S3-based data lake and warehouse layers with proper access controls.
• Own end-to-end data flows from source to consumption and resolve issues.
• Apply data modeling standards and data quality practices.
• Orchestrate workflows with Stonebranch, Step Functions, Airflow/MWAA.
• Ensure data security, governance, and compliance; collaborate with stakeholders on data infrastructure strategy on AWS.

Skills

Leadership

AWS data eng

Aurora PostgreSQL

Amazon Redshift

Python / PySpark

SQL development

ETL design

Agile / SDLC

Git / CI/CD

CloudWatch / data ops

Education

Bachelor's degree in Computer Science, Information Systems, Engineering, or related field

Tools

AWS Glue

AWS Lambda

AWS S3

AWS Athena

AWS EC2

IAM

Airflow / MWAA

Stonebranch

Job description

Lincoln Financial seeks a Lead Software Engineer to provide technical leadership for the Data Strategy and Delivery team. You will design, build, and maintain scalable data pipelines on AWS, optimize Aurora PostgreSQL and Redshift, and mentor a team of data engineers to deliver high-quality datasets for analytics and reporting.

You will own end-to-end data flows, integrate diverse data sources, and collaborate with data scientists, analysts and business partners to advance data governance,