Lead Data Engineer, AWS Data Platform (Hybrid)

Lincoln National; Radnor (Delaware County); Hybrid; USD 120,000 - 193,000; Full time

Benefits offered by this job

PTO / parental leave

401K and benefits

Tuition assistance

Job summary

Lincoln Financial is seeking a Lead Data Engineer to drive the Data & Analytics platform on AWS. You will design, build, and maintain scalable data pipelines, focusing on Aurora PostgreSQL and Redshift, while aligning with governance and security standards.

You will mentor engineers, own end-to-end data flows, and collaborate with data scientists, analysts, and business stakeholders to deliver high-quality datasets for analytics and reporting in a hybrid work arrangement.

Qualifications

• Bachelor’s degree in Computer Science, Information Systems, Engineering, or related field.
• 7+ years in AWS data engineering or similar role.
• Expertise in Aurora PostgreSQL and Amazon Redshift; advanced SQL and workload tuning.
• End-to-end data processing understanding from source to consumption.
• Data integration with upstream/downstream systems (APIs, files, messaging).
• Hands-on AWS: Glue, Lambda, S3, Athena, EC2, IAM.
• Python / PySpark and SQL development for ETL in Agile environments.
• Data governance, quality, and security practices.
• DevOps and scheduling: Git, CI/CD, and Stonebranch or similar.

Responsibilities

• Design, build, and maintain robust batch and streaming data pipelines.
• Integrate structured and unstructured data from internal/external sources.
• Develop ETL workflows using AWS Glue, Lambda, PySpark, and SQL scripts.
• Analyze workloads and optimize queries in Aurora PostgreSQL and Redshift.
• Build S3-based data lake/warehouse layers with fine-grained access controls.
• Own end-to-end data flows; monitor, trace, and resolve issues.
• Apply data modeling standards and create technical designs from business requirements.
• Orchestrate workflows with Stonebranch, Step Functions, or Airflow; monitor with CloudWatch.
• Ensure data security, governance, and compliance; collaborate with stakeholders.
• Mentor engineers; contribute to production support and process improvements.

Skills

AWS data engineering

Aurora PostgreSQL

Redshift

PySpark

SQL optimization

ETL development

Data modeling

Data governance

CloudFormation

Stonebranch

AI tool usage

Education

Bachelor’s degree in Computer Science / Information Systems / Engineering

Tools

Glue

Lambda

S3

Athena

EC2

IAM

Airflow

Step Functions

CloudWatch

Job description

Lincoln Financial is seeking a Lead Data Engineer to drive the Data & Analytics platform on AWS. You will design, build, and maintain scalable data pipelines, focusing on Aurora PostgreSQL and Redshift, while aligning with governance and security standards.

You will mentor engineers, own end-to-end data flows, and collaborate with data scientists, analysts, and business stakeholders to deliver high-quality datasets for analytics and reporting in a hybrid work arrangement.