Lead AWS Data Engineer – Lakehouse & Real-Time Pipelines

Cognizant Technology Solutions Corporation

Providence (RI)

On-site

USD 133,000 - 157,000

Full time

3 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Medical/Dental/Vision/Life Insurance
Paid holidays plus PTO
401(k) plan and contributions
Disability (Long-term/Short-term)

Job summary

Cognizant Technology Solutions Corporation seeks a Lead AWS Data Engineer to design, build, and optimize enterprise-scale cloud data platforms on AWS. You will develop high-performance data pipelines with PySpark, AWS Glue, S3, Lake Formation, Athena, Iceberg, Redshift, and Aurora, combining hands-on engineering with cloud-native architecture and GitHub-based practices.

The role requires technical leadership across data processing, governance, performance optimization, and production-grade data

Qualifications

  • 8+ years of experience in Data Engineering, Big Data Engineering, Cloud Data Platforms, or enterprise data architecture.
  • Expert hands-on experience with PySpark, AWS Glue, Amazon S3, AWS Lake Formation, Amazon Athena, and Apache Iceberg.
  • Strong experience with Amazon Redshift, including data modeling, query optimization, workload management, and performance tuning.
  • Hands-on experience with Amazon Aurora and strong knowledge of SQL, relational data modeling, and database integration patterns.
  • Strong Python development skills and experience building scalable ETL/ELT and data processing frameworks on AWS.
  • Strong experience with GitHub, including branching strategies, pull requests, code reviews, source control, and CI/CD integration.
  • Working knowledge of AWS Lambda, EMR, Kinesis, Kafka, and real-time or event-driven data processing architectures.
  • Experience with Terraform, CloudFormation, or AWS CDK for Infrastructure as Code and automated cloud deployments.
  • Strong understanding of data governance, metadata, lineage, data quality, IAM, security, and cloud cost optimization.
  • Experience with AWS VPC, IAM/SSO, KMS, networking, containers, and cloud-native architecture is desirable.

Responsibilities

  • Design and develop scalable batch and streaming data pipelines using AWS Glue, PySpark, S3, and cloud-native data services.
  • Build modern lakehouse architectures leveraging Amazon S3, AWS Lake Formation, Apache Iceberg, Athena, and Redshift.
  • Develop data ingestion, transformation, and processing frameworks using PySpark, Glue, Lambda, EMR, Kinesis, and related AWS services.
  • Design and optimize analytical and transactional data solutions using Redshift and Amazon Aurora, ensuring performance, scalability, and cost efficiency.
  • Implement data governance capabilities including access controls, metadata management, lineage, data quality, and secure data sharing through Lake Formation.
  • Develop serverless data processing and integration components using AWS Lambda, APIs, EventBridge, SQS, and SNS where applicable.
  • Establish CI/CD and Infrastructure-as-Code practices using GitHub, Terraform, CloudFormation, or AWS CDK for repeatable data platform deployments.
  • Implement GitHub branching, pull request, code review, testing, and release management standards across engineering teams.
  • Monitor and optimize data pipelines, storage, queries, and compute resources to improve reliability, performance, and FinOps outcomes.
  • Collaborate with architects, analysts, application teams, and business stakeholders while providing technical guidance and mentoring to data engineers.

Skills

Strong Python development
Data engineering
Cloud data platforms
Leadership/Mentoring
Data governance
FinOps

Tools

PySpark
AWS Glue
Amazon S3
AWS Lake Formation
Amazon Athena
Apache Iceberg
Redshift
Amazon Aurora
SQL
Python
GitHub
CI/CD
Terraform
CloudFormation
AWS CDK
AWS Lambda
EMR
Kinesis
Kafka
KMS

Job description

Cognizant Technology Solutions Corporation seeks a Lead AWS Data Engineer to design, build, and optimize enterprise-scale cloud data platforms on AWS. You will develop high-performance data pipelines with PySpark, AWS Glue, S3, Lake Formation, Athena, Iceberg, Redshift, and Aurora, combining hands-on engineering with cloud-native architecture and GitHub-based practices.

The role requires technical leadership across data processing, governance, performance optimization, and production-grade data

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AWS Data Engineer - Lakehouse & Pipelines
Senior AWS Data Engineer - Lakehouse & Pipelines

Cognizant Technology Solutions Corporation • Charlotte (NC)

On-site
USD 133,000 - 157,000
Medical/Dental/Vision/Life Insurance
Paid holidays plus Paid Time Off
401(k) plan and contributions
+3
Lead AWS Data Engineer: Lakehouse & Data Pipelines
Lead AWS Data Engineer: Lakehouse & Data Pipelines

Cognizant Technology Solutions Corporation • Nashville (TN)

On-site
USD 133,000 - 157,000
Medical/Dental/Vision/Life Insurance
Paid holidays/PTO
401(k) plan
+3
Remote Cloud Data Engineer — AWS Databricks Lakehouse
Remote Cloud Data Engineer — AWS Databricks Lakehouse

Cognizant • Norfolk (VA)

Remote
USD 83,000 - 95,000
Medical/Dental/Vision/Life Insurance
Paid holidays plus PTO
401(k) plan and contributions
+3
Lead AWS Data Engineer
Lead AWS Data Engineer

Cognizant Technology Solutions Corporation • Charlotte (NC)

On-site
USD 133,000 - 157,000
Medical/Dental/Vision/Life Insurance
Paid holidays plus Paid Time Off
401(k) plan and contributions
+3
Senior AWS Data Engineer: Lakehouse & AI-Driven Pipelines
Senior AWS Data Engineer: Lakehouse & AI-Driven Pipelines

Global Business Ser. 4u Inc. • New York (NY)

On-site
USD 140,000 - 190,000
Lead AWS Data Engineer
Lead AWS Data Engineer

Cognizant Technology Solutions Corporation • Providence (RI)

On-site
USD 133,000 - 157,000
Medical/Dental/Vision/Life Insurance
Paid holidays plus PTO
401(k) plan and contributions
+1
Lead AWS Data Engineer
Lead AWS Data Engineer

Cognizant Technology Solutions Corporation • Nashville (TN)

On-site
USD 133,000 - 157,000
Medical/Dental/Vision/Life Insurance
Paid holidays/PTO
401(k) plan
+3
Remote AI Data Engineer - AWS Data Pipelines & AI Apps
Remote AI Data Engineer - AWS Data Pipelines & AI Apps

Cognizant Technology Solutions Corporation • Richmond (VA)

Remote
USD 100,000 - 115,000
Medical/Dental/Vision/Life Insurance
Paid holidays + Paid Time Off
401(k) plan and contributions
+3
Remote Senior Data Engineer: AWS Lakehouse & Pipelines
Remote Senior Data Engineer: AWS Lakehouse & Pipelines

safeguardglobal • United States

Remote
USD 120,000 - 180,000
Flexible scheduling
Paid family bonding leave
Two paid charitable days
+3
Remote AI Data Engineer — Python, AWS & Data Pipelines
Remote AI Data Engineer — Python, AWS & Data Pipelines

Cognizant Technology Solutions Corporation • Columbus (GA)

Remote
USD 100,000 - 115,000
Medical/Dental/Vision/Life Insurance
401(k) plan and contributions
Parental Leave
+1