Lead AWS Data Engineer

Cognizant Technology Solutions Corporation

Providence (RI)

On-site

USD 133,000 - 157,000

Full time

2 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Medical/Dental/Vision/Life Insurance
Paid holidays plus PTO
401(k) plan and contributions
Disability (Long-term/Short-term)

Job summary

Cognizant Technology Solutions Corporation seeks a Lead AWS Data Engineer to design, build, and optimize enterprise-scale cloud data platforms on AWS. You will develop high-performance data pipelines with PySpark, AWS Glue, S3, Lake Formation, Athena, Iceberg, Redshift, and Aurora, combining hands-on engineering with cloud-native architecture and GitHub-based practices.

The role requires technical leadership across data processing, governance, performance optimization, and production-grade data

Qualifications

  • 8+ years of experience in Data Engineering, Big Data Engineering, Cloud Data Platforms, or enterprise data architecture.
  • Expert hands-on experience with PySpark, AWS Glue, Amazon S3, AWS Lake Formation, Amazon Athena, and Apache Iceberg.
  • Strong experience with Amazon Redshift, including data modeling, query optimization, workload management, and performance tuning.
  • Hands-on experience with Amazon Aurora and strong knowledge of SQL, relational data modeling, and database integration patterns.
  • Strong Python development skills and experience building scalable ETL/ELT and data processing frameworks on AWS.
  • Strong experience with GitHub, including branching strategies, pull requests, code reviews, source control, and CI/CD integration.
  • Working knowledge of AWS Lambda, EMR, Kinesis, Kafka, and real-time or event-driven data processing architectures.
  • Experience with Terraform, CloudFormation, or AWS CDK for Infrastructure as Code and automated cloud deployments.
  • Strong understanding of data governance, metadata, lineage, data quality, IAM, security, and cloud cost optimization.
  • Experience with AWS VPC, IAM/SSO, KMS, networking, containers, and cloud-native architecture is desirable.

Responsibilities

  • Design and develop scalable batch and streaming data pipelines using AWS Glue, PySpark, S3, and cloud-native data services.
  • Build modern lakehouse architectures leveraging Amazon S3, AWS Lake Formation, Apache Iceberg, Athena, and Redshift.
  • Develop data ingestion, transformation, and processing frameworks using PySpark, Glue, Lambda, EMR, Kinesis, and related AWS services.
  • Design and optimize analytical and transactional data solutions using Redshift and Amazon Aurora, ensuring performance, scalability, and cost efficiency.
  • Implement data governance capabilities including access controls, metadata management, lineage, data quality, and secure data sharing through Lake Formation.
  • Develop serverless data processing and integration components using AWS Lambda, APIs, EventBridge, SQS, and SNS where applicable.
  • Establish CI/CD and Infrastructure-as-Code practices using GitHub, Terraform, CloudFormation, or AWS CDK for repeatable data platform deployments.
  • Implement GitHub branching, pull request, code review, testing, and release management standards across engineering teams.
  • Monitor and optimize data pipelines, storage, queries, and compute resources to improve reliability, performance, and FinOps outcomes.
  • Collaborate with architects, analysts, application teams, and business stakeholders while providing technical guidance and mentoring to data engineers.

Skills

Strong Python development
Data engineering
Cloud data platforms
Leadership/Mentoring
Data governance
FinOps

Tools

PySpark
AWS Glue
Amazon S3
AWS Lake Formation
Amazon Athena
Apache Iceberg
Redshift
Amazon Aurora
SQL
Python
GitHub
CI/CD
Terraform
CloudFormation
AWS CDK
AWS Lambda
EMR
Kinesis
Kafka
KMS

Job description

About AI & Analytics:

Artificial intelligence (AI) and the data it collects and analyzes will soon sit at the core of all intelligent, human-centric businesses. By decoding customer needs, preferences, and behaviors, our clients can understand exactly what services, products, and experiences their consumers need. Within AI & Analytics, we work to design the future—a future in which trial-and-error business decisions have been replaced by informed choices and data-supported strategies.

By applying AI and data science, we help leading companies to prototype, refine, validate, and scale their AI and analytics products and delivery models. Cognizant’s AIA practice takes insights that are buried in data and provides businesses a clear way to transform how they source, interpret and consume their information. Our clients need flexible data structures and a streamlined data architecture that quickly turns data resources into informative, meaningful intelligence.

Job Summary

We are seeking a Lead AWS Data Engineer to design, build, and optimize enterprise-scale cloud data platforms and lakehouse solutions on AWS. This role will focus on developing high-performance data pipelines using PySpark, AWS Glue, S3, Lake Formation, Athena, Apache Iceberg, Redshift, and Aurora. The ideal candidate will combine strong hands- on data engineering expertise with cloud-native architecture, automation, and GitHub-based engineering practices. The position requires technical leadership across data processing, governance, performance optimization, and production-grade data platform delivery.

In this role, you will:
  • Design and develop scalable batch and streaming data pipelines using AWS Glue, PySpark, S3, and cloud-native data services.
  • Build modern lakehouse architectures leveraging Amazon S3, AWS Lake Formation, Apache Iceberg, Athena, and Redshift.
  • Develop data ingestion, transformation, and processing frameworks using PySpark, Glue, Lambda, EMR, Kinesis, and related AWS services.
  • Design and optimize analytical and transactional data solutions using Redshift and Amazon Aurora, ensuring performance, scalability, and cost efficiency.
  • Implement data governance capabilities including access controls, metadata management, lineage, data quality, and secure data sharing through Lake Formation.
  • Develop serverless data processing and integration components using AWS Lambda, APIs, EventBridge, SQS, and SNS where applicable.
  • Establish CI/CD and Infrastructure-as-Code practices using GitHub, Terraform, CloudFormation, or AWS CDK for repeatable data platform deployments.
  • Implement GitHub branching, pull request, code review, testing, and release management standards across engineering teams.
  • Monitor and optimize data pipelines, storage, queries, and compute resources to improve reliability, performance, and FinOps outcomes.
  • Collaborate with architects, analysts, application teams, and business stakeholders while providing technical guidance and mentoring to data engineers.
What you need to have to be considered
  • 8+ years of experience in Data Engineering, Big Data Engineering, Cloud Data Platforms, or enterprise data architecture.
  • Expert hands- on experience with PySpark, AWS Glue, Amazon S3, AWS Lake Formation, Amazon Athena, and Apache Iceberg.
  • Strong experience with Amazon Redshift, including data modeling, query optimization, workload management, and performance tuning.
  • Hands- on experience with Amazon Aurora and strong knowledge of SQL, relational data modeling, and database integration patterns.
  • Strong Python development skills and experience building scalable ETL/ELT and data processing frameworks on AWS.
  • Strong experience with GitHub, including branching strategies, pull requests, code reviews, source control, and CI/CD integration.
  • Working knowledge of AWS Lambda, EMR, Kinesis, Kafka, and real- time or event-driven data processing architectures.
  • Experience with Terraform, CloudFormation, or AWS CDK for Infrastructure as Code and automated cloud deployments.
  • Strong understanding of data governance, metadata, lineage, data quality, IAM, security, and cloud cost optimization.
  • Experience with AWS VPC, IAM/SSO, KMS, networking, containers, and cloud-native architecture is desirable.

#LI-EF1

#CB

#Ind123

Applications will be accepted until 30 Nov 2026.

Salary and Other Compensation:

The annual salary for this position is between $[133,000- 156,500] depending on experience and other qualifications of the successful candidate.

This position is also eligible for Cognizant’s discretionary annual incentive program, based on performance and subject to the terms of Cognizant’s applicable plans.

Benefits: Cognizant offers the following benefits for this position, subject to applicable eligibility requirements:
  • Medical/Dental/Vision/Life Insurance
  • Paid holidays plus Paid Time Off
  • 401(k) plan and contributions
  • Long-term/Short-term Disability
  • Paid Parental Leave
  • Employee Stock Purchase Plan

Cognizant is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to sex, gender identity, sexual orientation, race, color, religion, national origin, disability, protected Veteran status, age, or any other characteristic protected by law.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Lead AWS Data Engineer
Lead AWS Data Engineer

Cognizant Technology Solutions Corporation • Nashville (TN)

On-site
USD 133,000 - 157,000
Medical/Dental/Vision/Life Insurance
Paid holidays/PTO
401(k) plan
+3
Lead AWS Data Engineer
Lead AWS Data Engineer

Cognizant • Charlotte (NC)

On-site
USD 133,000 - 157,000
Medical Insurance
401(k) plan
Employee Stock Purchase Plan
+1
Sr. AWS Data Engineer (Java, Python & Generative AI)
Sr. AWS Data Engineer (Java, Python & Generative AI)

Cognizant • Charlotte (NC)

Hybrid
USD 90,000 - 105,000
Medical/Dental/Vision/Life Insurance
Paid holidays plus Paid Time Off
401(k) plan and contributions
+3
Sr. AWS Data Engineer (Java, Python & Generative AI)
Sr. AWS Data Engineer (Java, Python & Generative AI)

Cognizant Technology Solutions Corporation • Charlotte (NC)

Hybrid
USD 90,000 - 105,000
Medical/Dental/Vision/Life Insurance
Paid holidays plus PTO
401(k) plan and contributions
+3
Cloud Data Migration Engineer
Cloud Data Migration Engineer

Cognizant • Jackson (MS)

Remote
USD 105,000 - 117,000
Medical/Dental/Vision/Life Insurance
Paid holidays plus Paid Time Off
401(k) plan and contributions
+3
Cloud Data Migration Engineer
Cloud Data Migration Engineer

Cognizant Technology Solutions Corporation • Hartford (CT)

Remote
USD 105,000 - 117,000
Medical Insurance
Dental Insurance
Vision Insurance
+4
AI Data Engineer
AI Data Engineer

Cognizant Technology Solutions Corporation • Columbus (GA)

Remote
USD 100,000 - 115,000
Medical/Dental/Vision/Life Insurance
401(k) plan and contributions
Parental Leave
+1
Cloud Data Migration Engineer
Cloud Data Migration Engineer

Cognizant • Richmond (VA)

Remote
USD 105,000 - 117,000
Medical/Dental/Vision/Life Insurance
Paid holidays plus PTO
401(k) plan and contributions
+3
Cloud Data Migration Engineer
Cloud Data Migration Engineer

Cognizant Technology Solutions Corporation • Frankfort (KY)

Remote
USD 105,000 - 117,000
Medical/Dental/Vision/Life Insurance
Paid holidays plus Paid Time Off
401(k) plan and contributions
+3
AI Data Engineer
AI Data Engineer

Cognizant Technology Solutions Corporation • Richmond (VA)

Remote
USD 100,000 - 115,000
Medical/Dental/Vision/Life Insurance
Paid holidays + Paid Time Off
401(k) plan and contributions
+3