Senior AWS Data Engineer

Prudent Technologies and Consulting, Inc.; Torrance (CA); On-site; USD 140,000 - 190,000; Full time

Job summary

Prudent Technologies and Consulting, Inc. in Torrance, CA is seeking a senior data engineer to build scalable data pipelines, data warehouses, and robust ETL processes using AWS tooling. You will design data models, implement security/governance with IAM/Lake Formation, and apply CI/CD practices. Experience with Informatica and AI use cases in data engineering is highly valued.

Candidates must be U.S.-authorized to work on a W-2 basis without visa sponsorship.

Qualifications

• 7+ years of experience in data engineering, database design, ETL processes, and data warehousing.
• 5+ years of experience with AWS tools and technologies (S3, EMR, Glue, Athena, RedShift, RDS, Spectrum and Airflow)
• 5+ in programming languages such as Python, Pyspark, or Scala.
• 2+ years of experience with CI/CD tools and DevOps practices for automated build, deployment, and release of data pipelines.
• 2+ years of hands-on experience with AWS IAM and AWS Lake Formation, including IAM roles/policies, access controls, and data lake security/governance.
• Strong knowledge of data storage and processing technologies, including databases and data lakes based distributed computing frameworks (e.g., Hadoop, Spark).
• Experience with Informatica IDMC / Informatica Cloud.
• Experience with Agentic AI or Generative AI use cases in Data Engineering.

Skills

Data engineering

ETL pipelines

Data warehousing

Python / PySpark / Scala

AWS tools

CI/CD & DevOps for data pipelines

AWS IAM & Lake Formation

Hadoop / Spark ecosystem

Informatica IDMC / Informatica Cloud

Generative AI in data engineering

US work authorization (W-2)

Tools

Informatica IDMC

Informatica Cloud

Airflow

Hadoop

Spark

Job description

Key Requirement: Candidates must be authorized to work in the U.S. for any employer on a W-2 basis without requiring current or future visa sponsorship. Qualified candidates who meet these requirements are encouraged to apply.

WHAT’S NEEDED

7+ years of experience in data engineering, database design, ETL processes, and data warehousing.

5+ years of experience with AWS tools and technologies (S3, EMR, Glue, Athena, RedShift, RDS, Spectrum and Airflow)

5+ in programming languages such as Python, Pyspark, or Scala.

2+ years of experience with CI/CD tools and DevOps practices for automated build, deployment, and release of data pipelines.

2+ years of hands-on experience with AWS IAM and AWS Lake Formation, including IAM roles/policies, access controls, and data lake security/governance.

Strong knowledge of data storage and processing technologies, including databases and data lakes based distributed computing frameworks (e.g., Hadoop, Spark).

Experience with Informatica IDMC / Informatica Cloud.

Experience with Agentic AI or Generative AI use cases in Data Engineering.