Senior Data Engineer - Cloud Data Pipelines & Analytics

Incedo Inc.; Torrance (CA); On-site; USD 120,000 - 160,000; Full time

Job summary

Incedo Inc. in Torrance, CA is hiring a Data Engineer to design and maintain data integration solutions across AWS services.

You will translate business needs into scalable pipelines using PySpark, Spark, Python, and tools like Glue, EMR, and Airflow, ensuring data quality and timely delivery for BI.

The role emphasizes performance optimization, documentation, compliance, and collaboration with analysts.

Qualifications

• 5+ years of data engineering, ETL, and data warehousing.
• 3+ years with AWS tools including S3, EMR, Glue, Athena, Redshift, RDS, Spectrum and Airflow.
• 2+ years CI/CD practices and pipelines.

Responsibilities

• Design and implement data integration workflows with AWS Glue/EMR and Airflow.
• Develop data pipelines using PySpark and Python for large datasets.
• Ensure data extraction, transformation, and loading into target systems.
• Maintain data quality, monitoring, validation, and error handling.
• Collaborate with analysts and stakeholders to meet data requirements.
• Document data integration processes and compliance.

Skills

Pyspark

Apache Spark

Python

AWS Glue

AWS EMR

Airflow

Redshift

Iceberg

RDS

CI/CD

Amazon Kiro

IDMC

S3

Lambda

Athena

Tools

Informatica Cloud (IDMC)

Lambda

S3

Athena

Job description

Incedo Inc. in Torrance, CA is hiring a Data Engineer to design and maintain data integration solutions across AWS services.

You will translate business needs into scalable pipelines using PySpark, Spark, Python, and tools like Glue, EMR, and Airflow, ensuring data quality and timely delivery for BI.

The role emphasizes performance optimization, documentation, compliance, and collaboration with analysts.