Data Engineer II: Build Scalable AWS ETL/ELT Pipelines

Detail Page LLC; Utah; Sur place; USD 90 000 - 130 000; Plein temps

Résumé du poste

DetailPage LLC is seeking a Data Engineer to design, build, and optimize scalable ETL/ELT pipelines across AWS services (Aurora, Redshift, Glue) to keep data flowing to engineering, analytics, and product teams powering AI-assisted insights behind DetailPage's platform. You will design, develop, and maintain data pipelines, support ETL/ELT processes, and collaborate with cross-functional teams.

Proficiency in Python, SQL, Pandas, PyTest, FastAPI, and IaC tools like CDK/Terraform is required.

Qualifications

• Sufficient SQL expertise for complex queries and optimization.
• 2-3 years of Data Engineering experience with AWS and Python.
• Linux scripting and container basics.
• Experience with data APIs and testing practices.

Responsabilités

• Design, develop, and maintain scalable data pipelines on AWS.
• Work with Aurora, Redshift, and Glue for large-scale data.
• Develop and optimize ETL/ELT for multi-source integration.
• Collaborate with engineering, analytics, and product teams.
• Use Python, SQL, and Pandas for data manipulation and automation.
• Implement unit tests with PyTest to ensure reliability.
• Manage API integrations with FastAPI.
• Assist with IaC using CDK and Terraform.
• Build CI/CD pipelines with Jenkins.

Connaissances

SQL mastery

Data Engineering

Python

Linux

Git

ETL/ELT

Unit testing

Outils

PySpark

Pandas

SQLAlchemy

Description du poste

DetailPage LLC is seeking a Data Engineer to design, build, and optimize scalable ETL/ELT pipelines across AWS services (Aurora, Redshift, Glue) to keep data flowing to engineering, analytics, and product teams powering AI-assisted insights behind DetailPage's platform. You will design, develop, and maintain data pipelines, support ETL/ELT processes, and collaborate with cross-functional teams.

Proficiency in Python, SQL, Pandas, PyTest, FastAPI, and IaC tools like CDK/Terraform is required.