Cloud Data Platform Engineer - AWS Lakehouse & ETL

Holistic Partners, Inc; Dallas (TX); On-site; USD 120,000 - 170,000; Full time

Job summary

A distinguished technology firm in Dallas, TX is seeking a skilled professional to design and implement AWS-based data Lakehouse architecture. The role involves building automated ETL/ELT pipelines, managing RESTful APIs for data access, and ensuring data quality and compliance. Candidates should be proficient in AWS services like S3 and Lambda. This position is a great opportunity for individuals looking to work in a cutting-edge data environment.

Responsibilities

• Design and implement AWS-based data Lakehouse architecture using Apache Iceberg.
• Build and automate ETL/ELT pipelines for large-scale data ingestion.
• Develop and manage secure RESTful APIs for data access.
• Manage and optimize Iceberg tables (ACID, schema evolution, time travel, performance tuning).
• Utilize AWS services such as S3, EMR, Lake Formation, Lambda, API Gateway, IAM.
• Ensure data quality, security, and compliance.
• Collaborate with cross-functional teams and provide technical support.

Job description

A distinguished technology firm in Dallas, TX is seeking a skilled professional to design and implement AWS-based data Lakehouse architecture. The role involves building automated ETL/ELT pipelines, managing RESTful APIs for data access, and ensuring data quality and compliance. Candidates should be proficient in AWS services like S3 and Lambda. This position is a great opportunity for individuals looking to work in a cutting-edge data environment.