AWS Lakehouse Data Engineer- GrantSolutions experienced only

TRIWAVE Solutions INC; United States; Remote; USD 80,000 - 113,000; Full time

Job summary

TRIWAVE Solutions INC. is seeking an experienced AWS Lakehouse Data Engineer to design, build, and operate a modern AWS-native data platform supporting analytics, reporting, visualization, and AI/ML workloads.

The ideal candidate will have hands-on experience with AWS data services (S3, Glue, Athena, EMR, Lake Formation, Redshift), Apache Iceberg, PySpark, Python, and SQL, plus strong data governance capabilities. Remote work and a competitive rate are offered.

Qualifications

• Hands-on experience building AWS data lake/lakehouse architectures.
• Strong Python, PySpark, and SQL skills with production ETL/ELT experience.
• Experience with Apache Iceberg, including ACID, schema evolution, snapshots, partitioning, and optimization.
• Experience with AWS services including S3, Glue, Athena, EMR, Lake Formation, IAM, KMS, and Redshift.
• Experience with data governance, metadata, lineage, data quality, and fine-grained access controls.
• Experience with IaC, CI/CD, AWS security, and distributed data-processing environments.

Responsibilities

• Design and build scalable batch and streaming data pipelines using Python and PySpark.
• Build and maintain an AWS-native lakehouse on Amazon S3 using Iceberg and Parquet.
• Develop ETL/ELT workflows, incremental processing, CDC, schema validation, and reusable transformations.
• Use AWS services for data processing, querying, and governance (Glue, Athena, EMR, Lake Formation, Redshift).
• Implement metadata management, lineage, data quality, encryption, and fine-grained access controls.
• Automate AWS infrastructure using IaC and support CI/CD pipelines across environments.
• Monitor and optimize platform performance, reliability, security, and cost.
• Collaborate with data, analytics, AI/ML, security, and cloud teams; maintain technical documentation.

Skills

Python

PySpark

SQL

AWS data lake

Infrastructure as Code

CI/CD

AWS security

Data governance

Tools

AWS Glue

Athena

EMR

Lake Formation

Redshift

S3

IAM

KMS

Job description

AWS Lakehouse Data Engineer

Client: GrantSolutions.govLocation: 100% RemoteRate: $70/hourVisa: No visa restrictions

About the Role

We are seeking an experienced AWS Lakehouse Data Engineer to design, build, and operate a modern AWS-native data platform supporting analytics, reporting, visualization, and AI/ML workloads.The ideal candidate will have strong hands-on experience with AWS data services, Amazon S3, Apache Iceberg, Python, PySpark, SQL, ETL/ELT pipelines, and data governance.

Responsibilities

• Design and build scalable batch and streaming data pipelines using Python and PySpark.
• Build and maintain an AWS-native lakehouse on Amazon S3 using Apache Iceberg and Parquet.
• Develop ETL/ELT workflows, incremental processing, CDC, schema validation, and reusable transformations.
• Use services such as AWS Glue, Athena, EMR, Lake Formation, and Redshift for data processing, querying, and governance.
• Implement metadata management, lineage, data quality, encryption, and fine-grained access controls.
• Automate AWS infrastructure using Infrastructure as Code (IaC) and support CI/CD pipelines across development, test, and production environments.
• Monitor and optimize platform performance, reliability, security, and cost.
• Collaborate with data, analytics, AI/ML, security, and cloud teams and maintain technical documentation.

Required Qualifications

• Hands-on experience building AWS data lake/lakehouse architectures.
• Strong Python, PySpark, and SQL skills with production ETL/ELT experience.
• Experience with Apache Iceberg, including ACID transactions, schema evolution, snapshots, partitioning, and optimization.
• Experience with AWS services including S3, Glue, Athena, EMR, Lake Formation, IAM, KMS, and Redshift.
• Experience with data governance, metadata, lineage, data quality, and fine-grained access controls.
• Experience with IaC, CI/CD, AWS security, and distributed data-processing environments.

Nice to Have

• Databricks or Delta Lake experience, including migration to AWS-native platforms.
• Experience with Terraform, CloudFormation/CDK, Docker, GitHub Actions, Jenkins, Step Functions, MWAA, Kinesis, Lambda, DMS, or MSK.
• Experience with QuickSight, Tableau, or Power BI.
• Knowledge of AI-assisted development, Knowledge Graphs, and Graph RAG, including ontology modeling, entity resolution, and hybrid graph/vector retrieval.