Remote Lakehouse BI & Data Architect – AI-Ready Pipelines

Acestack; Marlborough (MA); On-site; USD 120,000 - 190,000; Full time

Job summary

Acestack is seeking a BI / Data Architect to design and implement enterprise data lakehouse solutions in Marlborough, MA with remote flexibility. The role focuses on building robust data layers (Bronze-Silver-Gold) using Iceberg and modern streaming/batch pipelines, while enforcing governance and security.

Responsibilities include designing ingestion frameworks, implementing metadata management, and enabling AI-ready data services with scalable, CI/CD-enabled pipelines.

Qualifications

• Experience designing enterprise lakehouse architecture and governance.
• Proficient with Iceberg-based data layers and ETL pipelines.
• Strong skills in batch, streaming, CDC, APIs, and event-driven integrations.

Responsibilities

• Define enterprise lakehouse architecture, standards, governance, and implementation roadmap.
• Design and build Iceberg-based Bronze, Silver, and Gold data layers.
• Develop ingestion frameworks for batch, streaming, CDC, APIs, and event-driven integrations.
• Build scalable Spark, Flink, Kafka, dbt, SQL, and Python pipelines.
• Implement metadata management, cataloging, lineage, RBAC, encryption, and data quality.
• Optimize partitioning, compaction, snapshots, metadata, and query performance.
• Enable AI-ready semantic layers, feature engineering, RAG, and GenAI workloads.
• Implement Infrastructure as Code, CI/CD, monitoring, and observability.

Tools

Apache Iceberg

Spark

Flink

Kafka

dbt

Trino

Snowflake

Databricks

AWS

Azure

Google Cloud

Python

Scala

SQL

Java

Kubernetes

Docker

Terraform

Airflow

Dagster

Prefect

Polaris

Unity Catalog

Glue Catalog

Apache Nessie

Job description

Acestack is seeking a BI / Data Architect to design and implement enterprise data lakehouse solutions in Marlborough, MA with remote flexibility. The role focuses on building robust data layers (Bronze-Silver-Gold) using Iceberg and modern streaming/batch pipelines, while enforcing governance and security.

Responsibilities include designing ingestion frameworks, implementing metadata management, and enabling AI-ready data services with scalable, CI/CD-enabled pipelines.