Lead Data Architect: AI-Assisted Hadoop-to-Snowflake

Machine Learning Technologies, LLC; Austin (TX); Presencial; USD 180.000 - 240.000; Tempo integral

Resumo da vaga

Machine Learning Technologies, LLC is seeking a hands-on Lead Data Architect to anchor the US side of a multi‑year data platform modernization for a global financial services client. The program moves on‑prem Hadoop workloads to Snowflake, and you will own the target architecture and stakeholder alignment.

You will guide an India‑based delivery team through an AI‑assisted migration, define Snowflake models and ingestion patterns, oversee Hadoop‑to‑Snowflake migrations, and drive growth by

Qualificações

• Extensive data engineering and architecture experience (12+ years).
• Hands-on Snowflake experience (4+ years).
• Proven Hadoop (Cloudera, Hive, Spark) to cloud migration delivery.
• Strong SQL, Python and Spark; knowledge of Snowpark and Snowflake tooling.
• Experience with data modeling, lineage, and reconciliation in regulated environments.

Responsabilidades

• Define target Snowflake architecture including models and ingestion patterns.
• Lead Hadoop-to-Snowflake migration assessment and design.
• Guide conversion of Hive, Spark, Python workloads to Snowflake SQL and Snowpark.
• Set validation approaches: reconciliation, data quality, parallel runs, cutover and rollback.
• Collaborate with security, governance on access, retention and compliance.
• Identify growth opportunities and shape proposals with account and delivery leads.
• Mentor engineers and support estimates and risk management.

Conhecimentos

Data architecture

Snowflake

SQL

Python

Spark

Team leadership

Stakeholder communication

Ferramentas

Hadoop (Cloudera, Hive, Spark)

Snowpark

CI/CD for data pipelines

Descrição da vaga

Machine Learning Technologies, LLC is seeking a hands-on Lead Data Architect to anchor the US side of a multi‑year data platform modernization for a global financial services client. The program moves on‑prem Hadoop workloads to Snowflake, and you will own the target architecture and stakeholder alignment.

You will guide an India‑based delivery team through an AI‑assisted migration, define Snowflake models and ingestion patterns, oversee Hadoop‑to‑Snowflake migrations, and drive growth by