Senior Azure & AI Data Architect

Fractal Analytics Inc; New York (NY); On-site; USD 150,000 - 200,000; Full time

Benefits offered by this job

Health, dental, vision, life insurance

Disability plans

401(k) Plan

11 paid holidays

Parental Leave (12 weeks)

PTO policy

Job summary

Fractal Analytics Inc in New York invites a Lead Architect – Azure & AI to design and deliver cloud-native data solutions on Azure and Snowflake, enabling analytics, ML/AI workloads, and governance.

You will lead end-to-end data pipelines, ETL/ELT, PySpark, SQL, Snowflake, and integrate NoSQL, while partnering with stakeholders. The role includes DevOps practices and a strong focus on data security.

Qualifications

• 8+ years in data engineering with Azure and Snowflake.
• Strong Insurance domain experience preferred.
• Proficient in SQL and Python/PySpark for data transformations.
• Experience designing ETL/ELT pipelines and data warehouses.
• Expertise with Snowflake schema design, performance tuning, and security.
• Hands-on Spark tuning and distributed processing knowledge.

Responsibilities

• Design and deliver large-scale cloud data pipelines on Azure and Snowflake.
• Develop and maintain ETL/ELT workflows for structured and unstructured data.
• Write production-grade Python (PySpark) and SQL for data transformations.
• Architect Snowflake solutions with schema design and performance tuning.
• Leverage Azure Synapse and Snowflake for analytics and data warehousing.
• Partner with stakeholders to design DataMarts and Data Lakes.
• Implement data quality, governance, and lineage across environments.
• Optimize Spark workloads on Databricks and manage Notebooks/Jobs
• Integrate NoSQL stores and hybrid Snowflake-Azure solutions
• Utilize Azure Cognitive Search for indexing and search

Skills

Azure Data Factory

Azure Synapse

Databricks

Snowflake

SQL

Python

PySpark

ETL/ELT pipelines

NoSQL (Cosmos DB/MongoDB)

Kafka

Event Hub

SFTP/API integration

Spark performance tuning

CI/CD DevOps

Tools

Azure Data Factory

Azure Synapse

Databricks

Snowflake

Elasticsearch

Azure DevOps

Jenkins

Git

Cosmos DB

MongoDB

Kafka

Event Hub

SFTP

APIs

CI/CD pipelines

Job description

Fractal Analytics Inc in New York invites a Lead Architect – Azure & AI to design and deliver cloud-native data solutions on Azure and Snowflake, enabling analytics, ML/AI workloads, and governance.

You will lead end-to-end data pipelines, ETL/ELT, PySpark, SQL, Snowflake, and integrate NoSQL, while partnering with stakeholders. The role includes DevOps practices and a strong focus on data security.