AWS Data Architect

E-Solutions; Village of Tarrytown (NY); On-site; USD 151,536 - 206,640; Part time

Job summary

A leading IT consulting company is seeking a Data Architect in Tarrytown, NY. This role requires 12+ years of experience in data engineering, with strong knowledge in Spark, PySpark, AWS Redshift, and data governance. The successful candidate will contribute to the architecture and design of large-scale platforms, ensuring efficiency and cost reduction. This position is a contract role, 100% onsite.

Qualifications

• 12+ years of experience in data engineering architecture for large-scale platforms.
• Proficiency in data ingestion/orchestration tools and real-time processing frameworks.
• Solid understanding of data security, authentication, and compliance frameworks.

Responsibilities

• Define platform roadmap and architecture.
• Create data models to enhance efficiency and reduce costs.
• Design POCs and guide principles for best practices.

Skills

Spark

PySpark

AWS Redshift

Airflow

EMR

Python

Tools

Dremio

Elasticsearch

Solr

Privacera

Apache Ranger

Jenkins

Git

Docker

Kubernetes

Job description

Overview

Role: Data Architect

Location: Tarrytown NY 10591 (100% Onsite)

Skills: Spark, PySpark, AWS Redshift, Airflow, EMR, Python

Job Description:

• Candidate should have strong 12+ Years of experience in data engineering architecture for large-scale platforms.
• Contribute towards defining platform roadmap/Architecture/solution, Design, POCs, prototype, technical evaluation for tech stack finalization and guiding principle for the best practices etc.
• Creating data models to reduce system complexities and hence increase efficiency & reduce cost.
• Expertise with data ingestion/orchestration tools and working experience in Real-time processing Framework (Apache Spark), PySpark and in AWS Redshift, Apache Airflow and EMR etc
• Strong coding background in Python, SQL, PySpark. Proficiency in data virtualization (Dremio or similar).
• Experience with data governance and access control frameworks (Privacera, Apache Ranger, etc.).
• Knowledge of search & discovery platforms (Solr, Elasticsearch, Looker).
• Solid understanding of data security, authentication (Okta), and compliance frameworks.
• Familiarity with CI/CD pipelines and DevOps practices (Jenkins, Git, Docker, Kubernetes).
• Prior experience designing enterprise data platforms in healthcare, pharma, or regulated industries.
• Knowledge of machine learning pipelines and integration into data platforms.

Seniority level

• Mid-Senior level

Employment type

• Contract

Job function

• Information Technology

Industries

• IT Services and IT Consulting and Pharmaceutical Manufacturing