Senior Big Data Architect for Scalable AI & Analytics

Blackstraw AI; Town of Florida (NY); On-site; USD 130,000 - 160,000; Full time

Job summary

A technology services company is seeking an experienced Big Data Architect to design and build scalable data platforms supporting AI and analytics solutions. The role entails collaborating with engineering teams to define data architecture, implement reliable data pipelines, and optimize data workflows. Candidates should have over 10 years of experience in data engineering with expertise in big data systems, particularly in distributed frameworks like Apache Spark and cloud environments. The position offers a chance to play a pivotal role in enterprise-level data architecture initiatives.

Qualifications

• 10+ years of experience in data engineering or big data systems.
• Proven experience with enterprise-scale data platforms.
• Strong hands-on experience with Apache Spark.

Responsibilities

• Design and implement scalable data architectures.
• Architect batch and near real-time data pipelines.
• Define and maintain data modeling standards.

Skills

Data architecture design

Distributed data processing frameworks

Cloud platforms (AWS, Azure, GCP)

SQL

PySpark

Machine learning

Education

Bachelor's Degree in Computer Science or related field

Tools

Apache Spark

Snowflake

Redshift

Job description

A technology services company is seeking an experienced Big Data Architect to design and build scalable data platforms supporting AI and analytics solutions. The role entails collaborating with engineering teams to define data architecture, implement reliable data pipelines, and optimize data workflows. Candidates should have over 10 years of experience in data engineering with expertise in big data systems, particularly in distributed frameworks like Apache Spark and cloud environments. The position offers a chance to play a pivotal role in enterprise-level data architecture initiatives.