Data Architect: AWS, Spark & Real-Time Data Pipelines

Saransh Inc; Hartford (CT); On-site; USD 120,000 - 160,000; Full time

Job summary

Saransh Inc is seeking a Data Architect for an onsite contract role in Hartford, CT and Minneapolis, MN. You will lead the design and implementation of scalable data architectures on AWS, leveraging Spark for batch processing and Flink for real-time streams, with a focus on data modeling, governance, and end-to-end pipelines.

The position requires hands-on experience with Python, Docker, Kubernetes, CI/CD, and both SQL and NoSQL databases.

Qualifications

• Strong hands-on Python for data engineering and app development.
• Experience with AWS services including S3, EMR, Glue, Lambda, IAM, EC2, ECS/EKS, CloudWatch, Redshift.
• Expertise in Apache Spark for large-scale batch processing.
• Hands-on with Apache Flink for real-time streaming and data pipelines.
• Experience designing batch and streaming architectures and data modeling.

Responsibilities

• Design and implement scalable, secure data architectures on AWS.
• Build and optimize batch processing pipelines with Apache Spark.
• Develop real-time streaming solutions using Apache Flink.
• Define data models, governance standards, and best practices.
• Shape end-to-end data ingestion, transformation, and processing pipelines.

Skills

Python

AWS

Apache Spark

Apache Flink

SQL

Docker

Kubernetes

Git

CI/CD

Tools

Docker

Kubernetes

Git

CI/CD

Job description

Saransh Inc is seeking a Data Architect for an onsite contract role in Hartford, CT and Minneapolis, MN. You will lead the design and implementation of scalable data architectures on AWS, leveraging Spark for batch processing and Flink for real-time streams, with a focus on data modeling, governance, and end-to-end pipelines.

The position requires hands-on experience with Python, Docker, Kubernetes, CI/CD, and both SQL and NoSQL databases.