Senior Data Engineer: AWS/Snowflake Data Pipelines Lead

Visionary Innovative Technology Solutions LLC; Virginia; On-site; USD 96,000 - 138,000; Full time

Job summary

Visionary Innovative Technology Solutions LLC is seeking a Senior Data Engineer to lead cloud-native data pipelines on AWS and Snowflake. You will drive Spark-on-EKS, Snowflake capabilities, and PoCs for AI-powered data solutions.

You will mentor mid-level developers, collaborate with stakeholders, and architect end-to-end pipelines using AWS, Snowflake, IICS, and PySpark. Strong leadership and hands-on expertise are essential for success.

Qualifications

• Extensive experience designing cloud-native data pipelines on AWS.
• Strong Snowflake expertise and data governance capabilities.
• Proficient in PySpark and Snowpark for large-scale processing.
• Experience with IICS for file-based ETL ingestion.
• Leadership and mentoring of engineers on complex data projects.

Responsibilities

• Design and deploy containerized PySpark workloads on EKS.
• Build and tune EMR clusters on EC2 or EKS for large-scale processing.
• Orchestrate workflows using AWS Step Functions and Control-M.
• Lead IICS file-based ingestion design and data ingestion pipelines.
• Conduct code reviews, optimize performance, and mentor engineers.

Skills

AWS data services

PySpark

Snowpark

RAG PoCs

Agentic AI

SQL

Data modeling

Leadership

Mentoring

Control-M

Tools

IICS

EKS

EMR

Snowflake

DynamoDB

Glue Data Catalog

Job description

Visionary Innovative Technology Solutions LLC is seeking a Senior Data Engineer to lead cloud-native data pipelines on AWS and Snowflake. You will drive Spark-on-EKS, Snowflake capabilities, and PoCs for AI-powered data solutions.

You will mentor mid-level developers, collaborate with stakeholders, and architect end-to-end pipelines using AWS, Snowflake, IICS, and PySpark. Strong leadership and hands-on expertise are essential for success.