Snowflake Lead - PySpark Data Pipeline Architect

Envision Technology Solutions; Oklahoma; On-site; USD 110,000 - 150,000; Full time

Job summary

Envision Technology Solutions in Lincoln, Rhode Island is seeking a skilled Snowflake Engineer with PySpark expertise to design and optimize scalable data pipelines. This onsite role focuses on building governed data solutions with Snowflake, Snowpark, and advanced SQL techniques.

You will collaborate across teams, implement CI/CD for data workflows, and ensure performance and reliability while applying data governance and metadata management best practices.

Qualifications

• Must have 5–7 years of data engineering experience with Snowflake and PySpark.
• Strong hands-on Snowflake design, pipelines, and query optimization.
• Proficiency with Snowpark workflows and AWS integration with Snowflake.
• Deep knowledge of data governance, metadata management, and data lineage.
• Advanced PySpark skills for complex transformations and automation.
• Solid understanding of data warehousing concepts and distributed computing.
• Experience with Agile/Scrum and effective communication for client interaction.

Responsibilities

• Design, develop, and manage Snowflake data pipelines for scalable warehousing.
• Implement and maintain PySpark notebooks for data ingestion and loading into Snowflake.
• Develop and optimize PySpark scripts for advanced transformations and workflow automation.
• Integrate AWS with Snowflake stages for enhanced data processing.
• Collaborate with cross-functional teams to translate business needs into technical solutions.
• Monitor and troubleshoot Snowflake and PySpark workflows for performance and reliability.
• Implement data partitioning, indexing, and caching to improve Snowflake query performance.
• Automate repetitive tasks and implement CI/CD pipelines for data workflows.

Tools

Snowflake

PySpark

SQL

Python

Job description

Envision Technology Solutions in Lincoln, Rhode Island is seeking a skilled Snowflake Engineer with PySpark expertise to design and optimize scalable data pipelines. This onsite role focuses on building governed data solutions with Snowflake, Snowpark, and advanced SQL techniques.

You will collaborate across teams, implement CI/CD for data workflows, and ensure performance and reliability while applying data governance and metadata management best practices.