Snowflake Lead / Architect

Envision Technology Solutions; Oklahoma; On-site; USD 110,000 - 150,000; Full time

Job summary

Envision Technology Solutions in Lincoln, Rhode Island is seeking a skilled Snowflake Engineer with PySpark expertise to design and optimize scalable data pipelines. This onsite role focuses on building governed data solutions with Snowflake, Snowpark, and advanced SQL techniques.

You will collaborate across teams, implement CI/CD for data workflows, and ensure performance and reliability while applying data governance and metadata management best practices.

Qualifications

• Must have 5–7 years of data engineering experience with Snowflake and PySpark.
• Strong hands-on Snowflake design, pipelines, and query optimization.
• Proficiency with Snowpark workflows and AWS integration with Snowflake.
• Deep knowledge of data governance, metadata management, and data lineage.
• Advanced PySpark skills for complex transformations and automation.
• Solid understanding of data warehousing concepts and distributed computing.
• Experience with Agile/Scrum and effective communication for client interaction.

Responsibilities

• Design, develop, and manage Snowflake data pipelines for scalable warehousing.
• Implement and maintain PySpark notebooks for data ingestion and loading into Snowflake.
• Develop and optimize PySpark scripts for advanced transformations and workflow automation.
• Integrate AWS with Snowflake stages for enhanced data processing.
• Collaborate with cross-functional teams to translate business needs into technical solutions.
• Monitor and troubleshoot Snowflake and PySpark workflows for performance and reliability.
• Implement data partitioning, indexing, and caching to improve Snowflake query performance.
• Automate repetitive tasks and implement CI/CD pipelines for data workflows.

Tools

Snowflake

PySpark

SQL

Python

Job description

Job Location: Lincoln Rhode Island (Onsite)

Primary skills: Snowflake, PySpark

Secondary skills: SQL, Python

Mode of Work: Work from Office

About the job

We are seeking a skilled Snowflake Engineer with expertise in PySpark to join our team and contribute to building scalable, efficient, and governed data solutions. The ideal candidate will have hands-on experience in designing and optimizing Snowflake data warehouses, leveraging PySpark for complex ETL/ELT processes. Proficiency in advanced Snowflake features, such as streams, tasks, materialized views, and SQL, is essential. A solid understanding of data governance principles, metadata management, and cloud platforms like AWS or Azure will be highly beneficial.

Responsibilities

• Design, develop, and manage data pipelines in Snowflake to support scalable and efficient data warehousing solutions.
• Implement and maintain PySpark notebooks, ensuring seamless data ingestion, transformation, and loading into Snowflake.
• Develop and optimize PySpark scripts for advanced data transformation and workflow automation.
• Integrate AWS with Snowflake stages for enhanced data processing
• Collaborate with cross-functional teams to gather requirements and translate business needs into robust technical solutions.
• Monitor and troubleshoot Snowflake, and Pyspark workflows to ensure performance, reliability, and availability.
• Implement and optimize data partitioning, indexing, and caching techniques to enhance query performance in Snowflake.
• Automate repetitive tasks and implement CI/CD pipelines for seamless deployment and monitoring of data workflows.
• Collaborate with stakeholders to gather requirements and translate them into technical solutions.
• Build and maintain comprehensive mapping documents, transformation of business rules, and custom processes for data governance and analytics.

Requirements - Must Have

• 5-7 years of experience in data engineering with expertise in Snowflake, and PySpark.
• Strong hands-on experience with Snowflake, including designing schemas, managing pipelines, and optimizing query performance.
• Proficiency in developing and maintaining Snowpark workflows, with expertise in integrating AWS with Snowflake.
• In-depth knowledge of Snowflake for implementing data governance, metadata management, and data lineage processes.
• Advanced skills in PySpark for complex data transformation and automation tasks
• Solid understanding of Data Warehousing concepts and distributed computing.
• Experience with Agile/Scrum methodologies and excellent problem-solving capabilities.
• Effective verbal and written communication skills for direct client interaction.
• Experience working as both an individual contributor and a team player.
• Experience in the P&C Insurance domain is preferred.