TechRuiter is looking for an experienced Data Engineer to design and maintain scalable data pipelines using Snowflake as the core platform. Candidates should have a Bachelor’s degree in a related field and at least 5 years of experience in data engineering, including hands-on work with Snowflake and AWS or Azure services. The role involves collaboration with various teams for technical solution development and requires strong Python and SQL skills.
Qualifications
5+ years of experience in data engineering or similar roles.
3+ years of strong hands-on experience with Snowflake, including advanced SQL and performance tuning.
Experience working in Azure cloud environments.
Responsibilities
Design, develop, and maintain scalable data pipelines using Snowflake.
Build and optimize data ingestion processes from multiple sources.
Collaborate to translate requirements into technical solutions.
Skills
Snowflake SQL
Data ingestion methods
AWS services
Python programming
SQL Server
Data modeling
Git
Education
Bachelor’s degree in Computer Science, Information Systems, or related field
Tools
Snowflake
AWS S3
Azure
Python
Job description
Responsibilities
Design, develop, and maintain scalable data pipelines usingSnowflakeas the core data warehouse platform.
Build and optimize batch, file-based, and real-time streaming data ingestion processes from multiple sources.
Develop data transformation logic using Snowflake SQL, stored procedures, and Python.
Collaborate with architects, analysts, and business teams to translate requirements into technical solutions.
Monitor and troubleshoot pipeline performance while ensuring data quality and availability.
Maintain documentation for data flows, models, and system architecture.
Partner with DevOps teams to implement CI/CD practices for data pipeline deployments.
Required Skills and Experience
Bachelor’s degree in Computer Science, Information Systems, or related field.
5+ years of experience in data engineering or similar roles.
3+ years of strong hands-on experience withSnowflake, including advanced SQL, stored procedures, and performance tuning.
Experience with data ingestion methods such as bulk loading, micro-batching, and streaming.
Strong knowledge ofAWS services such as S3, Lambda, and CloudWatch, orAzure servicesincluding Data Factory, Event Hubs, Blob Storage, and Azure Functions.
Experience working inAzure cloudenvironments.
StrongPythonprogramming skills for automation, integrations, and data processing.
Good experience withSQL Serverand relational databases.
Knowledge of data modeling, security, governance, and best practices.
Experience with Git and collaborative development environments.