Job Summary
We are looking for an experienced Snowflake Data Engineer with hands-on experience in Snowflake, advanced SQL, Python, ETL development, Apache Airflow, and AWS. The candidate should have strong knowledge of data warehousing, data modelling, data validation, and data pipeline troubleshooting.
Key Responsibilities
- Develop and maintain data warehouse solutions using Snowflake.
- Write complex SQL queries and optimise query performance.
- Develop Python-based data processing solutions.
- Build and maintain ETL pipelines using SQL and other ETL tools.
- Manage data pipeline orchestration and scheduling using Apache Airflow.
- Work with AWS services, specifically Amazon S3 and AWS Connection Management.
- Design data warehouse schemas based on business requirements.
- Implement dimensional modelling using fact and dimension tables.
- Implement Slowly Changing Dimensions (SCD) concepts.
- Analyse data and support business reporting requirements.
- Reconcile business information and validate data accuracy.
- Troubleshoot data pipeline issues, perform root cause analysis, and implement solutions.
- Follow Agile methodologies and collaborate with teams throughout the product life cycle.
- Apply software development practices and adopt current technologies for data solutions.
Required Skills
- Snowflake data warehousing and data engineering
- Advanced SQL and query performance optimisation
- Python
- ETL development
- Apache Airflow
- AWS, Amazon S3, and AWS Connection Management
- Data warehouse architecture and schema design
- Dimensional modelling (fact and dimension tables)
- Slowly Changing Dimensions (SCD)
- Data analysis and business reporting
- Business information reconciliation and data validation
- Agile methodology
- Product life cycle
- Troubleshooting and root cause analysis
- Software development practices
- Technology adoption