A technology solutions company in the United States is seeking a Data Engineer to develop and maintain data models and scalable data pipelines using Snowflake and DBT. The ideal candidate has proven experience with data warehousing concepts, CI/CD pipelines, and excellent problem-solving skills. This role involves collaborating with cross-functional teams to ensure data quality and performance, providing a dynamic work environment focused on innovation.
Qualifications
Proven experience with Snowflake, DBT, Airflow, and CI/CD pipelines.
Strong knowledge of SQL and data warehousing concepts.
Experience in designing and optimizing ETL/ELT processes.
Responsibilities
Develop and maintain data models in dbt following modular & scalable design principles.
Design, develop, and maintain scalable data pipelines using Snowflake and DBT.
Build and optimize pipelines on Snowflake, ensuring performance, cost efficiency and scalability.
Skills
Snowflake
DBT
Airflow
SQL
ETL/ELT processes
Cloud platforms
Tools
AWS
Job description
Responsibilities
Develop and maintain data models in dbt following modular & scalable design principles.
Design, develop, and maintain scalable data pipelines using Snowflake and DBT
Build and optimize pipelines on Snowflake, ensuring performance, cost efficiency and scalability.
Collaborate with cross functional teams to understand data requirements.
Implement data quality checks and testing in dbt.
Implement and optimize Airflow workflows for automation and scheduling of data processes.
Maintain documentation for data models, transformations and processes.
Develop and maintain CI/CD pipelines for data pipeline deployment and version control
Troubleshoot and resolve issues related to data pipelines
Qualifications
Proven experience with Snowflake, DBT, Airflow, and CI/CD pipelines.
Strong knowledge of SQL and data warehousing concepts.
Experience in designing and optimizing ETL/ELT processes.
Familiarity with cloud platforms (like AWS).
Strong problem-solving skills and ability to work in a fast-paced environment.