Overview
We are seeking a highly skilled and motivated Data Engineer with 4 to 6 years of experience in building and managing data pipelines on cloud platforms. The ideal candidate must have strong hands-on experience with Microsoft Azure along with either SSIS or Snowflake, and a deep understanding of data integration, transformation, and warehousing practices.
Responsibilities
- Design, develop, and maintain scalable data pipelines using Azure Data Services.
- Integrate data from various sources using SSIS or Snowflake, depending on project requirements.
- Build efficient ETL/ELT workflows to support data warehousing, reporting, and analytics needs.
- Optimize and monitor existing data pipelines for performance and reliability.
- Collaborate with data analysts, architects, and business stakeholders to understand data requirements.
- Ensure data quality, consistency, and security across the pipeline lifecycle.
- Implement best practices for cloud data engineering and participate in code reviews.
- Maintain documentation related to data processes, architecture, and standards.
Required Skills & Experience
- 4 to 6 years of relevant experience in Data Engineering.
- Experience in building ETL/ELT processes using SSIS (SQL Server Integration Services) or Snowflake (including SnowSQL, Snowpipe, etc.).
- Proficient in SQL for data manipulation, transformation, and performance tuning.
- Familiarity with data modeling, data warehousing, and cloud data architectures.
- Experience with version control systems like Git.
- Understanding of CI/CD concepts and deployment pipelines in a cloud environment.