Data Engineer -Azure and Snowflake

Tech Mahindra oportunidades; United States; Remote; USD 80,000 - 120,000; Full time

Job summary

An established industry player is seeking a skilled Data Engineer with expertise in Azure and Snowflake. This role involves designing and maintaining data pipelines, ensuring data quality, and integrating various data sources. You will collaborate closely with data scientists and analysts to deliver high-quality data solutions while optimizing performance and ensuring compliance with industry standards. If you are a self-starter with a passion for data technology and the ability to see the big picture, this opportunity is perfect for you.

Qualifications

• 5+ years of complex data technology experience.
• Expertise in Azure Data Services and Snowflake for data pipelines.

Responsibilities

• Design, develop, and maintain data pipelines using Azure services.
• Integrate data into Azure and Snowflake, ensuring quality and consistency.

Skills

Azure Data Services

Snowflake Expertise

Data Integration

ETL Development

SAP HANA

Performance Tuning

Security and Compliance

Automation

Collaboration

Monitoring and Troubleshooting

Documentation

Tableau/PowerBI exposure

Sales data within a CPG environment

Agile

Tools

Azure Data Factory

Azure Databricks

Azure DevOps

Job description

Data Engineer ( Azure) with Snowflake

• 5+ years of complex data technology experience
• Azure Data Services: Design, develop, and maintain data pipelines using Azure Data Factory, Azure Databricks and Blob Storage.
• Snowflake Expertise: Implement and manage data warehousing solutions using Snowflake, including data modeling, ETL/ELT processes, and performance optimization.
• Data Integration: Integrate data from various sources into Azure and Snowflake environments, ensuring data quality and consistency.
• ETL Development: Develop and maintain ETL processes to support data ingestion, transformation, and loading using tools like Azure Data Factory and Snowflake’s native capabilities.
• SAP HANA: Ability to analyze current models and also migrate data and models from SAP HANA into Snowflake environment, ensuring seamless data flow and consistency across platforms.
• Performance Tuning: Optimize the performance of data pipelines and queries in both Azure and Snowflake environments.
• Security and Compliance: Ensure data security and compliance with industry standards and regulations within Azure and Snowflake platforms.
• Automation: Automate data workflows and processes using Azure DevOps and other relevant tools.
• Collaboration: Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions.
• Monitoring and Troubleshooting: Monitor data pipelines and troubleshoot issues to ensure data availability and reliability.
• Documentation: Document data architectures, pipelines, and processes to ensure clarity and maintainability.
• Preferred - Tableau/PowerBI exposure
• Preferred - experience with Sales data within a CPG environment
• Self-starter who can see the big picture, prioritize work to make the largest impact on the business and customer's vision and requirements.
• Agile

Responsibilities and assignments

Data Engineer ( Azure) with Snowflake

• 5+ years of complex data technology experience
• Azure Data Services: Design, develop, and maintain data pipelines using Azure Data Factory, Azure Databricks and Blob Storage.
• Snowflake Expertise: Implement and manage data warehousing solutions using Snowflake, including data modeling, ETL/ELT processes, and performance optimization.
• Data Integration: Integrate data from various sources into Azure and Snowflake environments, ensuring data quality and consistency.
• ETL Development: Develop and maintain ETL processes to support data ingestion, transformation, and loading using tools like Azure Data Factory and Snowflake’s native capabilities.
• SAP HANA: Ability to analyze current models and also migrate data and models from SAP HANA into Snowflake environment, ensuring seamless data flow and consistency across platforms.
• Performance Tuning: Optimize the performance of data pipelines and queries in both Azure and Snowflake environments.
• Security and Compliance: Ensure data security and compliance with industry standards and regulations within Azure and Snowflake platforms.
• Automation: Automate data workflows and processes using Azure DevOps and other relevant tools.
• Collaboration: Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions.
• Monitoring and Troubleshooting: Monitor data pipelines and troubleshoot issues to ensure data availability and reliability.
• Documentation: Document data architectures, pipelines, and processes to ensure clarity and maintainability.
• Preferred - Tableau/PowerBI exposure
• Preferred - experience with Sales data within a CPG environment
• Self-starter who can see the big picture, prioritize work to make the largest impact on the business and customer's vision and requirements.
• Agile

Process stages

• Step 1: Registration 1 Registration
• Step 4: Entrevista L1 Global 4 Entrevista L1 Global
• Step 5: Entrevista L2 GLobal 5 Entrevista L2 GLobal
• Step 6: Entrevista Cliente 6 Entrevista Cliente
• Step 7: Hiring 7 Hiring