Azure Data Engineer

Decskill; Santarém; Presencial; BRL 120.000 - 180.000; Tempo integral

Resumo da oferta

Uma empresa de consultoria em tecnologia busca um Azure Data Engineer para desenvolver e manter soluções de dados usando ferramentas Azure. O candidato ideal terá experiência em Azure Data Factory, Stream Analytics e CI/CD, com forte atenção à qualidade e integração de dados. Oportunidade oferece um ambiente dinâmico e colaborativo, focado em inovação e transformação digital.

Qualificações

• Experiência com Azure Functions e Logic Apps.
• Familiaridade com Azure API Management.
• Entendimento do Microsoft Purview.

Responsabilidades

• Projetar, desenvolver e manter pipelines de dados usando Azure Data Factory.
• Implementar soluções de armazenamento de dados com Azure Data Lake Storage Gen 2.
• Monitorar e solucionar pipelines de dados para desempenho e confiabilidade.

Conhecimentos

Azure Data Factory

Azure Stream Analytics

PySpark

Data Governance

CI/CD

Data Pipeline Development

Data Lake Storage

Azure DevOps

Serverless Computing

Data Analysis

Descrição da oferta de emprego

Decskill, founded in 2014 as an IT Consulting Company, places paramount importance on its greatest asset: its people. Our main mission is to deliver value through knowledge and talent, and we achieve this by fostering a culture of excellence and investing in the development and well-being of our people. With over 600 dedicated professionals and offices in Lisbon, Porto, Madrid, and Luxembourg, Decskill operates across three core areas: DECSKILL TALENT : We believe that our people are key to our success. Through Decskill Talent, we empower our team to embrace the digital transformation challenges of our clients. We collaborate with clients to drive innovation, ensuring project success and business growth. DECSKILL BOOST : Equipping our team with the latest tools and methodologies, we optimize Time-to-Market and deliver innovative solutions exceeding client expectations. DECSKILL CONNECT : Our team collaborates closely with clients to implement and manage IT infrastructures that generate long-term value. At Decskill, we believe that by nurturing and empowering our people to confront the challenges of digital transformation, we create value not only for our clients but also for our entire ecosystem, fostering a digital community dedicated to growth and progress. We are searching for an Azure Data Engineer ! Responsibilities: Design, develop, and maintain data pipelines using Azure Data Factory (ADF) . Implement and manage data storage solutions using Azure Data Lake Storage (ADLS) Gen 2. Design, develop, and maintain data pipelines pipelines using Azure Synapse Analytics. Utilize Azure Stream Analytics for real-time data processing and analytics. Ensure data quality and integrity through effective data governance practices. Implement CI/CD pipelines using Azure DevOps for automated build and deployment. Collaborate with data analysts and other stakeholders to understand data requirements and deliver solutions that meet business needs. Monitor and troubleshoot data pipelines to ensure optimal performance and reliability. Stay up to date with the latest industry trends and best practices in data engineering and cloud technologies. Requirements: Experience with Azure Functions for serverless computing. Knowledge of Azure Logic Apps for workflow automation. Experience with Azure Stream Analytics for real-time data processing. Familiarity with Azure API Management (APIM) for managing APIs. Understanding of Microsoft Purview for data governance and compliance. Proficiency in PySpark for data processing and transformation over either Spark. Pool or using Azure data bricks Strong experience with Azure Data Factory (ADF) for data integration and ETL processes. Strong experience of Azure Synapse Analytics for ETL processes. Expertise in Azure Data Lake Storage (ADLS) Gen 2 for scalable data storage. Experience with CI/CD practices and tools, particularly Azure DevOps. Strong problem-solving skills and attention to detail. Excellent communication and collaboration skills. Experience with Azure Functions for serverless computing. PLUS Knowledge of Azure Logic Apps for workflow automation. PLUS Experience with Azure Stream Analytics for real-time data processing. PLUS Familiarity with Azure API Management (APIM) for managing APIs. PLUS Understanding of Microsoft Purview for data governance and compliance. PLUS If you're interested in this job, please send your CV to ****** or with reference "AzureDataEngineer". Thank You! ?? Decskill is committed to equality and non-discrimination with all our talents. We recruit and promote talent, based on diversity and inclusion, regardless of age, gender, ethnicity, race, nationality or any other form of discrimination incompatible with the dignity of the human being

• Nível de experiência

  Assistente