Senior Data Engineer / Full Remote / U$S

DaBrein Solutions; Buenos Aires; A distancia; USD 40.000 - 80.000; Jornada completa

Descripción de la vacante

An innovative firm is seeking a Senior Data Engineer to design and maintain robust data pipelines using Azure technologies. This role involves collaboration with cross-functional teams to ensure seamless data integration and delivery, transforming raw data into structured datasets for analysis. The ideal candidate will have a passion for data quality and governance, leveraging tools like Power BI and Azure Synapse. Join a forward-thinking company that values teamwork and communication, offering a dynamic environment where your contributions will significantly impact data initiatives and architecture across projects.

Formación

• 4+ years of experience in data engineering and building data solutions.
• Strong analytic skills and ability to work with unstructured datasets.
• Experience with cloud automation tooling and data modeling concepts.

Responsabilidades

• Design and maintain scalable data pipelines using Azure tools.
• Collaborate with teams to ensure seamless data integration.
• Ensure data quality and governance using Power BI and Purview.

Conocimientos

Data Engineering

Azure Data Factory

Databricks

Azure Synapse

Python

SQL

CI/CD

Data Quality

Data Governance

Communication Skills

Educación

Bachelor's Degree in Computer Science

Herramientas

Power BI

Microsoft Purview

Visual Studio

Azure DevOps

Descripción del empleo

Senior Data Engineer / Full Remote / U$S

• Design, develop, and maintain robust and scalable data pipelines using Azure Data Factory, Databricks, and other Azure-native tools.
• Collaborate with cross-functional teams, including software developers, database architects, and data analysts, to ensure seamless data integration and delivery.
• Transform raw data into clean, structured datasets optimized for analysis and reporting.
• Develop solutions that enable real-time and batch data processing using Azure Synapse and high-speed indexing technologies.
• Implement best practices for CI/CD pipelines, automated testing, version control, and production deployment of data solutions.
• Ensure data quality, consistency, and governance by using tools such as Power BI and Microsoft Purview.
• Troubleshoot and maintain data infrastructure and support analytics applications and data warehouse environments.
• Support ongoing data initiatives by ensuring a consistent and reliable data architecture across projects.
• Contribute to architectural decisions and solution design, leveraging expertise in data modeling, distributed systems, and automation.

Responsibilities

• Design, develop, and maintain robust and scalable data pipelines using Azure Data Factory, Databricks, and other Azure-native tools.
• Collaborate with cross-functional teams, including software developers, database architects, and data analysts, to ensure seamless data integration and delivery.
• Transform raw data into clean, structured datasets optimized for analysis and reporting.
• Develop solutions that enable real-time and batch data processing using Azure Synapse and high-speed indexing technologies.
• Implement best practices for CI/CD pipelines, automated testing, version control, and production deployment of data solutions.
• Ensure data quality, consistency, and governance by using tools such as Power BI and Microsoft Purview.
• Troubleshoot and maintain data infrastructure and support analytics applications and data warehouse environments.
• Support ongoing data initiatives by ensuring a consistent and reliable data architecture across projects.
• Contribute to architectural decisions and solution design, leveraging expertise in data modeling, distributed systems, and automation.

Requirements

• 4+ years of industry experience in data engineering and building world class data solutions.
• Excellent communication skills and a passion for collaborating with a diverse team and help foster an environment that promotes effective teamwork, communication, collaboration, and commitment.
• Assure that data is cleansed, mapped, transformed, and otherwise optimized for storage and use according to business and technical requirements
• Develop and maintain innovative Azure solutions
• Solution design using Microsoft Azure services and other tools
• The ability to automate tasks and deploy production standard code (with unit testing, continuous integration, versioning etc.)
• Load transformed data into storage and reporting structures in destinations including data warehouse, high speed indexes, real-time reporting systems and analytics applications
• Build data pipelines to collectively bring together data
• Other responsibilities include extracting data, troubleshooting and maintaining the data warehouse
• Assist software developers, database architects, data analysts, and data scientists with data initiatives and ensuring a consistent data delivery architecture is put in place throughout ongoing projects.

Qualifications

• Bachelor’s degree in computer science or equivalent experience.
• Inclusive of Data Warehouse fact and dimensional modeling concepts
• Experience in Azure Synapse, Visual Studio, Azure DevOps, CI/CD, Pipelines, Data Factory, Python, Databricks, SQL
• Experience with data tools such as Power BI and Purview
• Expertise with cloud automation tooling such as ARM Templates
• Experience with distributed (multi-tiered) systems and databases
• Strong analytic skills related to working with unstructured datasets
• The ability to design and implement well written code
• Ability to work to tight deadlines
• Ability to test the data from source to the presentation layer
• Ability to support/troubleshoot data pipelines