Data Engineering Analyst III

Jobtailor; Fortaleza; Presencial; BRL 180 000 - 240 000; Tempo integral

Resumo da oferta

Jobtailor is seeking a data engineer to design and optimize end-to-end data pipelines in Azure Databricks and Synapse. You will govern data architecture, implement CI/CD, and mentor junior analysts while collaborating with analytics teams.

The role focuses on delivering reliable data solutions across the data lake architecture, with emphasis on performance tuning, data quality, and security.

Qualificações

• Bachelor’s degree in a relevant field is required.
• Strong background in data engineering and complex pipelines.
• Experience with governance, quality, and security processes.
• Familiarity with CI/CD and Agile methods.
• Proficiency in SQL and Azure data stack.
• Knowledge of Big Data and distributed processing.

Responsabilidades

• Design, develop, and optimize data pipelines across Bronze, Silver, Gold layers.
• Define data architecture standards ensuring governance and scalability.
• Implement CI/CD pipelines for data workflows.
• Monitor pipelines and tune Spark/Databricks performance.
• Ensure availability and quality of data for analytics teams.
• Analyze failures and propose durable structural fixes.
• Document architectures and best practices in DevOps Wiki and Visio.
• Act as technical reference and mentor Level I/II analysts.
• Collaborate with business teams to translate requirements into data solutions.

Conhecimentos

Data Ingestion

Data Transformation

Data Governance

Data Quality

Data Modeling

Big Data

Distributed Processing

Cloud Architecture

Automation

Performance Tuning

Collaboration

Mentoring

Problem Solving

Formação académica

Bachelor's degree in Information Systems, Computer Science, Software Engineering, or a related field

Postgraduate degree in a related field

Ferramentas

Azure DevOps

Visio

Spark

Azure Synapse

Azure Fabric

Descrição da oferta de emprego

Responsibilities

• Design, develop, and optimize complex data ingestion and transformation pipelines across multiple layers of the Data Lake (bronze, silver, and gold) using Azure Data Factory, Databricks, and dbt


• Define technical data architecture standards, ensuring governance, scalability, and alignment with Solar's business needs


• Implement automation and continuous integration/continuous delivery (CI/CD) processes for data workflows


• Monitor pipeline performance and perform advanced tuning of queries and distributed processes (Spark, Databricks)


• Ensure the availability and quality of critical data used by strategic business areas, Analytics, BI, and Data Science


• Analyze pipeline failures and propose structural solutions to recurring issues


• Document architectures, pipelines, and best practices in Azure DevOps Wiki, Visio, and other knowledge repositories


• Serve as a technical reference, supporting and mentoring Level I and Level II analysts


• Collaborate with business teams to translate requirements into technical data solutions

Requirements

• Bachelor's degree in Information Systems, Computer Science, Software Engineering, or a related field


• Solid experience in data engineering and the development of complex pipelines


• Experience with data governance, quality, and security processes


• Experience with Agile methodologies and continuous integration/continuous delivery (CI/CD)


• Proficiency in SQL, data modeling, and the Azure ecosystem (Data Factory, Databricks, Synapse, Fabric)


• Knowledge of Big Data, distributed processing, and cloud architecture


• Basic English proficiency


• Postgraduate degree in a related field (a plus)


• Certifications in data engineering or architecture (Azure Data Engineer, Databricks) (a plus)

Core Competencies

Demonstrates expertise in designing and optimizing data ingestion and transformation pipelines using Azure Data Factory, Databricks, and SQL, while ensuring data governance and quality. Proficient in implementing CI/CD processes and collaborating with business teams to deliver technical data solutions.

Highest-signal resume keywords

• Data Engineering


• Azure Data Factory


• Databricks


• SQL


• CI/CD

Hard Skills

• Data Ingestion


• Data Transformation


• Data Governance


• Data Quality


• Data Modeling


• Big Data


• Distributed Processing


• Cloud Architecture


• Automation


• Performance Tuning

Soft Skills

• Collaboration


• Mentoring


• Problem Solving

Certifications & Qualifications

• Azure Data Engineer


• Databricks

Industry Keywords

• Agile Methodologies


• Continuous Integration


• Continuous Delivery


• Data Lake


• Technical Data Architecture

Tools & Technologies

• Azure DevOps


• Visio


• Spark


• Azure Synapse


• Azure Fabric