Data Engineer – Senior

Jobtailor; São Paulo; Presencial; BRL 180 000 - 300 000; Tempo integral

Resumo da oferta

Jobtailor in São Paulo, Brazil seeks a senior data engineer to implement advanced data engineering solutions in Azure cloud, Databricks, and secure data governance.

You will design data integration strategies, ensure data quality, and promote best practices in software development, CI/CD, and documentation.

Qualificações

• Degree in Engineering, Computer Science, Mathematics, or Statistics, preferably in a STEM/quantitative field.
• Minimum of 8 years of experience in IT with software development.
• Experience in cloud programming.
• Familiarity with the Microsoft Azure environment.
• Strong knowledge of the Databricks platform, including Genie, Lakeflow Jobs, and other features.
• Experience with Azure SQL Database.
• Experience with Azure Data Lake.
• Strong proficiency in Python and SQL.
• Experience in software development and applying best practices, including documentation, version control, unit testing, clean code, and CI/CD.
• Familiarity with data administration and data governance.
• Nice to have: knowledge of Data Mesh.
• Nice to have: understanding of LGPD (Brazil's General Data Protection Law).
• Nice to have: Microsoft Azure certification.
• Nice to have: experience with API development.

Responsabilidades

• Implement advanced data engineering solutions using agile methodologies and industry best practices.
• Improve the company’s data analysis productivity and process performance.
• Design and execute data integration strategies.
• Ensure data quality and information security.

Conhecimentos

Data Engineering

Python

SQL

Azure Cloud

Databricks

CI/CD

Formação académica

Engineering / Computer Science / Mathematics / Statistics degree

Ferramentas

Azure SQL Database

Azure Data Lake

Genie

Lakeflow Jobs

Descrição da oferta de emprego

• Implement advanced data engineering solutions using agile methodologies and industry best practices
• Improve the company’s data analysis productivity and process performance
• Design and execute data integration strategies
• Ensure data quality and information security

Requirements

• Degree in Engineering, Computer Science, Mathematics, or Statistics, preferably in a STEM/quantitative field
• Minimum of 8 years of experience in IT with software development
• Experience in cloud programming
• Familiarity with the Microsoft Azure environment
• Strong knowledge of the Databricks platform, including Genie, Lakeflow Jobs, and other features
• Experience with Azure SQL Database
• Experience with Azure Data Lake
• Strong proficiency in Python and SQL
• Experience in software development and applying best practices, including documentation, version control, unit testing, clean code, and CI/CD
• Familiarity with data administration and data governance
• Nice to have: knowledge of Data Mesh
• Nice to have: understanding of the basic principles of LGPD (Brazil's General Data Protection Law)
• Nice to have: Microsoft Azure certification
• Nice to have: experience with API development

Core Competencies

Demonstrates expertise in advanced data engineering solutions, focusing on data integration strategies, data quality, and information security within cloud environments. Proficient in Python, SQL, and the Microsoft Azure ecosystem, with a strong emphasis on best practices in software development.

Highest-signal resume keywords

• Data Engineering Solutions
• Microsoft Azure Environment
• Databricks Platform
• Python Programming
• SQL Proficiency

ATS Optimization Keywords

Hard Skills

• Data Integration Strategies
• Cloud Programming
• Software Development Best Practices
• Data Administration
• Data Governance

Certifications & Qualifications

• Microsoft Azure Certification

Industry Keywords

• Agile Methodologies
• Data Mesh
• LGPD

Tools & Technologies

• Azure SQL Database
• Azure Data Lake
• Genie
• Lakeflow Jobs