Data Engineer - Remote, Latin America

Bluelight; Belo Horizonte; Teletrabalho; BRL 167 400 - 279 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Competitive salary and bonuses

Generous paid-time-off policy

Technology / Office stipend

Health Coverage

Flexible working hours

Continuing education, training, conferences

Company-sponsored coursework, exams, and certifications

Resumo da oferta

A leading software consultancy is seeking a Data Engineer to develop and maintain data models for core applications. The role involves monitoring data pipelines and collaborating with teams to improve data accessibility. Ideal candidates should have experience with AWS, strong problem-solving skills, and a degree in Computer Science or a related field. The position offers competitive salary, flexible working hours, and health coverage.

Qualificações

• Experience with AWS services is crucial.
• Strong knowledge of data integration and database technologies is needed.
• Must have excellent problem-solving skills and communication abilities.

Responsabilidades

• Develop and maintain data models for core applications and databases.
• Monitor and optimize daily data pipelines and resolve issues.
• Collaborate with teams to improve data accessibility.

Conhecimentos

AWS services (S3, Athena, EC2, EMR, Glue)

Data integration from multiple sources

Problem-solving and troubleshooting

Excellent communication skills

Knowledge of data governance and quality principles

Agile Software Development methodologies

Familiarity with Web Services (XML, REST, SOAP)

Formação académica

BS or MS degree in Computer Science or a related technical field

Ferramentas

SQLServer

Postgres

Redshift

Git

Descrição da oferta de emprego

Job Overview

Bluelight Consulting is a leading software consultancy dedicated to designing and developing innovative technology that enhances users' lives. With a steadfast commitment to delivering exceptional service to our clients, Bluelight excels in its focus on quality and customer satisfaction.

We are looking for a skilled individual to join our rapidly growing team at Bluelight Consulting as a Data Engineer. This position is ideal for someone who thrives in a fast-paced, dynamic environment where everyone's opinions and efforts are valued and appreciated.

Responsibilities

• Develop and maintain data models for core package application and reporting databases to describe objects and fields for support documentation and to facilitate custom application development and data integration.
• Monitor execution and performance of daily pipelines, triage and escalate any issues.
• Collaborate with analytics and business teams to improve data models and data pipelines that feed business intelligence tools, increasing data accessibility and fostering data-driven decision-making across the organization.
• Implement processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes.
• Write unit/integration tests, contribute to engineering wiki, and document work.
• Perform data analysis required to troubleshoot data-related issues and assist in the resolution of data issues.
• Work within AWS/Linux cloud systems environment in support of data integration solution.
• Work closely with a team of frontend and backend engineers, product managers, and analysts.

Requirements

• Experience with AWS services including but not limited to S3, Athena, EC2, EMR, and Glue.
• Ability to solve any ongoing issues with operating the cluster.
• Experience with the integration of data from multiple data sources.
• Experience with various database technologies such as SQLServer, Redshift, Postgres, and RDS.
• Experience with one or more of the following data integration platforms: Pentaho Kettle, SnapLogic, Talend OpenStudio, Jitterbit, Informatica PowerCenter, or similar.
• Knowledge of best practices and IT operations in an always-up, always-available service.
• Experience with or knowledge of Agile Software Development methodologies.
• Excellent problem-solving and troubleshooting skills.
• Excellent oral and written communication skills with a keen sense of customer service.
• Experience with collecting/managing/reporting on large data stores.
• Awareness of Data governance and data quality principles.
• Well-versed in Business Analytics including basic metric building and troubleshooting.
• Understand Integration architecture: application integration and data flow diagrams, source-to-target mappings, data dictionary reports.
• Familiar with Web Services: XML, REST, SOAP.
• Experience with Git or similar version control software.
• Experience with integrations with and/or use of BI tools such as GoodData (preferred), Tableau, PowerBI, or similar.
• Broad experience with multiple RDBMS: MS SQLServer, Oracle, MySQL, PostgreSQL, Redshift.
• Familiarity with SaaS/cloud data systems (e.g. Salesforce).
• Data warehouse design: star-schemas, change data capture, denormalization.
• SQL/DDL queries/Tuning techniques such as indexing, sorting, and distribution.
• BS or MS degree in Computer Science or a related technical field.
• 3+ years of Data Pipeline development such as SnapLogic or Datastage, Informatica, or related experience.
• 3+ years of SQL experience (No-SQL experience is a plus).

Company Benefits

• Competitive salary and bonuses, including performance-based salary increases.
• Generous paid-time-off policy.
• Technology / Office stipend.
• Health Coverage.
• Flexible working hours.
• Work remotely.
• Continuing education, training, conferences.
• Company-sponsored coursework, exams, and certifications.