Data Engineer

Vista Applied Solutions Group Inc; Teletrabalho; BRL 100.000 - 130.000; Tempo integral

Resumo da oferta

A leading technology firm in Brazil is seeking a Data Engineer to enhance data pipeline resilience and operational stability. The role focuses on developing and integrating technologies for improved reliability, conducting analysis, and supporting a global team. Ideal candidates will have a degree in Engineering or Computer Science, experience with SQL, Python, and Google Cloud Platform (GCP), and strong analytical skills. This position offers a unique chance to impact data governance and operational efficiency.

Qualificações

• Proven experience in systems support, data pipelines, and database reliability engineering.
• Strong background in designing monitoring and logging solutions.
• Hands-on experience with GCP data technologies and monitoring tools.

Responsabilidades

• Design and develop production support technologies to enhance data pipeline reliability.
• Proactively implement solutions to improve pipeline resilience.
• Conduct statistical analysis of pipeline performance and incidents.
• Collaborate with global teams to troubleshoot data pipeline issues.

Conhecimentos

Organized

Proactive

Curious

Sense of urgency

Prioritization

Ownership

Formação académica

Degree in Engineering or Computer Science

Ferramentas

Google Cloud Platform (GCP)

SQL

Python

BigQuery

Dataflow

Grafana

Cloud Monitoring

Looker

Power BI

Tableau

Descrição da oferta de emprego

• We are seeking a Data Engineer to enhance the resilience and operational stability of our data pipelines, from factory floor to cloud repositories. This critical role will focus on building robust monitoring and support systems, and on accelerating our ability to understand and resolve system and pipeline breakdowns

Responsibilities

• Design, develop, and integrate production support technologies and systems to improve data pipeline reliability.
• Proactively identify vulnerabilities and implement systemic process oriented solutions to enhance pipeline resilience.
• Develop and apply advanced analytics for proactive pipeline monitoring, anomaly detection, and performance optimization.
• Conduct in-depth statistical analysis of pipeline performance, incident data, and root causes to drive continuous improvement.
• Prepare and maintain comprehensive reports and dashboards with key performance indicators (KPIs) for measuring system and pipeline resiliency.
• Collaborate with global team of data analysts, engineers, and leaders to rapidly troubleshoot and resolve data pipeline issues.
• Interface with corporate areas, preparing technical documentation, reports, and presentations on pipeline health and improvements.
• Maintain accurate and up-to-date documentation for systems, processes, and troubleshooting guides.
• Assist in meeting data environment governance requirements, specifically related to pipeline data quality and integrity.

Knowledge and Technical Competencies

• Soft skills: Organized, proactive, curious, sense of urgency and prioritization, and a strong feeling of ownership.

Technical expertise

• Proven experience in systems support, data pipelines, database reliability engineering, and IT production support.
• Strong background in designing and implementing monitoring, alerting, and logging solutions.
• Proficiency with cloud platforms, specifically Google Cloud Platform (GCP).
• Experience with industrial data historians (e.g., OSI Soft PI) and API data extraction.

Experience

• Background: Degree in Engineering or Computer Science.

Technical Skills

• Proficiency in SQL (queries) and a scripting language (e.g., Python) for data analysis and automation.
• Hands-on experience with GCP data technologies (e.g., BigQuery, Dataflow) and monitoring tools (e.g., Grafana, Cloud Monitoring).
• Familiarity with business intelligence tools (e.g., Looker, Power BI, Tableau) for dashboarding.
• Desirable: Knowledge of process industry KPIs. Familiarity with data governance platforms (e.g., Collibra) and data transformation tools (e.g., Dataform).
• Multilingual English/Spanish/Portuguese would be a plus
• Experience with Production Support would be a plus