Data Engineer

Vista Applied Solutions Group Inc; Lucas do Rio Verde; Presencial; BRL 80.000 - 120.000; Tempo integral

Resumo da oferta

A leading solutions provider in Brazil is seeking a skilled Data Engineer to enhance the resilience and operational stability of their data pipelines. The successful candidate will design and implement support technologies, analyze pipeline performance, and collaborate with global teams to resolve issues. Key competencies include proficiency in SQL, experience with Google Cloud Platform, and tools for data monitoring and analysis. This position requires a degree in Engineering or Computer Science and offers opportunities for impactful contributions in data management.

Qualificações

• Proven experience in systems support and data pipelines.
• Strong background in database reliability engineering.
• Experience with industrial data historians and API data extraction.

Responsabilidades

• Design and develop production support technologies.
• Implement solutions to enhance data pipeline reliability.
• Prepare reports and dashboards with key performance indicators.

Conhecimentos

Proficiency in SQL

Experience with Python scripting

Experience with GCP data technologies

Proficiency in using monitoring tools

Knowledge of process industry KPIs

Multilingual (English/Spanish/Portuguese)

Formação académica

Degree in Engineering or Computer Science

Ferramentas

GCP (Google Cloud Platform)

BigQuery

Dataflow

Grafana

Tableau

Power BI

Descrição da oferta de emprego

• We are seeking a Data Engineer to enhance the resilience and operational stability of our data pipelines, from factory floor to cloud repositories. This critical role will focus on building robust monitoring and support systems, and on accelerating our ability to understand and resolve system and pipeline breakdowns

Responsibilities

• Design, develop, and integrate production support technologies and systems to improve data pipeline reliability.
• Proactively identify vulnerabilities and implement systemic process oriented solutions to enhance pipeline resilience.
• Develop and apply advanced analytics for proactive pipeline monitoring, anomaly detection, and performance optimization.
• Conduct in-depth statistical analysis of pipeline performance, incident data, and root causes to drive continuous improvement.
• Prepare and maintain comprehensive reports and dashboards with key performance indicators (KPIs) for measuring system and pipeline resiliency.
• Collaborate with global team of data analysts, engineers, and leaders to rapidly troubleshoot and resolve data pipeline issues.
• Interface with corporate areas, preparing technical documentation, reports, and presentations on pipeline health and improvements.
• Maintain accurate and up-to-date documentation for systems, processes, and troubleshooting guides.
• Assist in meeting data environment governance requirements, specifically related to pipeline data quality and integrity.

Knowledge and Technical Competencies

• Soft skills: Organized, proactive, curious, sense of urgency and prioritization, and a strong feeling of ownership.

Technical expertise

• Proven experience in systems support, data pipelines, database reliability engineering, and IT production support.
• Strong background in designing and implementing monitoring, alerting, and logging solutions.
• Proficiency with cloud platforms, specifically Google Cloud Platform (GCP).
• Experience with industrial data historians (e.g., OSI Soft PI) and API data extraction.

Experience

• Background: Degree in Engineering or Computer Science.

Technical Skills

• Proficiency in SQL (queries) and a scripting language (e.g., Python) for data analysis and automation.
• Hands-on experience with GCP data technologies (e.g., BigQuery, Dataflow) and monitoring tools (e.g., Grafana, Cloud Monitoring).
• Familiarity with business intelligence tools (e.g., Looker, Power BI, Tableau) for dashboarding.
• Desirable: Knowledge of process industry KPIs. Familiarity with data governance platforms (e.g., Collibra) and data transformation tools (e.g., Dataform).
• Multilingual English/Spanish/Portuguese would be a plus
• Experience with Production Support would be a plus