Data Engineer

Vista Applied Solutions Group Inc; Itatiba; Presencial; BRL 80.000 - 120.000; Tempo integral

Resumo da oferta

A leading solutions provider in São Paulo is seeking a Data Engineer to enhance the resilience and operational stability of data pipelines. The role involves designing support technologies, identifying vulnerabilities, and developing analytics for performance optimization. Candidates should have a degree in Engineering or Computer Science, proven experience in data engineering, and proficiency with GCP and SQL. The position requires strong soft skills, proactive problem-solving, and ability to collaborate effectively.

Qualificações

• Proven experience in systems support, data pipelines, and IT production support.
• Strong background in designing monitoring and alerting solutions.
• Proficiency in data analysis and automation using SQL and a scripting language.
• Hands-on experience with GCP data technologies and monitoring tools.

Responsabilidades

• Design and develop technologies to improve data pipeline reliability.
• Identify vulnerabilities and enhance pipeline resilience.
• Develop advanced analytics for pipeline monitoring and performance optimization.
• Prepare comprehensive reports and KPIs for measuring resilience.
• Collaborate with global teams to troubleshoot and resolve issues.

Conhecimentos

Organized

Proactive

Curious

Sense of urgency

Prioritization

Ownership

Formação académica

Degree in Engineering or Computer Science

Ferramentas

SQL

Python

Google Cloud Platform (GCP)

Grafana

BigQuery

Looker

Power BI

Tableau

Descrição da oferta de emprego

• We are seeking a Data Engineer to enhance the resilience and operational stability of our data pipelines, from factory floor to cloud repositories. This critical role will focus on building robust monitoring and support systems, and on accelerating our ability to understand and resolve system and pipeline breakdowns

Responsibilities

• Design, develop, and integrate production support technologies and systems to improve data pipeline reliability.
• Proactively identify vulnerabilities and implement systemic process oriented solutions to enhance pipeline resilience.
• Develop and apply advanced analytics for proactive pipeline monitoring, anomaly detection, and performance optimization.
• Conduct in-depth statistical analysis of pipeline performance, incident data, and root causes to drive continuous improvement.
• Prepare and maintain comprehensive reports and dashboards with key performance indicators (KPIs) for measuring system and pipeline resiliency.
• Collaborate with global team of data analysts, engineers, and leaders to rapidly troubleshoot and resolve data pipeline issues.
• Interface with corporate areas, preparing technical documentation, reports, and presentations on pipeline health and improvements.
• Maintain accurate and up-to-date documentation for systems, processes, and troubleshooting guides.
• Assist in meeting data environment governance requirements, specifically related to pipeline data quality and integrity.

Knowledge and Technical Competencies

• Soft skills: Organized, proactive, curious, sense of urgency and prioritization, and a strong feeling of ownership.

Technical expertise

• Proven experience in systems support, data pipelines, database reliability engineering, and IT production support.
• Strong background in designing and implementing monitoring, alerting, and logging solutions.
• Proficiency with cloud platforms, specifically Google Cloud Platform (GCP).
• Experience with industrial data historians (e.g., OSI Soft PI) and API data extraction.

Experience

• Background: Degree in Engineering or Computer Science.

Technical Skills

• Proficiency in SQL (queries) and a scripting language (e.g., Python) for data analysis and automation.
• Hands-on experience with GCP data technologies (e.g., BigQuery, Dataflow) and monitoring tools (e.g., Grafana, Cloud Monitoring).
• Familiarity with business intelligence tools (e.g., Looker, Power BI, Tableau) for dashboarding.
• Desirable: Knowledge of process industry KPIs. Familiarity with data governance platforms (e.g., Collibra) and data transformation tools (e.g., Dataform).
• Multilingual English/Spanish/Portuguese would be a plus
• Experience with Production Support would be a plus