Data Engineer

Vista Applied Solutions Group Inc; Curitiba; Presencial; BRL 60.000 - 90.000; Tempo integral

Resumo da oferta

A technology solutions provider is seeking a Data Engineer to enhance data pipeline resilience and operational stability, from factory floor to cloud. This role involves designing production support technologies, conducting statistical analyses, and preparing KPI reports. Candidates should have a degree in Engineering or Computer Science and strong expertise in SQL and Google Cloud Platform. Experience with monitoring tools and business intelligence solutions is preferred. Excellent communication skills in English, Spanish, or Portuguese are a plus.

Qualificações

• Experience in systems support and database reliability engineering.
• Strong background in monitoring and logging solutions.
• Hands-on experience with data technologies and monitoring tools.

Responsabilidades

• Design and develop technologies to improve data pipeline reliability.
• Identify vulnerabilities and implement solutions to enhance resilience.
• Conduct statistical analysis of pipeline performance and incidents.
• Prepare reports and dashboards with KPIs for data resilience.

Conhecimentos

Proficiency in SQL

Scripting language (e.g., Python)

GCP data technologies (e.g., BigQuery, Dataflow)

Monitoring tools (e.g., Grafana, Cloud Monitoring)

Business intelligence tools (e.g., Looker, Power BI, Tableau)

Multilingual (English/Spanish/Portuguese)

Formação académica

Degree in Engineering or Computer Science

Ferramentas

Google Cloud Platform

OSI Soft PI

Descrição da oferta de emprego

Job Summary:

• We are seeking a Data Engineer to enhance the resilience and operational stability of our data pipelines, from factory floor to cloud repositories. This critical role will focus on building robust monitoring and support systems, and on accelerating our ability to understand and resolve system and pipeline breakdowns

Responsibilities:

• Design, develop, and integrate production support technologies and systems to improve data pipeline reliability.
• Proactively identify vulnerabilities and implement systemic process oriented solutions to enhance pipeline resilience.
• Develop and apply advanced analytics for proactive pipeline monitoring, anomaly detection, and performance optimization.
• Conduct in-depth statistical analysis of pipeline performance, incident data, and root causes to drive continuous improvement.
• Prepare and maintain comprehensive reports and dashboards with key performance indicators (KPIs) for measuring system and pipeline resiliency.
• Collaborate with global team of data analysts, engineers, and leaders to rapidly troubleshoot and resolve data pipeline issues.
• Interface with corporate areas, preparing technical documentation, reports, and presentations on pipeline health and improvements.
• Maintain accurate and up-to-date documentation for systems, processes, and troubleshooting guides.
• Assist in meeting data environment governance requirements, specifically related to pipeline data quality and integrity.

Knowledge and Technical Competencies:

• Soft skills: Organized, proactive, curious, sense of urgency and prioritization, and a strong feeling of ownership.

Technical expertise:

• Proven experience in systems support, data pipelines, database reliability engineering, and IT production support.
• Strong background in designing and implementing monitoring, alerting, and logging solutions.
• Proficiency with cloud platforms, specifically Google Cloud Platform (GCP).
• Experience with industrial data historians (e.g., OSI Soft PI) and API data extraction.

Experience:

• Background: Degree in Engineering or Computer Science.

Technical Skills:

• Proficiency in SQL (queries) and a scripting language (e.g., Python) for data analysis and automation.
• Hands‑on experience with GCP data technologies (e.g., BigQuery, Dataflow) and monitoring tools (e.g., Grafana, Cloud Monitoring).
• Familiarity with business intelligence tools (e.g., Looker, Power BI, Tableau) for dashboarding.
• Desirable: Knowledge of process industry KPIs. Familiarity with data governance platforms (e.g., Collibra) and data transformation tools (e.g., Dataform).
• Multilingual English/Spanish/Portuguese would be a plus
• Experience with Production Support would be a plus