Data Engineer

Calyptus; Manaus; Presencial; BRL 80.000 - 120.000; Tempo integral

Resumo da oferta

A technology company based in Manaus, Brazil, is seeking a data engineer with over 3 years of experience in data engineering within enterprise environments. The ideal candidate will have strong proficiency in Python and SQL, along with experience in ETL/ELT tools and cloud platforms like AWS, Azure, or GCP. This role involves designing data pipelines, establishing data governance, and collaborating with data scientists to meet model requirements. The position offers a dynamic work environment focused on AI processing and data integration.

Responsabilidades

• Design and build data pipelines that integrate diverse enterprise data sources for AI processing.
• Develop connectors and adapters for enterprise systems like CRM, ERP, and databases.
• Implement data quality frameworks and validation systems for AI model inputs.
• Create secure data handling workflows that support global development teams.
• Build data transformation pipelines for unstructured and structured data.
• Establish data governance and lineage tracking for compliance and audits.
• Optimize data processing workflows for scale and performance.
• Collaborate with data scientists and AI engineers to ensure data meets model requirements.

Conhecimentos

Data engineering

Python

SQL

ETL / ELT tools

Data integration

APIs (REST, GraphQL, SOAP)

Data privacy and security

Cloud platforms (AWS, Azure, GCP)

Containerization tools

Formação académica

Bachelor's degree in Computer Science, Engineering, Data Science, or related field

Descrição da oferta de emprego

Qualifications

• 3+ years experience with data engineering in enterprise environments


• Strong proficiency in Python and SQL for data processing and transformation


• Experience with ETL / ELT tools and data integration patterns


• Knowledge of enterprise data standards and APIs (REST, GraphQL, SOAP)


• Understanding of data privacy, security, and access control best practices


• Experience with cloud platforms (AWS, Azure, GCP) and data infrastructure


• Familiarity with containerization and orchestration tools


• Bachelor's degree in Computer Science, Engineering, Data Science, or related field

Day-to-Day Activities

• Design and build data pipelines that integrate diverse enterprise data sources for AI processing


• Develop connectors and adapters for enterprise systems (CRM, ERP, document management, databases)


• Implement data quality frameworks and validation systems for AI model inputs


• Create secure data handling workflows that support global development teams


• Build data transformation pipelines that prepare unstructured and structured data for AI models


• Establish data governance and lineage tracking for compliance and audit requirements


• Optimize data processing workflows for scale and performance


• Collaborate with data scientists and AI engineers to ensure data meets model requirements