Data Engineer

Calyptus; Salvador; Presencial; BRL 80.000 - 120.000; Tempo integral

Resumo da oferta

A leading data solutions firm in Brazil seeks a skilled Data Engineer to design and build robust data pipelines, optimize data workflows, and ensure data quality for AI models. The ideal candidate has over 3 years of experience in data engineering, is proficient in Python and SQL, and possesses a strong understanding of cloud platforms like AWS or Azure. A Bachelor's degree in a related field is required. Join us to work on cutting-edge data integration projects in a collaborative, dynamic environment.

Qualificações

• 3+ years experience with data engineering in enterprise environments.
• Strong proficiency in Python and SQL for data processing and transformation.
• Experience with ETL / ELT tools and data integration patterns.

Responsabilidades

• Design and build data pipelines that integrate diverse enterprise data sources for AI processing.
• Develop connectors and adapters for enterprise systems (CRM, ERP, document management, databases).
• Implement data quality frameworks and validation systems for AI model inputs.
• Create secure data handling workflows that support global development teams.
• Build data transformation pipelines that prepare unstructured and structured data for AI models.
• Establish data governance and lineage tracking for compliance and audit requirements.
• Optimize data processing workflows for scale and performance.
• Collaborate with data scientists and AI engineers to ensure data meets model requirements.

Conhecimentos

Data engineering experience

Python

SQL

ETL / ELT tools

Data integration patterns

APIs (REST, GraphQL, SOAP)

Data privacy practices

Cloud platforms (AWS, Azure, GCP)

Containerization

Orchestration tools

Formação académica

Bachelor's degree in Computer Science, Engineering, Data Science, or related field

Descrição da oferta de emprego

You’re a perfect match if you have :

• 3+ years experience with data engineering in enterprise environments
• Strong proficiency in Python and SQL for data processing and transformation
• Experience with ETL / ELT tools and data integration patterns
• Knowledge of enterprise data standards and APIs (REST, GraphQL, SOAP)
• Understanding of data privacy, security, and access control best practices
• Experience with cloud platforms (AWS, Azure, GCP) and data infrastructure
• Familiarity with containerization and orchestration tools
• Bachelor's degree in Computer Science, Engineering, Data Science, or related field

Your day-to-day activities :

• Design and build data pipelines that integrate diverse enterprise data sources for AI processing
• Develop connectors and adapters for enterprise systems (CRM, ERP, document management, databases)
• Implement data quality frameworks and validation systems for AI model inputs
• Create secure data handling workflows that support global development teams
• Build data transformation pipelines that prepare unstructured and structured data for AI models
• Establish data governance and lineage tracking for compliance and audit requirements
• Optimize data processing workflows for scale and performance
• Collaborate with data scientists and AI engineers to ensure data meets model requirements