COPE - Senior Data Engineer

FoodChain ID Group, Inc; Brasil; Presencial; BRL 80.000 - 120.000; Tempo integral

Resumo da oferta

A leading company in food technology is seeking a Data Engineer to enhance their data solutions and optimize large datasets. The ideal candidate will have extensive experience in Python and SQL, and will work collaboratively with teams to improve data processes. This role offers an exciting opportunity to lead technical designs in a dynamic environment while contributing to innovative projects.

Qualificações

• 7+ years of experience using Python for data tasks.
• Proficient in SQL and relational databases.
• College degree in CS or a related field is required.

Responsabilidades

• Create, extract, transform, and optimize large datasets.
• Develop and maintain data models and documentation.
• Collaborate with cross-functional teams in data settings.

Conhecimentos

Python

SQL

Data Engineering

Agile Development

Troubleshooting

Formação académica

College degree in Computer Science or related field

Ferramentas

Pandas

NumPy

SciPy

Oracle

Postgres

MS SQL Server

MongoDB

AWS

Azure

GCP

Terraform

Azure DevOps

Descrição da oferta de emprego

· Use Python and SQL to efficiently create, extract, transform, and optimize very large datasets.

· Troubleshoot data and data processes and develop solutions for improvement.

· Develop and maintain data models, schemas, and documentation.

· Contribute as a hands-on engineer while sometimes taking the lead in the technical design and solution.

· Collaborate daily with data scientists, food scientists, product owners, team members, API developers, architects, and DevOps engineers.

· Advise other developers, both junior and senior, and share best practices.

This job description is not intended to be all-inclusive. Employees may be asked to perform additional tasks as required, that may or may not be related to their primary duties.

Required Qualifications:

· Minimum 7 years’ experience using Python for analyzing, extracting, creating, and transforming large datasets.

· Proficiency in Python 3+ and common Python libraries for data engineering and data science, specifically Pandas, NumPy, and SciPy.

· Deep experience with SQL and relational data using Oracle, Postgres, or MS SQL Server.

· Solid understanding of database design principles, data modeling, and data warehousing concepts.

· Excellent troubleshooting skills and instincts.

· Curious, self-motivated, and self-directed; comfortable working within an Agile software development team with short, iterative delivery cycles.

· College degree or equivalent experience in computer science, software development, engineering, information systems, math, food science, or other applicable field of study.

Preferred Qualifications:

· NoSQL database design and development using MongoDB, AWS DynamoDB, or Azure Cosmos DB.

· Familiarity with cloud platforms (e.g., AWS, Azure, GCP) and services related to data storage/processing

· Exposure to Terraform or other Infrastructure-as-Code tooling.

· Proficient in Azure DevOps for source code and pipeline management.