Data Engineer

Quartile LLC; Brasil; Teletrabalho; BRL 80.000 - 120.000; Tempo integral

Resumo da oferta

Quartile LLC is seeking a Data Engineer to join their Data Engineering Team. In this fully remote role, you will develop data pipelines utilizing APIs from major marketing companies, implementing cutting-edge technologies and improving data architecture. Candidates should have strong proficiency in Python and experience with cloud services like AWS or Azure.

Serviços

Fully remote work

Generous Paid Time Off

Opportunity to join an international team

Qualificações

• Experience with Pyspark, Spark or Scala.
• Solid Experience with Python.
• Proficiency in English (Advanced to Fluent Level).

Responsabilidades

• Develop Data Pipelines in Python using APIs.
• Create monitoring systems for pipelines.
• Design Architecture for new ETLs.

Conhecimentos

Pyspark

Python

Relational databases

Cloud Architecture

Data Lake/Delta Lake

Machine Learning

Object Oriented programming

Descrição da oferta de emprego

Quartile, the world's largest retail media optimization platform, is a trusted partner for multichannel e-commerce success. Through unmatchedexpertiseand patented AI technology, we fuel growth for 5,300+ brands and sellers worldwide and manage an annual ad spend exceeding$2 billion. The award-winning platform covers major marketplaces and ad channels foroptimalreach. The result is unprecedented granularity, smarter budgeting, and bespoke solutions for retailers.

Quartile is proud to be an equal opportunity employer with employees stemming from a wide range of backgrounds and experiences. As a business, we value the enrichment that diversity brings to our organization and are committed to a culture that creates a sense of inclusion and belonging. We welcome new perspectives and affirm that all employment decisions are made without regard to race, color, ancestry, religion, national origin, age, familial or marital status, sex, sexual orientation, pregnancy, gender identity or expression, disability, genetic information, veteran status, or any other classification protected by federal, state, or local law.

OVERVIEW:
We are looking for a Data Engineer to join our Data Engineering Team!

As a Data Engineer, you will join the team responsible for designing and implementing cutting edge technologies to develop data pipelines from the most important advertising channel of the world (Amazon, Google, Facebook, Instacart, Walmart and others), being awarded by Amazon as the best US Scaled Technology of 2022.

REQUIREMENTS:

• Experience with Pyspark, Spark or Scala
• Relational databases (MySQL, PostgreSQL, AWS RDS)
• Profiling backend services and databases and improving their performance
• Experience with Tests (unit, manual, integration, E2E…) and good documentations
• Solid Experience with Python (APIs, Data Modeling, Classes)
• Knowledge of Cloud Architecture (Azure or AWS)
• Experience working with Data Lake/Delta Lake Housing
• Proficiency in English is required - Advanced to Fluent Level

….. If youreachedthis point, we hopeyou'refeeling excited about the job description.We'reeager to meet people that believe in Quartile's mission and can contribute to our team in a variety of ways. Feel welcome to apply!

PREFERRED QUALIFICATIONS:

• Experience with Machine Learning for engineering
• Experience with Databricks
• Experience with Terraform
• Experience with OAuth Authentication Workflow
• Experience with Topics and Queues Architecture (Kafka, Event Hub, Service Bus)
• Experience with Object Oriented languages like Scala or Java
• Understanding of E-commerce and Marketing area
• Good teamwork and positive mindset

WHAT YOU’LL DO:

As a Data Engineer you will:

• Develop Data Pipelines in Python using APIs from world leading marketing companies
• Create monitoring systems for pipelines
• Design Architecture for new ETLs in Databricks or Azure Functions
• Consume data from Azure Data Lake to generate requests to APIs
• Develop integrated tests for QA

BENEFITS:

• Fully remote work
• The opportunity to join an international team
• Generous Paid Time Off

This is a PJ contract based out in Brazil.