Sr. Big Data Engineer

Tecla; Teletrabalho; BRL 80.000 - 120.000; Tempo integral

Resumo da oferta

A technology company is seeking a Senior Big Data Engineer to enhance customer data accuracy and availability. This fully remote role demands strong expertise in Python, Apache Airflow, and Spark technologies. The engineer will manage high-performance data services and support personalized marketing initiatives. A structured work-life balance is promoted. Benefits include generous paid time off. Salary ranges from $4,000 to $5,000 USD monthly. Contract is for 3 months, potentially extendable based on team needs.

Serviços

Fully remote position

Two weeks of paid vacation

10 paid local holidays

Qualificações

• 5+ years of professional experience as a Data Engineer or in a related role.
• Strong experience with Python programming.
• Hands-on experience with Apache Airflow.
• Experience working with Scala language.
• Experience with Spark technologies including Spark SQL and Spark Streaming.
• Experience designing with relational and NoSQL databases.
• Direct experience using Apache Kafka.
• Strong ability to write complex SQL queries.
• Experience with Google Cloud Platform services like BigQuery and BigTable.
• Experience working with RESTful APIs within data pipelines.

Responsabilidades

• Ensure customer data is accurate and readily accessible.
• Manage high-performance batch and real-time services for customer interactions.
• Support personalized marketing and analytical reporting.
• Leverage modern development practices and tools.

Conhecimentos

Professional experience as a Data Engineer

Strong experience with Python

Hands-on experience with Airflow

Experience with Scala

Experience with Spark, Spark SQL, and Spark Streaming

Ability to design and work with databases

Experience using Apache Kafka

Ability to write complex SQL queries

Experience with GCP (BigQuery, BigTable, Dataproc)

Experience with RESTful APIs in data pipelines

Ferramentas

Python

Apache Airflow

Apache Spark

GCP

SQL

Descrição da oferta de emprego

Native / Bilingual English is required for this role (read / written / spoken)

Please upload your CV Resume in English.

Monthly salary: $4,000 - $5,000 USD

Along with our partner, we are seeking a Senior Big Data Engineer to join the Customer Identity (CI) team that is central to the enterprise, focused on ensuring customer data is accurate, consistent, and readily accessible. This critical data is the foundation for essential business processes, including personalized marketing, analytical reporting, and seamless online and in-store checkout and customer service experiences.

They manage a wide array of high-performance, scalable batch and real-time services. These services are utilized at numerous customer interactions, such as in-store purchases, online orders, rewards program enrollments, and activations from various marketing channels (Email, Direct Mail, SMS, Push notifications, etc.). By leveraging modern development practices, tools, and technology platforms, the CI team builds capabilities that empower customer-facing and checkout teams to deliver personalized, relevant, and frictionless experiences, ensuring customers realize value with every interaction.

Core hours

This team operates in every major US time zone from Pacific to Eastern. Core hours would be considered 10 am CST - 4 pm CST with 2 hours spilling over either direction based on location.

Required Skills

Non‑Negotiable Requirements

• 5+ years of professional experience as a Data Engineer or in a closely related role.
• Strong experience with Python.
• Hands‑on experience with Airflow.
• Experience working with Scala.
• Experience with Spark, Spark SQL, and Spark Streaming.
• Experience designing and working with relational and NoSQL databases.
• Direct experience using Apache Kafka.
• Strong ability to write complex SQL queries.
• Experience with GCP, including BigQuery, BigTable, and Dataproc.
• Experience working with RESTful APIs in data pipelines.

Tech Stack

Python, Apache Airflow, Apache Spark, Spark SQL, Spark Streaming, Kafka, Relational Databases, NoSQL Databases, GCP BigQuery, BigTable, Dataproc, RESTful APIs.

Bonus Skills

• Experience with Databriks, Snowflake, Java, Springboot.

Duration

3 months; end date being March 31, 2026, with the possibility of being extended based on team needs.

Benefits

• A fully remote position with a structured schedule that supports work‑life balance.
• The opportunity to join a leading retail innovator transforming the shopping experience through cutting‑edge technology.
• Two weeks of paid vacation per year.
• 10 paid days for local holidays.

• Please note our partner is only looking for full‑time dedicated team members who are eager to fully integrate within their team.