Senior Data Engineer - Remote Brazil | AWS & Spark

KnowBe

United States

À distance

USD 54 000 - 69 000

Plein temps

14 jours+

Une candidature complète en une minute

Un CV et une lettre de motivation personnalisés, prêts à envoyer.

Passez les filtres ATS

Avantages offerts par ce poste

Monthly bonuses based on targets
Employee referral bonuses
Tuition reimbursement
Certification reimbursement

Résumé du poste

KnowBe4 is seeking a Data Platform Engineer for a Brazil-based role in São Paulo. You will own production Spark streaming workloads on AWS, leveraging Delta Lake or Apache Iceberg, and design robust data pipelines with stateful processing and schema evolution.

The position requires strong Python, IaC, and data modeling skills, with a focus on building agentic tooling and scalable, reliable streaming platforms for cross-functional teams.

Qualifications

  • Experience owning production Spark streaming workloads, including orchestration, checkpointing, monitoring and failure recovery.
  • Python you’d put your name on: tested, typed, reviewed and shipped through CI.
  • AWS fluency and comfort reading and changing infrastructure as code.
  • Hands-on experience with modern table formats, including upserts, schema evolution and the maintenance they need.
  • Strong data modelling judgement, including knowing the tradeoffs and limits of a design.
  • Experience with event-stream or CDC ingestion, and the de-duplication and ordering problems that come with it.
  • The ability to take a vague stakeholder request, work out the real question, come back with a design, and explain the result and its caveats to people who don’t read code.
  • The judgement to spot what the platform needs before anyone files a ticket, scope it and make the case for it, including new technologies where they would serve us better.
  • A track record of raising the bar around you: reviewing, mentoring and setting conventions a team actually follows.
  • Interest in or experience building, agentic tooling for engineering work itself: scaffolding, change detection, triage and review loops.
  • Clear verbal and written English communication skills to collaborate effectively across international teams.

Responsabilités

  • Architect, deploy, and operate production near real-time streaming workloads on AWS from ingestion to analytical serving layers.
  • Model complex event streams through bronze/silver/gold medallion architectures using modern open table formats (Delta Lake, Apache Iceberg).
  • Implement robust checkpointing, state recovery, schema evolution, and deduplication to safeguard against silent data corruption and ordering anomalies.
  • Develop internal developer agents and automation loops (scaffolding, change detection, quality circuit breakers, and alert triage).
  • Spot platform bottlenecks, architectural debt, or emerging technologies before anyone files a ticket—scope the solution and champion it to production.

Connaissances

Spark streaming
Python
AWS
Data modeling
English communication

Outils

Delta Lake
Apache Iceberg
CI/CD

Description du poste

KnowBe4 is seeking a Data Platform Engineer for a Brazil-based role in São Paulo. You will own production Spark streaming workloads on AWS, leveraging Delta Lake or Apache Iceberg, and design robust data pipelines with stateful processing and schema evolution.

The position requires strong Python, IaC, and data modeling skills, with a focus on building agentic tooling and scalable, reliable streaming platforms for cross-functional teams.

Obtenez votre examen gratuit et confidentiel de votre CV.

ou faites glisser et déposez votre fichier ici.

Similar jobs

Postes similaires à comparer

Senior Data Engineer (Remote in Brazil)
Senior Data Engineer (Remote in Brazil)

KnowBe • États-Unis

À distance
USD 54 000 - 69 000
Monthly bonuses based on targets
Employee referral bonuses
Tuition reimbursement
+1
Data Engineer — Remote Brazil | ETL/ELT & AWS
Data Engineer — Remote Brazil | ETL/ELT & AWS

Not Disclosed • États-Unis

À distance
USD 90 000 - 120 000
Remote work from Brazil
Meal allowances
Healthcare coverage
+2
Senior Data Engineer - Real-Time Pipelines (Remote Brazil)
Senior Data Engineer - Real-Time Pipelines (Remote Brazil)

knowbe4 • États-Unis

À distance
USD 120 000 - 180 000
Company bonuses
Referral bonuses
Adoption assistance
+3
Staff Data Engineer
Staff Data Engineer

Vertexinc • États-Unis

À distance
USD 150 000 - 190 000
Remote Spark Data Engineer - Build Scalable Pipelines
Remote Spark Data Engineer - Build Scalable Pipelines

BairesDev • États-Unis

À distance
USD 110 000 - 165 000
100% Remote
Competitive USD compensation
Home office setup
+5
Senior Data Engineer (AWS, Python & SQL) | Remote LATAM
Senior Data Engineer (AWS, Python & SQL) | Remote LATAM

Job4Travelers • Boca Raton (FL)

À distance
USD 110 000 - 170 000
Access to AI tools
Flexible PTO and paid holidays
Remote-friendly culture and ongoing AI
Senior Data Platform Engineer — Remote LATAM
Senior Data Platform Engineer — Remote LATAM

TeamStation Artificial Intelligence, LLC. • États-Unis

À distance
USD 140 000 - 190 000
Remote-first culture
Remote work across Latin America
Senior Spark & Data Platform Engineer (Remote)
Senior Spark & Data Platform Engineer (Remote)

Cephas Consultancy Services Private Limited • Georgia

Hybride
USD 120 000 - 190 000
Senior Data Engineer – Python, PySpark & AWS
Senior Data Engineer – Python, PySpark & AWS

SCI SOLUTIONS GLOBAL • Plano (TX)

Sur place
USD 120 000 - 160 000
Remote Lead Data Engineer - Spark, Snowflake & AWS
Remote Lead Data Engineer - Spark, Snowflake & AWS

4C India Security & IT • États-Unis

À distance
USD 19 000 - 34 000
Mentorship and professional developent