Engenheiro de Dados Senior

Jobgether; Brasil; On-site; BRL 180,000 - 300,000; Full time

Benefits offered by this job

Health insurance

Dental insurance

Home-office allowance

Meal allowances

Childcare assistance

Extended parental leave

Life insurance

Birthday day off

Mental Health Break

Career development

Job summary

Jobgether is seeking a Senior Data Engineer based in Brazil to join a data team powering B2B sales intelligence. You will design and optimize Databricks pipelines, primarily with SQL and PySpark, and leverage AI tools to automate data collection, extraction, and validation across diverse data sources.

You will collaborate with Product, Data Science, Platform, and business teams to shape data architecture, ensure data quality, and manage cost efficiency in AWS environments.

Qualifications

• Degree in Computer Science, Data Engineering, Information Systems, or related field, or equivalent experience.
• Professional experience as a Data Engineer or in a similar role.
• Advanced SQL skills and solid knowledge of data modeling.
• Hands-on experience with Databricks.
• Practical experience using AI in data workflows (LLMs/agents).
• Daily experience with AI-powered development tools (Claude Code, Cursor, GitHub Copilot).
• Knowledge of Python and PySpark.
• Familiarity with AWS services (S3, Lambda, EKS).
• Experience with Git and automated testing.
• Able to work independently and communicate results clearly.
• Experience in agile and collaborative environments.

Responsibilities

• Develop, maintain, and optimize large-scale data pipelines in Databricks using SQL and PySpark.
• Apply AI, LLMs, and agents to automate data collection and validation.
• Integrate new data sources while ensuring traceability and cost efficiency.
• Build and maintain data APIs for platform products.
• Ensure data quality via automated tests and monitoring.
• Apply LGPD privacy practices in Brazil.
• Optimize Databricks and AWS processing costs.
• Contribute to data engineering standards and architecture decisions.
• Utilize AI tools (Claude Code) throughout development lifecycle.
• Share knowledge through code reviews and pair programming.
• Translate requirements into effective solutions and communicate results.
• Document data pipelines and data architecture.

Skills

Advanced SQL

Data modeling

Python

PySpark

Databricks

AI in data workflows

Agile

Communication

Independent work

Education

Degree in Computer Science / Data Engineering / Information Systems

Tools

Databricks

Claude Code

Cursor

GitHub Copilot

Python

AWS S3/Lambda/EKS

Job description

This position is listed on behalf of a partner company, which manages all applications and next steps. Our partner is looking for a Senior Data Engineer (Engenheiro de Dados Senior) based in Brazil.

We are looking for a Senior Data Engineer to join a Data team responsible for powering B2B sales intelligence solutions through large-scale data collection, processing, and delivery. In this role, you will design and optimize data pipelines primarily using Databricks, SQL, and PySpark, while exploring practical applications of generative AI, LLMs, and intelligent agents. You will work with structured and unstructured data from multiple sources, ensuring quality, scalability, privacy, and cost efficiency. Collaborating with Product, Data Science, Platform, and business teams, you will help shape data architecture and engineering best practices. This is an opportunity to contribute to an innovative, AI-driven environment where autonomy, critical thinking, and knowledge sharing are highly valued.

Accountabilities

• Develop, maintain, and optimize large-scale data pipelines in Databricks, primarily using SQL and also PySpark.

• Apply generative AI, LLMs, and agents to automate data collection, extraction, structuring, and validation, including from unstructured sources.

• Integrate new internal and external data sources while ensuring traceability and cost efficiency.

• Build and maintain APIs that make data available to platform products.

• Ensure data quality and integrity through automated tests, validation processes, and monitoring, addressing issues at their root cause.

• Apply privacy and data protection best practices in compliance with Brazil’s LGPD.

• Optimize processing performance and costs across Databricks and AWS environments.

• Contribute to architecture decisions and define data engineering standards and best practices.

• Use AI-powered development tools, including Claude Code, throughout the development lifecycle, helping the team adopt these tools with quality and critical judgment.

• Share knowledge through code reviews, pair programming, and technical collaboration.

• Work closely with Product, Data Science, Platform, and business teams to translate requirements into effective solutions and communicate results clearly.

• Document data pipelines, business rules, and data architecture.

Requirements:

• Degree in Computer Science, Data Engineering, Information Systems, or a related field, or equivalent professional experience.

• Professional experience as a Data Engineer or in a similar role.

• Advanced SQL skills and solid knowledge of data modeling.

• Hands-on experience with Databricks.

• Practical experience using AI in data-related workflows, such as LLMs or agents for information collection, extraction, classification, or validation.

• Daily experience with AI-powered development tools such as Claude Code, Cursor, GitHub Copilot, or similar solutions.

• Knowledge of Python and PySpark.

• Familiarity with AWS services such as S3, Lambda, and EKS.

• Experience with Git and automated testing.

• Ability to work independently, communicate results clearly, and collaborate effectively.

• Experience working in agile and collaborative environments.

Nice to have:

• Experience with Claude Code.

• Knowledge of Delta Live Tables (DLT) and/or streaming data pipelines.

• Experience with Unity Catalog.

• Expertise in optimizing Databricks pipeline performance and processing costs.

• Experience building data APIs.

• Knowledge of CI/CD practices and code review standards.

• Experience with web scraping and large-scale public data collection.

• Experience building AI agents or integrating with LLM APIs.

• Knowledge of LGPD requirements as applied to data.

• English proficiency for reading technical documentation.

Benefits:

• Meal and food allowances.

• Wellhub or TotalPass access.

• Home-office allowance.

• Health insurance.

• Optional dental insurance.

• Childcare assistance for children up to 6 years old.

• Extended maternity, paternity, and adoption leave.

• Life insurance.

• Birthday day off, available on the birthday or during the birthday month.

• Family Day: an additional day off for parents between May and August.

• Mental Health Break: one consecutive week off in December.

• Career development and growth opportunities.

• Collaborative, inclusive, and entrepreneurial work environment.

• Opportunity to contribute to innovative technology and products with broader market impact.

We appreciate your interest and wish you the best!

Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.