Data Engineer (Azure Databricks + Python) - Remote Work

BairesDev

Brasil

Remote

BRL 557,000 - 892,000

Full time

6 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

100% remote
USD compensation
Hardware provided
Flexible hours
Parental leave
Mentorship & growth

Job summary

BairesDev is seeking a Data Engineer to design scalable data pipelines using Azure Databricks and Python, enabling AI-enabled data workflows and automated classification. You will work with AI teams to integrate LLM APIs and ensure robust, secure data processing in distributed cloud environments.

This role offers 100% remote work, generous USD compensation, hardware setup, flexible hours, and opportunities to grow in a global Top 1% tech talent network with mentorship and cross-functional

Qualifications

  • 4+ years in Data/ML Engineering or Software Engineering.
  • Proven experience with Azure Databricks and Python.
  • Experience integrating ML/AI and LLM APIs into data workflows.
  • Strong data manipulation, automation, and classification task support.
  • Cloud-native data architectures and AI integration patterns.
  • Fluent English communication.

Responsibilities

  • Design, build, and optimize end-to-end data pipelines and Lakehouse architectures using Azure Databricks.
  • Integrate LLM APIs and ML models into data processing streams for automated classification and insights.
  • Develop and maintain high-quality Python code and SQL procedures for data transformation and ingestion.
  • Collaborate with AI and product teams to implement data-driven solutions delivering business value.
  • Monitor and troubleshoot pipeline performance for reliability and scalability in distributed clouds.
  • Implement data governance and security practices to maintain data integrity and compliance.

Skills

Azure Databricks
Python
Data pipelines
Cloud computing
English

Tools

SQL

Job description

At BairesDev®, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley.

Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works remotely on roles that drive significant impact worldwide.

When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success.

Data Engineer (Azure Databricks + Python) at BairesDev

As a Data Engineer, you will design and develop scalable data pipelines leveraging Azure Databricks and Python. You will play a key role in integrating AI capabilities into data workflows, enabling the organization to process complex datasets and automate intelligent classification tasks.

What You'll Do:
  • Design, build, and optimize end-to-end data pipelines and Lakehouse architectures using Azure Databricks.
  • Integrate LLM APIs and machine learning models into data processing streams to support automated classification and insights.
  • Develop and maintain high-quality Python code and SQL procedures to ensure efficient data transformation and ingestion.
  • Collaborate with AI and product teams to implement data-driven solutions that drive significant business value.
  • Monitor and troubleshoot pipeline performance, ensuring reliability and scalability across distributed cloud environments.
  • Implement data governance and security best practices to maintain the integrity and compliance of the data platform.
What we are looking for:
  • 4+ years of experience in Data Engineering, Machine Learning Engineering, or Software Engineering.
  • Proven expertise in developing and optimizing data pipelines using Azure Databricks and Python.
  • Proficiency in integrating ML/AI solutions and LLM APIs into automated data workflows.
  • Strong background in data manipulation, automation, and supporting classification tasks.
  • Deep understanding of cloud-native data architectures and AI integration patterns.
  • Advanced proficiency in English.
How we do make your work (and your life) easier:
  • 100% remote work (from anywhere).
  • Excellent compensation in USD or your local currency if preferred
  • Hardware and software setup for you to work from home.
  • Flexible hours: create your own schedule.
  • Paid parental leaves, vacations, and national holidays.
  • Innovative and multicultural work environment: collaborate and learn from the global Top 1% of talent.
  • Supportive environment with mentorship, promotions, skill development, and diverse growth opportunities.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer (Azure Databricks) - Remote Work | REF#308459
Data Engineer (Azure Databricks) - Remote Work | REF#308459

BairesDev • São Paulo

Remote
BRL 493,000 - 712,000
100% remote work
USD or local currency compensation
Hardware setup for home office
+4
Data Engineer - Remote Work | REF#308432
Data Engineer - Remote Work | REF#308432

BairesDev • Brazil

Remote
BRL 657,000 - 876,000
100% remote work
USD or local currency compensation
Hardware and software setup for home
+4
Senior Data Engineer (Azure Databricks) - Remote Work | REF#308826
Senior Data Engineer (Azure Databricks) - Remote Work | REF#308826

BairesDev • Rio de Janeiro

Remote
BRL 657,000 - 986,000
Remote work
USD compensation
Home setup provided
+2
Data Engineer (Databricks) - Remote Work
Data Engineer (Databricks) - Remote Work

BairesDev • Brazil

Remote
BRL 636,000 - 867,000
Remote work
USD payments
Home setup for remote work
+4
Data Engineer - Remote Wor | REF#309140
Data Engineer - Remote Wor | REF#309140

BairesDev • Brazil

Remote
BRL 493,000 - 712,000
Remote work
USD or local currency compensation
Hardware and software setup
+3
Data Engineer - Remote Work
Data Engineer - Remote Work

BairesDev • São Paulo

Remote
BRL 429,876 - 644,815
100% remote work
Excellent compensation in USD
Flexible hours
+3
Data Management Specialist (Azure & Databricks) - Remote Work | REF#309564
Data Management Specialist (Azure & Databricks) - Remote Work | REF#309564

BairesDev • São Paulo

Remote
BRL 502,000 - 836,000
100% remote work
USD or local currency compensation
Hardware provided for home setup
+4
Data Engineer Associate - Remote Work | REF#308484
Data Engineer Associate - Remote Work | REF#308484

BairesDev • São Paulo

Remote
BRL 329,000 - 493,000
100% remote
USD salary or local currency
Hardware provided
+3
Data Engineer - Remote Work
Data Engineer - Remote Work

BairesDev • São Paulo

Remote
BRL 457,974 - 646,551
100% remote work
Excellent compensation in USD
Flexible hours
+3
Data Engineer (Databricks) - Remote Work | REF#297215
Data Engineer (Databricks) - Remote Work | REF#297215

BairesDev • Minas Gerais

Remote
BRL 493,000 - 821,000
100% remote work
Competitive USD or local currency pay
Home office setup
+2