Data Engineer (Azure Databricks + Python) - Remote Work | REF#294145

BairesDev; United States; Teletrabalho; CLP 88 670 000 - 128 079 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Remote work

USD pay or local currency

Home setup provided

Flexible hours

Parental leaves & vacations

Global, multicultural environment

Mentorship & growth opportunities

Resumo da oferta

BairesDev® has led technology projects for over 15 years, delivering cutting-edge solutions to Google and top startups worldwide. Our 4,000+ team works remotely on roles that create meaningful impact across the globe.

As a Data Engineer, you will design and develop scalable data pipelines using Azure Databricks and Python, and you will integrate AI capabilities into data workflows to automate intelligent classification and insights. Join a global team where your talents can thrive.

Qualificações

• 4+ years of experience in Data Engineering, ML Engineering, or Software Engineering.
• Expertise in building data pipelines with Azure Databricks and Python.
• Experience integrating ML/AI solutions and LLM APIs into workflows.
• Strong data manipulation and automation skills for classification tasks.
• Understanding of cloud-native data architectures and AI integration patterns.
• Strong written and spoken English.

Responsabilidades

• Design, build, and optimize end-to-end data pipelines and Lakehouse architectures with Azure Databricks.
• Integrate LLM APIs and ML models into data processing for automated insights.
• Develop and maintain high-quality Python code and SQL procedures for data transformation.
• Collaborate with AI and product teams on data-driven solutions delivering business value.
• Monitor pipeline performance, ensuring reliability and scalability across cloud environments.
• Implement data governance and security practices to protect data integrity.

Conhecimentos

Azure Databricks

Python

ML/AI integration

LLM APIs

Data pipelines

Cloud-native architecture

English proficiency

Ferramentas

SQL

Git

Descrição da oferta de emprego

At BairesDev®, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley.

Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works remotely on roles that drive significant impact worldwide.

When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success.

As a Data Engineer, you will design and develop scalable data pipelines leveraging Azure Databricks and Python. You will play a key role in integrating AI capabilities into data workflows, enabling the organization to process complex datasets and automate intelligent classification tasks.

What You'll Do

• Design, build, and optimize end-to-end data pipelines and Lakehouse architectures using Azure Databricks.
• Integrate LLM APIs and machine learning models into data processing streams to support automated classification and insights.
• Develop and maintain high-quality Python code and SQL procedures to ensure efficient data transformation and ingestion.
• Collaborate with AI and product teams to implement data-driven solutions that drive significant business value.
• Monitor and troubleshoot pipeline performance, ensuring reliability and scalability across distributed cloud environments.
• Implement data governance and security best practices to maintain the integrity and compliance of the data platform.

What We Are Looking For

• 4+ years of experience in Data Engineering, Machine Learning Engineering, or Software Engineering.
• Proven expertise in developing and optimizing data pipelines using Azure Databricks and Python.
• Proficiency in integrating ML/AI solutions and LLM APIs into automated data workflows.
• Strong background in data manipulation, automation, and supporting classification tasks.
• Deep understanding of cloud-native data architectures and AI integration patterns.
• Advanced proficiency in English.

How we do make your work (and your life) easier:

• 100% remote work (from anywhere).
• Excellent compensation in USD or your local currency if preferred
• Hardware and software setup for you to work from home.
• Flexible hours: create your own schedule.
• Paid parental leaves, vacations, and national holidays.
• Innovative and multicultural work environment: collaborate and learn from the global Top 1% of talent.
• Supportive environment with mentorship, promotions, skill development, and diverse growth opportunities.

Join a global team where your unique talents can truly thrive and make a significant impact!