Data Engineer (Databricks + Fabric)

Jobgether; United States; Remote; USD 120,000 - 180,000; Full time

Benefits offered by this job

Fully remote from Brazil

International exposure

Advanced technology stack

Professional development

Client-facing experience

Job summary

Jobgether is hiring a senior data engineering specialist to design, implement, and operate production-grade data platforms for diverse clients. You will build scalable ETL/ELT pipelines with Databricks and Microsoft Fabric, implementing Bronze/Silver/Gold Medallion architectures using Delta Lake and Unity Catalog for governance.

You will work across the Fabric ecosystem, automate deployments with CI/CD and IaC, and ensure secure, high-performance platforms while collaborating with clients and

Qualifications

• Experience implementing and managing Databricks solutions in production environments.
• Strong experience with PySpark, Delta Lake, Databricks Workflows, and Unity Catalog, including data lineage.
• Designing Medallion architectures (Bronze/Silver/Gold) in production environments.
• Hands-on experience with Microsoft Fabric across its full platform (Lakehouse, OneLake, Data Pipelines, Notebooks, Dataflows Gen2, Warehouse).
• Advanced SQL and Python skills for data transformation and processing.
• Knowledge of data governance, lakehouse architectures, and production data platform management.
• Experience building automated deployment workflows using CI/CD and IaC.
• Current Microsoft DP-900 or DP-700 cert with commitment to obtain remaining certs within 60 days.

Responsibilities

• Design, develop, deploy, and maintain production-grade data platforms for clients.
• Build scalable ETL/ELT pipelines using Databricks and Microsoft Fabric.
• Implement Medallion architectures Bronze/Silver/Gold with Delta Lake.
• Develop data processing solutions using PySpark, Python, SQL, and Fabric components.
• Establish and enforce data governance with Unity Catalog and data quality practices.
• Work across the Fabric ecosystem including Lakehouse, OneLake, and Data Pipelines.
• Automate deployment via CI/CD and IaC.
• Ensure platforms are scalable, secure, and high-performing.
• Translate business and technical requirements with clients and teams.
• Identify opportunities to improve architectures and workflows.
• Suggest enhancements to drive additional engagements.

Skills

English communication

Spanish communication

Analytical thinking

Problem solving

Cross-team collaboration

Hands-on approach

Tools

Databricks

Delta Lake

Databricks Workflows

Unity Catalog

Microsoft Fabric

CI/CD

Infrastructure as Code

Notebooks/Dataflows Gen2

Job description

Accountabilities:

• - Design, develop, deploy, and maintain production-grade data platforms for clients, taking hands‑on responsibility for implementation and ongoing operations.
• - Build and optimize scalable ETL/ELT pipelines using Databricks and Microsoft Fabric to support complex data integration and transformation requirements.
• - Design and implement modern lakehouse architectures based on the Medallion framework, organizing data into Bronze, Silver, and Gold layers using Delta Lake.
• - Develop and maintain data processing solutions using PySpark, Python, SQL, Databricks Workflows, and Microsoft Fabric components.
• - Implement and manage data governance through Unity Catalog, including permissions, access controls, data lineage, and data quality practices.
• - Work across the Microsoft Fabric ecosystem, leveraging Lakehouse, OneLake, Data Pipelines, Notebooks, Dataflows Gen2, and Warehouse capabilities.
• - Establish and automate deployment processes using CI/CD pipelines and Infrastructure as Code (IaC) practices.
• - Ensure data platforms are scalable, secure, reliable, and optimized for performance and maintainability.
• - Gather, analyze, and translate business and technical requirements in collaboration with clients and internal teams.
• - Identify opportunities to improve existing data architectures, infrastructure, and engineering workflows.
• - Proactively recognize potential client needs and recommend technical enhancements that may lead to additional projects and engagements.
• - Collaborate with cross-functional teams to ensure successful project delivery and alignment with business objectives.

Requirements:

• - Proven hands‑on professional experience implementing and managing Databricks solutions in production environments . Proofs of concept or theoretical knowledge alone are not sufficient.
• - Strong experience with PySpark, Delta Lake, Databricks Workflows, and Unity Catalog, including catalog management, permissions, and data lineage.
• - Demonstrated experience designing and implementing Medallion architectures (Bronze, Silver, and Gold) in production data environments.
• - Proven hands‑on experience with Microsoft Fabric across its full platform , including Lakehouse, OneLake, Data Pipelines, Notebooks, Dataflows Gen2, and Warehouse. Experience limited to proofs of concept is not sufficient.
• - Advanced proficiency in SQL and Python, with the ability to develop efficient data transformation and processing solutions.
• - Strong understanding of modern data engineering principles, lakehouse architectures, data governance, and production data platform management.
• - Experience building and maintaining automated deployment workflows using CI/CD and Infrastructure as Code.
• - Current Microsoft DP-900 or DP-700 certification, with a commitment to obtain the remaining certification within the first 60 days of employment. Certification status should be verifiable through Microsoft Learn.
• - Professional English proficiency at B2 level or above , with the ability to communicate effectively with international clients and technical teams.
• - Fluent Spanish, with the ability to participate confidently in professional discussions and client interactions.
• - Strong analytical and problem-solving skills, combined with a practical, hands‑on approach to technical implementation.
• - Excellent communication and collaboration skills, with the ability to gather requirements, understand client needs, and translate them into effective technical solutions.
• - Proactive mindset, attention to detail, and the ability to identify opportunities for continuous improvement.

Benefits:

• - Fully remote work: Work remotely from Brazil, with a location-independent working environment.
• - International exposure: Collaborate with clients and technical teams across Latin America and potentially other international markets.
• - Advanced technology stack: Gain hands‑on experience with Databricks, Microsoft Fabric, Delta Lake, PySpark, and modern cloud data engineering technologies.
• - Technical ownership: Take direct responsibility for building, deploying, and operating production data platforms.
• - Professional development: Strengthen your expertise in modern lakehouse architectures, data governance, automation, and enterprise data solutions.
• - Client-facing experience: Work closely with clients, understand their business challenges, and contribute to impactful technology initiatives.
• - Continuous learning: Develop your skills through practical exposure to evolving data engineering tools and methodologies.
• - Employment type: Remote engagement; specific contractual arrangements and compensation details to be confirmed during the recruitment process.
• - Location: Latin America, with Brazil as the target location.