Data Platform Engineer (Azure & Databricks)

Ares Management; New York (NY); Presencial; USD 140.000 - 180.000; Jornada completa

Descripción de la vacante

Ares Management is actively seeking an Associate, Data Platform Engineering to design, deploy, and support enterprise data pipelines on Azure Databricks and related technologies in a fast-paced environment. You will collaborate with data architects, engineers, and business stakeholders to deliver scalable data solutions.

The role emphasizes building reliable data platforms, ensuring data quality, and enabling analytics across Credit, Private Equity, Real Estate, Infrastructure, and Secondaries.

Formación

• Bachelor’s degree in CS, Engineering, IS, or related field.
• Hands-on with enterprise-scale data pipelines using Azure Databricks, Spark, Delta Lake, Python, SQL, and Azure Data Factory.
• Experience maintaining and optimizing data pipelines, debugging production issues, and performance tuning.
• Experience with data governance, lineage, and metadata management across Medallion Architecture.

Responsabilidades

• Develop and maintain scalable data pipelines, ETL/ELT processes, and data integrations.
• Support ingestion of structured and unstructured data from internal and external sources.
• Assist with building and optimizing cloud-based data solutions and enterprise data platforms.
• Partner with business teams to understand reporting and analytics requirements.
• Monitor data quality, performance, and reliability across data environments.
• Contribute to data governance, lineage, and documentation initiatives.
• Participate in code reviews and engineering best practices.

Conocimientos

Data pipelines

Cloud data engineering

Problem solving

Team collaboration

Big data concepts

Educación

Bachelor's degree in Computer Science, Engineering, Information Systems, or related field

Herramientas

Azure Databricks

Apache Spark

Delta Lake

Python

SQL

Azure Data Factory

Unity Catalog

Databricks Workflows

Delta Live Tables

SQL Warehouses

Cluster Policies

Lakehouse Monitoring

Databricks Audit Logs

Databricks Job Monitoring

Kafka

Azure Event Hubs

Azure Service Bus

CDC

Databricks Structured Streaming

CI/CD

Terraform

GitHub Actions

Azure DevOps

Automated testing

Release management

Environment promotion

Descripción del empleo

Ares Management is actively seeking an Associate, Data Platform Engineering to design, deploy, and support enterprise data pipelines on Azure Databricks and related technologies in a fast-paced environment. You will collaborate with data architects, engineers, and business stakeholders to deliver scalable data solutions.

The role emphasizes building reliable data platforms, ensuring data quality, and enabling analytics across Credit, Private Equity, Real Estate, Infrastructure, and Secondaries.