Data Platform Engineer - Azure Databricks

0200 Ares Operations LLC; New York (NY); Presencial; USD 85.000 - 100.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Comprehensive Medical/Rx, Dental and V

401(k) matching

Flexible Savings Accounts (FSA)

HSA with company contribution

Life Insurance

Long-Term Disability

EAP

Commuter Benefits

Wellbeing programs

Educational sponsorship

Descripción de la vacante

Ares Management LLC is seeking an Associate, Data Platform Engineering to design and operate scalable Azure Databricks data pipelines in a fast-paced environment. You will collaborate with data architects, engineers, and business stakeholders to deliver reliable data solutions and governance across Bronze to Gold medallion architectures.

The role requires 6+ years in data/platform engineering, hands-on experience with Databricks, Spark, Delta Lake, Python, SQL, and Azure Data Factory, plus CI/CD

Formación

• 6+ years of experience in Data Platform Engineering, Cloud Engineering, Infrastructure Engineering, DevOps, or Data Operations.
• Hands-on experience designing, developing, deploying, and supporting enterprise-scale data pipelines using Azure Databricks, Apache Spark, Delta Lake, Python, SQL, and Azure Data Factory.
• Experience implementing ETL/ELT processes, data enrichment, data validation, and data quality controls within Bronze, Silver, and Gold Medallion Architecture environments.
• Hands-on experience supporting Azure Databricks capabilities including Workspaces, Unity Catalog, Databricks Workflows, Delta Live Tables, SQL Warehouses, Cluster Policies, Lakehouse Monitoring, and System Tables.
• Strong understanding of CI/CD, Infrastructure-as-Code (Terraform), GitHub Actions, Azure DevOps, automated testing, release management, and environment promotion strategies.
• Experience implementing and supporting observability, telemetry, logging, alerting, and operational monitoring using Azure Monitor, Log Analytics, Application Insights, and Databricks monitoring.
• Experience supporting data governance including Unity Catalog Lineage, data reconciliation, audit trails, metadata management, data quality frameworks, and regulatory compliance.
• Working knowledge of real-time and event-driven architectures leveraging Kafka, Azure Event Hubs, and Databricks Structured Streaming.
• Strong troubleshooting and engineering skills to diagnose and resolve issues across data pipelines, cloud infrastructure, platform services, security, networking, and application integrations.

Responsabilidades

• Develop and maintain scalable data pipelines, ETL/ELT processes, and data integrations.
• Support ingestion of structured and unstructured data from internal and external sources.
• Assist with building and optimizing cloud-based data solutions and enterprise data platforms.
• Partner with business teams to understand reporting and analytics requirements.
• Monitor data quality, performance, and reliability across data environments.
• Contribute to data governance, lineage, and documentation initiatives.
• Participate in code reviews and engineering best practices.

Educación

Bachelor’s degree in Computer Science, Engineering, Information Systems, or related field

Herramientas

Azure Databricks

Apache Spark

Delta Lake

Python

SQL

Azure Data Factory

CI/CD

Terraform

GitHub Actions

Azure DevOps

Databricks Unity Catalog

Databricks Workflows

Monitoring/Observability tools

Kafka/Azure Event Hubs

Descripción del empleo

Ares Management LLC is seeking an Associate, Data Platform Engineering to design and operate scalable Azure Databricks data pipelines in a fast-paced environment. You will collaborate with data architects, engineers, and business stakeholders to deliver reliable data solutions and governance across Bronze to Gold medallion architectures.

The role requires 6+ years in data/platform engineering, hands-on experience with Databricks, Spark, Delta Lake, Python, SQL, and Azure Data Factory, plus CI/CD