The Data Platform Administration Architect is responsible for the architecture, administration, governance, operational excellence, and continuous improvement of the enterprise data platform. This role owns the stability, scalability, security, availability, and supportability of cloud-based data platforms, with a primary focus on Databricks, Azure Data Services, and enterprise platform operations.
The ideal candidate brings deep technical expertise along with strong operational leadership experience in enterprise production environments. This individual will serve as the technical lead for platform administration, partnering closely with engineering, infrastructure, security, governance, and business teams to ensure reliable, secure, and compliant data platform operations while driving modernization and continuous improvement initiatives.
KEY RESPONSIBILITIES
- Lead the administration, architecture, governance, and operational support of enterprise data platforms.
- Manage and support Databricks, Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), Azure Synapse Analytics, Azure SQL, and related Azure services across production and non-production environments.
- Own platform reliability, availability, scalability, performance, security, and operational excellence.
- Define and maintain platform standards, monitoring frameworks, environment strategies, governance models, and operational procedures.
- Oversee Change Management and Release Management processes, including Change Requests (CRs), Standard Changes (SCRs), Emergency Changes (ECRs), deployment planning, release scheduling, rollback strategies, and post-release validation.
- Participate in Change Advisory Board (CAB) meetings and provide technical assessments, deployment readiness reviews, and risk evaluations.
- Lead production support activities, including Incident Management, Service Requests (RITMs), Problem Management, and Major Incident Management processes.
- Coordinate cross-functional teams during critical production incidents and ensure timely restoration of services.
- Conduct Root Cause Analysis (RCA) investigations and implement corrective and preventive actions to reduce recurring issues.
- Develop and maintain operational runbooks, support documentation, knowledge articles, escalation procedures, and disaster recovery plans.
- Establish, track, and report operational KPIs, including platform uptime, SLA compliance, MTTR, release success rates, incident trends, and platform health metrics.
- Implement and govern CI/CD processes, deployment automation, Infrastructure as Code (IaC), and Azure DevOps best practices.
- Ensure compliance with enterprise security standards, access governance requirements, audit controls, and SOX compliance policies.
- Drive platform modernization initiatives, operational maturity programs, cost optimization efforts, and continuous service improvement activities.
- Mentor platform engineers and administrators while providing technical leadership, architectural guidance, and operational best practices.
REQUIRED QUALIFICATIONS
- Bachelor’s degree in Computer Science, Information Systems, Engineering, or a related field.
- 10+ years of experience in enterprise data platforms, platform engineering, cloud infrastructure, data operations, or platform administration.
- Hands-on experience administering and supporting Databricks and Azure-based data platforms in enterprise production environments.
- Experience working in platform administration, platform operations, platform architecture, or data platform support roles.
- Strong experience with Databricks administration, configuration, governance, security, and operational support.
- Strong knowledge of Azure Identity and Access Management (IAM), including RBAC, Managed Identities, and Service Principals.
- Experience with Azure Monitor, Log Analytics, and enterprise observability practices.
- Deep understanding of provisioning, securing, governing, and supporting production and non-production Databricks environments.
- Experience with platform capacity planning, workload management, cost optimization, performance tuning, and scalability planning.
- Proven experience implementing monitoring, alerting, observability frameworks, and operational dashboards.
- Experience managing enterprise production support processes, including:
- Service Request Management (RITM)
- Change Management (CR)
- Standard Changes (SCR)
- Emergency Changes (ECR)
- Experience leading release management activities, including planning, deployment execution, validation, rollback planning, and post-release support.
- Strong understanding of ITIL-aligned operational processes, including:
- Change Management
- Release Management
- Service Request Management
- Knowledge Management
- Experience leading and resolving critical production incidents (P1, P2, and P3), including executive communications and stakeholder management.
- Demonstrated experience conducting and presenting Root Cause Analysis (RCA) findings and corrective action plans.
- Experience establishing operational support models, escalation procedures, on-call rotations, and operational readiness reviews.
- Hands-on experience with ServiceNow or similar ITSM platforms.
- Experience developing operational reporting, service metrics, SLA reporting, trend analysis, and health dashboards.
- Experience designing scalable platform controls and operational processes for enterprise environments.
- Strong knowledge of CI/CD automation, deployment pipelines, Infrastructure as Code (IaC), and Azure DevOps methodologies.
- Experience implementing cloud governance, security controls, access management frameworks, and compliance standards.
- Experience supporting SOX-compliant, regulated, or audit-driven environments.
- Ability to partner effectively with infrastructure, networking, security, application, and business teams.
- Proven leadership experience managing platform, engineering, or operations teams.
- Excellent communication, leadership, stakeholder management, and problem-solving skills.
PREFERRED QUALIFICATIONS
- Experience within Supply Chain or Logistics domains.
- Databricks Certified Data Engineer, Databricks Platform Administrator, or related Databricks certifications.
- Microsoft Certified: Azure Solutions Architect Expert.
- Experience leading CAB meetings, release governance forums, or enterprise change management programs.
- Experience supporting large-scale enterprise Databricks and Azure data platforms across multiple business units and geographic regions.
- Experience with observability and monitoring solutions such as Datadog, Splunk, Grafana, Azure Monitor, or similar tools.
- Experience implementing enterprise-wide governance, FinOps, security, and compliance frameworks.
- Experience leading cloud modernization, platform transformation, and operational maturity initiatives.
- Strong understanding of Unity Catalog, data governance, data security, access governance, and regulatory compliance requirements.
- Vendor management and strategic technology partnership experience.
CERTIFICATIONS
- Databricks Certified Data Engineer (Preferred)
- Microsoft Certified: Azure Solutions Architect Expert (Preferred)