Job Description/Responsibilities:
- AWS VPC ownership (Databricks VPC): administer and maintain subnets, route tables, security groups, NACLs, NAT/Internet egress patterns (as applicable), and network segmentation to meet performance and security requirements.
- Connectivity to the bank / enterprise network: troubleshoot and support end-to-end connectivity between the Databricks AWS VPC (IRE) and the bank network across cross‑region/cross‑account boundaries; coordinate and drive changes with the Bank Cloud team where required.
- Private access to AWS services: Design, implement, and operate VPC endpoints and related routing/DNS patterns to enable secure access to services such as S3 while reducing reliance on public internet paths.
- S3 data access enablement (with security controls): Partner with platform/security teams to ensure Databricks workloads can reliably read/write required S3 data using appropriate IAM roles/policies and encryption controls; support diagnosis of access failures that present as platform incidents.
- Operational support & reliability: Provide production support for the platform connectivity layer (incident response, RCA, preventative actions), maintain runbooks and reference diagrams, and implement improvements to reduce repeat incidents.
- Cross‑team change management: Raise, manage, and chase change requests with the Bank Cloud team for items outside the Databricks VPC boundary; translate technical needs into clear implementation requirements and validate changes end‑to‑end.
Background and experience required:
- Years of Experience
- Industry Experience: 6+ years of industry experience
Must‑have Skills (Mandatory Skills):
- Include minimum years of experience required per skill
- AWS networking: strong hands‑on experience with VPC design/operations, routing, security groups/NACLs, and network troubleshooting in production. 5+ years
- Enterprise cloud operations: experience operating within a regulated/enterprise environment with change management, auditability, and strict security controls. 3+ years
- Connectivity troubleshooting: ability to diagnose reachability issues across complex boundaries (cross‑account/cross‑region, enterprise network perimeters) and drive resolution across multiple teams. 5+ years
- AWS service access patterns: experience enabling secure access to services like S3 (and related IAM policy patterns) in a way that supports production workloads. 5+ years
- Stakeholder management: proven ability to liaise with a central cloud/network team, raise and drive changes, and communicate clearly during incidents. 3+ years
Beneficial Skills (Desired Skills):
- Databricks on AWS experience: understanding of Databricks workspace architecture and its connectivity constraints (data plane/control plane concepts, typical network dependencies).
- Private connectivity patterns: experience with private endpoint patterns and enterprise connectivity services (e.g., endpoint‑based access, centralized routing constructs).
- Infrastructure-as-Code: Terraform/CloudFormation experience for repeatable, audited changes (nice‑to‑have).
- Security tooling and monitoring: exposure to logging/monitoring approaches used for network and cloud operations.
Ways of Working
- Owns outcomes end‑to‑end (hands‑on fixes inside the VPC; drives changes outside the boundary through the Bank Cloud team).
- Strong operational mindset prioritizes stability, clear communication, and measurable prevention of repeat incidents.
- Documents and standardizes runbooks, network diagrams, and repeatable change patterns.
Skill/Experience/Education
Mandatory Skills AWS networking, Enterprise cloud operations, Connectivity troubleshooting, AWS service access patterns, Stakeholder management, Databricks on AWS experience
Desired Skills:
Skill Matrix
Skills
Stakeholder Management AWS networking Enterprise cloud operations Databricks on AWS experience AWS service access patterns Connectivity troubleshooting