Purpose of Job
Beghou Consulting is looking for a hands‑on Site Reliability / DevOps Engineer to design, build, and maintain our cloud infrastructure across Azure and AWS. You’ll own infrastructure as code, automate our delivery pipelines with Azure DevOps, and collaborate with development and client teams to ensure our environments are secure, scalable, and maintainable. Familiarity with Databricks workspace infrastructure and disaster recovery planning is a plus.
Essential Duties & Responsibilities
- Develop, maintain, and review Terraform modules to provision and manage cloud resources.
- Apply best practices for Terraform state management, module design, and testing.
- Leverage CDKTF (Terraform) or Terragrunt patterns where appropriate.
- Architect and operate services in Azure and AWS (compute, storage, networking, databases).
- Provision, configure, and manage Databricks workspaces, clusters and jobs to support data pipelines.
- Implement tagging, cost‑optimization, and security controls across both clouds and Databricks environments.
- Build, test, and maintain Azure DevOps Pipelines or GitHub Actions to automate infrastructure provisioning and application deployment.
- Manage source in Azure DevOps or GitHub repos, enforce branching strategies, pull‑request workflows and policy‑as‑code checks.
- Partner with client and data engineering teams to integrate infrastructure changes safely into development workflows.
- Produce clear architecture diagrams, runbooks, and how‑to guides for both technical and non‑technical stakeholders.
- Write and maintain automation scripts and CLI tools in Python to streamline operational tasks.
- Contribute to internal SDKs or libraries for shared tooling and infrastructure utilities.
These essential functions are not designed to cover or contain a comprehensive listing of activities, duties or responsibilities that are required. Duties, responsibilities, and activities may change or new ones may be assigned at any time with or without notice.
Qualifications (Knowledge, Skills, Abilities, Education)
- Experience: 3+ years in a DevOps or SRE role with production workloads in Azure and AWS.
- IaC Proficiency: Deep hands‑on Terraform experience, including Terraform Cloud, Terragrunt, module design, and testing.
- CI/CD Expertise: Proven ability building and maintaining Azure DevOps Pipelines and managing code in either Azure DevOps or GitHub repos.
- Programming Skills: Strong Python scripting skills; able to write clean, testable, and reusable code.
- Data Platform Understanding: Familiarity with provisioning and managing Databricks workspaces, clusters, and jobs.
- Disaster Recovery: Experience designing DR plans, automated backups, and conducting restore drills.
- Cloud Services: Solid understanding of core Azure and AWS services (VMs, networking, storage, IAM, RDS/SQL).
- Problem‑Solving: Excellent troubleshooting abilities and a calm, methodical approach to incident response.
- Communication: Clear written and verbal communication; adept at documenting complex systems simply.
Preferred Qualifications
- Advanced IaC Tools: Experience with CDK for Terraform (CDKTF) or Terragrunt for composing infrastructure patterns.
- Languages: PowerShell, Bicep, Python, Terraform.
- Security & Compliance: Familiarity with cloud security best practices (CIS benchmarks, Azure Policy, AWS IAM policies).
- Networking: In‑depth knowledge of VPCs, VNets, load balancers, VPNs and cross‑region connectivity.
- Serverless & Containers: Experience with serverless platforms (Azure Functions, AWS Lambda) and container registries.