Data Engineering Lead / DevOps Lead
Apex Systems
Get more replies from employers
Send a job-specific resume in minutes.
Benefits offered by this job
Job summary
Apex Systems seeks a Data Engineering Lead / DevOps Lead to architect and operationalize the Data Intelligence Platform Enablement Framework. You will drive governance-as-code, IaC, CI/CD automation, and platform observability to deliver a scalable, secure data platform.
You will lead platform engineering, establish standards, automate operations, and enable self-service deployment while ensuring governance, reliability, and enterprise-grade performance.
Qualifications
- Bachelor's degree in CS/IT/Engineering or related field.
- 8+ years of experience in Data Engineering, Platform Engineering, DevOps, or Cloud Infrastructure.
- 5+ years of hands-on experience with Azure cloud technologies.
- 3+ years of experience supporting Databricks platform deployments and administration.
- Strong experience with Terraform, Infrastructure-as-Code, CI/CD automation, and DevOps practices.
- Deep understanding of cloud security, identity management, networking, and platform governance.
- Experience implementing monitoring, observability, and operational support frameworks.
- Proven ability to lead technical initiatives and drive engineering best practices.
Responsibilities
- Lead platform engineering and build the Data Intelligence Platform enablement framework.
- Design reusable platform services, deployment patterns, and engineering standards.
- Develop scalable platform capabilities for analytics, data products, AI, and self-service development.
- Establish enterprise-grade engineering practices for adoption, governance, and reliability.
- Design governance-as-code frameworks across Databricks and Azure.
- Automate security controls, Unity Catalog policies, and data classifications.
- Lead IaC initiatives using Terraform for Databricks and Azure services.
- Create enterprise CI/CD pipelines for data engineering workloads.
Skills
Education
Tools
Job description
The Data Engineering Lead / DevOps Lead is responsible for building and operationalizing the core foundation of the Data Intelligence Platform Enablement Framework. This role leads the implementation of governance-as-code, infrastructure-as-code, CI/CD automation, workspace configuration standards, platform monitoring, and observability capabilities to ensure a scalable, secure, and enterprise-ready data platform.
The ideal candidate is a hands-on technical leader with deep expertise in Databricks, Azure, DevOps, platform engineering, and automation. This individual will establish engineering standards, automate platform operations, and enable self-service deployment capabilities that accelerate delivery while maintaining governance, reliability, and operational excellence.
- Lead the implementation of the Data Intelligence Platform core infrastructure and enablement framework.
- Design and build reusable platform services, deployment patterns, and engineering standards.
- Develop scalable platform capabilities supporting analytics, data products, AI, and self-service development.
- Establish repeatable engineering practices that support enterprise adoption and growth.
- Design and implement governance-as-code frameworks across Databricks and Azure environments.
- Automate provisioning and enforcement of security, access controls, Unity Catalog policies, data classifications, and governance standards.
- Partner with Security, Architecture, and Data Governance teams to operationalize governance requirements through automation.
- Ensure platform controls are consistently deployed across environments.
- Lead infrastructure automation initiatives using Infrastructure-as-Code methodologies.
- Develop and maintain Terraform modules and deployment frameworks for Databricks and Azure services.
- Automate environment provisioning, configuration management, and platform scaling.
- Standardize deployment patterns to improve consistency, reliability, and speed.
- Design and implement enterprise CI/CD pipelines supporting data engineering, analytics, and platform workloads.
- Establish automated deployment frameworks for code, infrastructure, notebooks, workflows, and platform configurations.
- Enable version control, automated testing, release management, and deployment governance.
- Improve developer productivity through automation and self-service platform capabilities.
- Define workspace architecture, environment standards, and deployment strategies.
- Manage workspace configuration, cluster policies, compute governance, secret management, and environment isolation.
- Develop standards for development, testing, and production environments.
- Ensure platform configurations align with security, governance, and operational requirements.
- Implement platform-wide monitoring, observability, and operational health capabilities.
- Define and manage logging, alerting, dashboards, performance monitoring, and incident response processes.
- Establish proactive monitoring for platform health, usage, performance, security, and cost management.
- Support Site Reliability Engineering (SRE) practices and operational excellence initiatives.
- Provide technical leadership and mentorship to platform engineers, data engineers, and DevOps resources.
- Establish engineering standards, deployment patterns, and operational best practices.
- Lead troubleshooting of complex platform, infrastructure, and automation challenges.
- Drive continuous improvement through automation, standardization, and platform innovation.
- Bachelor's degree in Computer Science, Information Technology, Engineering, or related field.
- 8+ years of experience in Data Engineering, Platform Engineering, DevOps, or Cloud Infrastructure.
- 5+ years of hands-on experience with Azure cloud technologies.
- 3+ years of experience supporting Databricks platform deployments and administration.
- Strong experience with Terraform, Infrastructure-as-Code, CI/CD automation, and DevOps practices.
- Deep understanding of cloud security, identity management, networking, and platform governance.
- Experience implementing monitoring, observability, and operational support frameworks.
- Proven ability to lead technical initiatives and drive engineering best practices.
- Databricks Certified Data Engineer or Databricks Platform certifications.
- Microsoft Azure DevOps Engineer Expert certification.
- Experience with Unity Catalog, Delta Lake, Azure Data Lake Storage, Azure Key Vault, and Azure Monitor.
- Experience implementing Governance-as-Code and Policy-as-Code frameworks.
- Knowledge of GitHub Actions, Azure DevOps Pipelines, Jenkins, or similar automation platforms.
- Experience supporting enterprise Data Intelligence, Data Product, or AI platforms.
- Everforth Apex Benefits Overview: Everforth Apex offers a range of supplemental benefits, including medical, dental, vision, life, disability, and other insurance plans that offer an optional layer of financial protection.
- We offer an ESPP (employee stock purchase program) and a 401K program which allows you to contribute typically within 30 days of starting, with a company match after 12 months of tenure.
- Everforth Apex also offers a HSA (Health Savings Account on the HDHP plan), a SupportLinc Employee Assistance Program (EAP) with up to 8 free counseling sessions, a corporate discount savings program and other discounts.
- In terms of professional development, Everforth Apex hosts an on-demand training program, provides access to certification prep and a library of technical and leadership courses/books/seminars once you have 6+ months of tenure, and certification discounts and other perks to associations that include CompTIA and IIBA.
- Everforth Apex has a dedicated customer service team for our Consultants that can address questions around benefits and other resources, as well as a certified Career Coach.
- You can access a full list of our benefits, programs, support teams and resources within our 'Welcome Packet' as well, which an Everforth Apex team member can provide.
Everforth Apex Systems is an equal opportunity employer.
We do not discriminate or allow discrimination on the basis of race, color, religion, creed, sex (including pregnancy, childbirth, breastfeeding, or related medical conditions), age, sexual orientation, gender identity, national origin, ancestry, citizenship, genetic information, registered domestic partner status, marital status, disability, status as a crime victim, protected veteran status, political affiliation, union membership, or any other characteristic protected by law.
Everforth Apex will consider qualified applicants with criminal histories in a manner consistent with the requirements of applicable law.
If you require an accommodation under the Americans with Disabilities Act to participate in an interview with a virtual recruiter or to use our website for a search or application, please contact our Benefits Department at [email protected] or 804-523-8228. Please note that this contact information is strictly to be used for medical ADA accommodations and that no other inquiries will be answered.
UnitedHealthcare creates and publishes the Transparency in Coverage Machine-Readable Files on behalf of Everforth Apex Systems.
'/%3e%3cpath%20d='M101.744%2012.4726L102.894%2016.1947L99.0021%2013.2201L101.744%2012.4726ZM105.3%208.40937H100.488L99.0026%203.59473L97.5116%208.41047L92.7%208.40385L96.5965%2011.3834L95.1055%2016.1942L99.0021%2013.2196L101.408%2011.3834L105.3%208.40992V8.40937Z'%20fill='white'/%3e%3cdefs%3e%3clinearGradient%20id='paint0_linear_5593_1381'%20x1='90'%20y1='9.44471'%20x2='99'%20y2='9.44471'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%2300AD70'/%3e%3cstop%20offset='0.998594'%20stop-color='%2300B67A'/%3e%3cstop%20offset='1'%20stop-color='%23DCDCE6'/%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e){kind=small}
