AWS and Azure Data Governance Engineer

IntelliDyne Jobs for Veterans; Washington (District of Columbia); Hybrid; USD 120,000 - 160,000; Full time

Benefits offered by this job

Medical, dental, vision

401(K) with company match

Flexible Paid Time Off

Paid holidays and parental leave

Military leave and government shutdown

Job summary

IntelliDyne, LLC in Washington, DC, seeks an AWS and Azure Data Governance Engineer to oversee data lifecycle migrations across cloud storage tiers, enforce governance, reduce costs, and maintain data integrity. You will design automated tiering policies, monitor migrations, and ensure security compliance in AWS and Azure environments.

Responsibilities include implementing S3/Azure lifecycle workflows, configuring governance standards, and collaborating with data owners to optimize storage

Qualifications

• 5+ years’ experience in cloud data management, storage architecture, data lifecycle management, or data governance (AWS and/or Azure focus strongly preferred).
• Bachelor’s degree in Computer Science, Information Systems, Data Management, or other relevant discipline.
• Must possess an active Secret clearance with the ability to obtain a US TS/SCI clearance.
• Hands-on experience with AWS S3 storage classes, lifecycle configuration, and AWS Lake Formation, as well as Azure Blob Storage tiering, lifecycle management policies, and Azure Data Lake Storage, including large-scale data migration processes across both platforms.
• Proficiency in scripting and automation for cloud data operations (Python with boto3, Azure SDK/PowerShell, AWS CLI, etc.), including infrastructure-as-code tools such as Terraform, AWS CloudFormation, or Azure Bicep for policy-as-code deployment.
• Experience with cloud monitoring, reporting, analytics, and cost optimization for storage resources.
• Strong knowledge of data governance principles, data classification, retention/archival policies, and security/compliance frameworks in regulated environments.
• Familiarity with federal compliance frameworks related to data governance (NIST SP 800-53, OMB Circular A-130, CUI handling requirements).
• Data classification, cataloging, metadata governance, and stewardship, including compliance, retention, and security policy enforcement across AWS/Azure environments
• Cloud storage cost optimization and FinOps practices
• Must have an active professional certification such as AWS Certified Data Engineer – Associate, AWS Solutions Architect – Associate or Professional, Azure Data Engineer Associate, Azure Administrator Associate, or an equivalent data governance or cloud storage certification.

Responsibilities

• Analyze data access patterns, usage frequency, and business requirements to design and implement data lifecycle management policies and automated tier transitions for AWS S3 storage classes (Standard, Intelligent-Tiering, Standard-IA, Glacier, Glacier Deep Archive) and Azure Blob Storage tiers (Hot, Cool, Cold, Archive), including data residing on EC2 instances and associated storage (EBS volumes and snapshots), to identify tiering opportunities and coordinate secure, efficient migrations to lower-cost storage classes.
• Configure, deploy, monitor, and maintain automated data migration workflows using AWS S3 Lifecycle policies, S3 Batch Operations, and Azure Blob Storage lifecycle management rules.
• Establish and enforce data governance standards, including data classification, metadata management, retention policies, access controls, encryption, and compliance requirements across AWS and Azure environments.
• Utilize cloud-native monitoring, analytics, and cost management tools (AWS CloudWatch, Storage Lens, Cost Explorer; Azure Monitor, Azure Advisor, Cost Management) to track migration status, performance, cost savings, and compliance.
• Collaborate with data owners, architects, and stakeholders to assess data sensitivity and value, recommend optimal storage tiers, and resolve issues related to accessibility, performance, or policy compliance during tier transitions.
• Provide recommendations for improving data governance processes, increasing automation of migrations, achieving storage cost optimization, and integrating with enterprise monitoring and service management platforms.

Skills

Data governance

Cloud data lifecycle management

Scripting (Python)

Cost optimization

Data classification

Education

Bachelor’s degree in Computer Science

Tools

AWS S3

Azure Blob Storage

Azure Data Lake Storage

AWS Lake Formation

Terraform

CloudFormation

Azure Bicep

PowerShell

Job description

The AWS and Azure Data Governance Engineer is responsible for monitoring, managing, and optimizing the lifecycle migration of data pools across storage tiers in cloud environments. This role focuses on the controlled transition of data from hot to warm, cool, cold, and archive storage classes within AWS S3 and EC2 storage solutions, as well as equivalent tiers in Azure Blob Storage and Azure Data Lake Storage. In this role, you will design and enforce automated data tiering policies, ensure strong data governance and compliance, optimize storage costs, maintain data integrity and accessibility, and use monitoring tools to oversee migration progress, performance, and adherence to retention and security requirements across AWS and Azure platforms.

Location: Washington, D.C. (Hybrid - 2 days onsite)

Clearance: Must possess an active Secret clearance with the ability to obtain a US TS/SCI clearance

Status: Exempt

Responsibilities

• Analyze data access patterns, usage frequency, and business requirements to design and implement data lifecycle management policies and automated tier transitions for AWS S3 storage classes (Standard, Intelligent-Tiering, Standard-IA, Glacier, Glacier Deep Archive) and Azure Blob Storage tiers (Hot, Cool, Cold, Archive), including data residing on EC2 instances and associated storage (EBS volumes and snapshots), to identify tiering opportunities and coordinate secure, efficient migrations to lower-cost storage classes.
• Configure, deploy,monitor, andmaintainautomated data migration workflows using AWS S3 Lifecycle policies, S3 Batch Operations, and Azure Blob Storage lifecycle management rules.
• Establish and enforce data governance standards, including data classification, metadata management, retention policies, access controls, encryption, and compliance requirements across AWS and Azure environments.
• Utilize cloud-native monitoring, analytics, and cost management tools (AWS CloudWatch, Storage Lens, Cost Explorer; Azure Monitor, Azure Advisor, Cost Management) to track migration status, performance, cost savings, and compliance.
• Collaborate with data owners, architects, and stakeholders to assess data sensitivity and value, recommendoptimalstorage tiers, and resolve issues related to accessibility, performance, or policy compliance during tier transitions.
• Provide recommendations for improving data governance processes, increasing automation of migrations, achieving storage cost optimization, and integrating with enterprise monitoring and service management platforms.

Qualifications

• 5+ years’ experience in cloud data management, storage architecture, data lifecycle management, or data governance (AWS and/or Azure focus strongly preferred).
• Bachelor’s degree in Computer Science, Information Systems, Data Management, or other relevant discipline.
• Must possess an active Secret clearance with the ability to obtain a US TS/SCI clearance
• Hands-on experience with AWS S3 storage classes, lifecycle configuration, and AWS Lake Formation, as well as Azure Blob Storage tiering, lifecycle management policies, and Azure Data Lake Storage, including large-scale data migration processes across both platforms.
• Proficiencyin scripting and automation for cloud data operations (Python with boto3, Azure SDK/PowerShell, AWS CLI, etc.), including infrastructure-as-code tools such as Terraform, AWS CloudFormation, or Azure Bicep for policy-as-code deployment.
• Experience with cloud monitoring, reporting, analytics, and cost optimization for storage resources.
• Demonstrates sound knowledge of the following areas:
• Strong knowledge of data governance principles, data classification, retention/archival policies, and security/compliance frameworks in regulated environments.
• Familiarity with federal compliance frameworks related to data governance (NIST SP 800-53, OMB Circular A-130, CUI handling requirements).
• Data classification, cataloging, metadata governance, and stewardship, including compliance, retention, and security policy enforcement across AWS/Azure environments
• Cloud storage cost optimization and FinOps practices
• Must have an active professional certification such as AWS Certified Data Engineer – Associate, AWS Solutions Architect – Associate or Professional, Azure Data Engineer Associate, Azure Administrator Associate, or an equivalent data governance or cloud storage certification.

About Us

IntelliDyne, LLC empowers government organizations through the delivery of quality, mission-aligned services and innovative, people-first IT solutions. IntelliDyne has earned the designation of a Top Workplace by providing an inclusive and supportive environment where employees have a voice and are challenged to provide innovative solutions to our clients of national, state, and local importance.

• Inclusive and supportive work environment
• Competitive compensation package
• Professional growth through annual subsidy for trainings, certifications, professional memberships as well as mentorships and job shadowing
• Medical, dental, vision, 401(K) with company match
• Flexible Paid Time Off Program, 11 holidays, paid parental leave, military leave, and government shutdown leave
• Rewards and recognition through peer awards, service year awards, spot bonuses, and annual company awards
• Wellness and mental health benefits
• Flexible work options

IntelliDyne is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status. For individuals with disabilities who would like to request an accommodation, please contact [e-mail] or 703-575-9715.