Data Governance Architect — Databricks & AWS

AIT Worldwide Logistics; Itasca (IL); Presencial; USD 118.000 - 177.000; Jornada completa

Descripción de la vacante

AIT Worldwide Logistics in Illinois is seeking a Senior Data Governance Engineer to lead enterprise data dictionary, metadata, and governance initiatives across Databricks and AWS. You will establish standards, collaborate with business stakeholders, and mentor teammates as the data platform grows.

You will oversee platform configuration, access management, FinOps, and the use of AI-enabled data tooling to enhance discovery and self-service analytics. Strong technical leadership is required.

Formación

• 5+ years in data governance, data management, analytics engineering, or data platform.
• 3+ years administering cloud-based data platforms on AWS, including IAM, S3, networking, security, and access management.
• 3+ years hands-on Databricks experience, including Unity Catalog administration, permissions, and Delta Lake.
• 3+ years developing or maintaining enterprise data dictionaries, metadata, data catalogs, business glossaries, lineage, or related data-governance capabilities.
• 1+ years using AI/GenAI-enabled tools, such as Databricks Genie, for data discovery, analytics, engineering, or documentation (preferred).

Responsabilidades

• Enterprise Data Dictionary, Metadata & Lineage: Own the development, implementation, and ongoing maintenance of AIT's enterprise data dictionary.
• Establish consistent definitions, naming standards, metadata, business terminology, and technical documentation for enterprise data assets.
• Develop and maintain lineage and source-to-target documentation that improves transparency and trust in enterprise data.
• Partner with business stakeholders, data owners, and subject matter experts to validate definitions and resolve inconsistencies.
• Integrate data dictionary, metadata, catalog, and governance practices with Unity Catalog, Databricks, and related enterprise tooling.
• Drive adoption of common data definitions and make trusted information easier for teammates to discover and understand.
• Establish the review cadence, change-control process, and ownership model that keep definitions current as the business evolves.
• Platform Configuration, Provisioning & Access Management: Administer Databricks workspace and Unity Catalog configuration, including catalogs, schemas, grants, groups, service principals, and related platform settings.
• Own user and workload provisioning and permissioning across the platform - onboarding, role and entitlement assignment, periodic access review, and deprovisioning.
• Administer and secure the AWS environment supporting AIT's Databricks platform, including IAM, S3, networking, connectivity, and permissions.
• Establish and maintain security, access, resource, and configuration standards, and document them so access decisions are consistent and auditable.
• Monitor platform capacity, utilization, and cloud costs, and apply FinOps and cost-governance controls for Databricks and associated AWS resources.
• Partner with infrastructure, security, and technology teams to ensure the platform meets AIT requirements for availability, security, scalability, and operational support.
• AI-Enabled Data Discovery & Delivery: Use Databricks Genie and other approved AI and GenAI capabilities to improve enterprise data discovery, analytics, documentation, and self-service.
• Configure and curate AI-enabled data experiences that allow users to interact more effectively with governed enterprise data.
• Ensure the dictionary and metadata layer is structured to support reliable AI-assisted discovery and natural-language querying.
• Identify opportunities to automate or accelerate documentation and data-management activities through AI-assisted tooling.
• Establish appropriate patterns and guardrails for reliable use of AI-enabled data capabilities.
• Evaluate emerging Databricks and AI capabilities and recommend adoption where they provide measurable business value.
• Data Platform Engineering & Automation: Build and maintain targeted data pipelines and transformations in Databricks using SQL, Python/PySpark, and Delta Lake to support governance, documentation, and reporting needs.
• Automate recurring platform, provisioning, and documentation tasks through scripting, platform APIs, and Infrastructure as Code such as Terraform.
• Implement data quality controls, monitoring, and alerting, and drive data reliability issues to resolution.
• Apply sound engineering practices for source control, testing, deployment, and observability in the work this role produces.
• Support existing pipelines and troubleshoot platform, access, and data-processing issues in partnership with the broader data engineering team.
• Produce clear technical documentation and operational procedures that improve platform sustainability and supportability.
• Collaboration & Technical Leadership: Partner with technology teams, analysts, business stakeholders, data owners, and other subject matter experts to translate requirements into governed, well-documented data.
• Contribute to AIT's data governance, security, access-control, retention, lineage, and lifecycle-management standards.
• Provide technical leadership, mentoring, and knowledge sharing to teammates working with AIT's data platform.
• Communicate complex technical and data-definition concepts clearly to both technical and non-technical audiences.
• Proactively identify platform and governance risks, gaps, and opportunities and recommend practical paths forward.
• As the data platform function grows, take on additional leadership responsibilities, which may include future direct reports.
• Performs other duties as assigned
• complies with all policies and standards
• The wage range for this position is $118,330-$177,490 and may vary based on geography as well as relative knowledge, skills, abilities, and experience.

Descripción del empleo

AIT Worldwide Logistics in Illinois is seeking a Senior Data Governance Engineer to lead enterprise data dictionary, metadata, and governance initiatives across Databricks and AWS. You will establish standards, collaborate with business stakeholders, and mentor teammates as the data platform grows.

You will oversee platform configuration, access management, FinOps, and the use of AI-enabled data tooling to enhance discovery and self-service analytics. Strong technical leadership is required.