Cloud Data Platform Lead (Databricks/AWS) — AI & Governance

Associated Builders and Contractors (ABC); Miami (FL); Hybrid; USD 170,000 - 210,000; Full time

Job summary

ITTConnect is seeking a Data Intelligence Platform Lead for a direct-hire full-time role with a major financial institution. The position is hybrid in Miami and requires hands-on leadership of a 10-person data team to deliver end-to-end data platform capabilities.

You will drive modernization from on-prem to a cloud-native stack on AWS, Databricks, and PySpark, aligning architecture, governance, data quality, and security with business goals and AI initiatives.

Qualifications

• 15+ years of experience in IT.
• Experience leading data platform, data engineering, analytics engineering, or data architecture initiatives.
• Practical understanding of Databricks, AWS data services, SQL Server, Airflow, dbt, and data ingestion patterns.
• Demonstrated ability to translate data governance, data quality, metadata, lineage, access control, and observability requirements into practical engineering standards.
• Experience coordinating platform migrations or modernization initiatives from legacy or on-premises environments to cloud-based architectures.
• Experience with Databricks Lakehouse architecture, Unity Catalog, data quality frameworks, CI/CD pipelines, and cloud-native monitoring practices.
• Experience with AWS services commonly used in data platforms, such as S3, IAM, networking, security controls, monitoring, and infrastructure automation.
• Familiarity with regulatory, security, and audit expectations in banking or financial services.
• Highly desirable fluency in Portuguese and/or Spanish.

Responsibilities

• Coordinate the Databricks environment on AWS, pipelines, governance, data quality monitoring, alerting, and platform observability.
• Define target-state solutions for ingestion, orchestration, processing, monitoring, security, and lifecycle in the Databricks ecosystem.
• Lead migration of on-premises data pipelines to Databricks, rebuilt as reusable, scalable, governed data products.
• Partner with technology, security, infrastructure, compliance, and business stakeholders to meet banking-grade operational, regulatory, and information security expectations.
• Coordinate the definition, documentation, and dissemination of the data product concept across the Data team and the broader bank.
• Establish governance, ownership, metadata, lineage, access, quality, monitoring, and lifecycle dimensions for data products.
• Review and strengthen governance practices in the current data warehouse environment, including data access workflows and standards.
• Define and document data quality dimensions, implement automated quality tests, and build end-to-end monitoring and alerting for critical data flows.

Skills

Data platform leadership

Data engineering

Analytics engineering

Data architecture

Databricks

AWS data services

SQL Server

Airflow

dbt

Data governance

Observability

CI/CD pipelines

Cloud security

Regulatory compliance

Banking knowledge

Portuguese/Spanish

Tools

Airflow

dbt

SQL Server

Unity Catalog

Job description

ITTConnect is seeking a Data Intelligence Platform Lead for a direct-hire full-time role with a major financial institution. The position is hybrid in Miami and requires hands-on leadership of a 10-person data team to deliver end-to-end data platform capabilities.

You will drive modernization from on-prem to a cloud-native stack on AWS, Databricks, and PySpark, aligning architecture, governance, data quality, and security with business goals and AI initiatives.