Data Platform Lead

Ball Corporation; São José dos Campos; Presencial; BRL 180 000 - 300 000; Tempo integral

Resumo da oferta

Ball Corporation is seeking a senior data platform engineer to design, implement and support cloud‑based analytics and data capabilities. You will own data movement, governance, and engineering best practices across Azure services, driving scalable pipelines and secure data access for multiple teams.

You will collaborate with data engineering, product owners, and source data teams to deliver end‑to‑end data solutions, mentor engineers, and ensure production readiness with strong security and

Qualificações

• Bachelor's degree completed.
• Advanced English.
• Experience in designing and delivering large‑scale data engineering solutions using Agile/DevOps in a product model.

Responsabilidades

• Architect data movement techniques including replication and near real‑time transfer.
• Advise on data engineering tools and platform standards.
• Lead CI/CD policies, deployment gates, and reusable libraries.

Conhecimentos

English proficiency

SQL skills

Agile development

Formação académica

Bachelor's degree

Ferramentas

Azure Data Factory

Azure Databricks

Azure DevOps

Azure Blob Storage

Azure Data Lake

Azure Functions

Bicep scripting

Unity Catalog

Purview

Delta Live Tables

Descrição da oferta de emprego

Summary of the Position

Work closely with data engineering teams, source data application teams, and product owners to design, implement and support the data platform capabilities and analytics solutions that provide insights to enable better decisions. Implement data platform, data migration and data engineering solutions using Azure services (Azure Data Lake Storage, Azure Data Factory, Azure Functions, Azure Databricks, Unity Catalog, etc.). Perform multiple aspects of the development lifecycle – design, cloud engineering (infrastructure, network, security, administration), ingestion, preparation, data modeling, testing, CI/CD pipelines, performance tuning, deployments, consumption, BI, observability, alerting, and production support. Collaborate within a team environment as well as work independently as part of a DevOps team that owns and supports its product. Implement batch, streaming, and CDC data pipelines using cloud technologies. Define, promote and enforce coding standards, engineering best practices, and privacy and security guidelines across the platform.

Main Responsibilities

• Architectural ownership of data movement techniques including replication (CDC), messaging, and near real‑time data transfer.
• Deep understanding of backend infrastructure and how platform services are built on top of it.
• Knowledge of security approaches and tools for data storage, movement and access, including data catalog and access governance (Unity Catalog, Purview).
• Perform data acquisition requirements and design cost‑effective, reusable data acquisition patterns and ingestion accelerators.
• Provide guidance regarding the use of data engineering tools, their capability to deliver information, and subject‑matter expertise regarding current systems and emerging technology.
• Lead governance and enforcement of data pipeline patterns and standards — including pipeline scaffolding, shared libraries, CI/CD policies and deployment gates.
• Analyze and recommend changes to increase developer productivity, treating friction removal for engineering teams as a platform deliverable.
• Understand user needs as well as technical requirements and limitations when building platform services.
• Manage cross dependencies across teams to ensure alignment, and adjust team directions when gaps exist.
• Align with the strategy vision for various platform components and related services to increase adoption and deliver business results.
• Define and promote best practices and design principles for data engineering pipelines and platform architecture independently and in partnership with other data team members.
• Develop and propose options with pros/cons and risk, and work with stakeholders to finalize the best solution that meets business needs.
• Establish credibility with partners while managing expectations; ensure frequent, continuous and effective communication with team members, IT, and stakeholders to set expectations and negotiate priorities appropriately.
• Understand the underlying technologies and applications in the specified area of responsibility to direct how to design, develop, test, and implement requirements.
• Mentor and coach engineers on platform standards and best practices, acting as the technical reference for the data platform.

Minimum Qualifications

• Completed Bachelor's Degree.
• Advanced/Fluent level of English.
• Progressive experience in software solution development using agile, DevOps, operating in a product model that includes designing, developing, and implementing large‑scale applications or data engineering solutions.
• Progressive experience in cloud development and data lake experience (prefer Microsoft Azure), including Azure Data Factory, Azure Databricks, Azure DevOps, Azure Blob Storage, Azure Data Lake, Azure Functions, CI/CD with GitHub, Azure DevOps, and Bicep scripting.
• Experience in ADLS, Databricks (Unity Catalog, Delta Live Tables, Asset Bundles), ADF, Purview.
• Demonstrated experience defining platform standards, reusable frameworks or shared libraries consumed by multiple engineering teams.
• Strong SQL skills.

Ball Corporation is proud to be an Equal Opportunity Employer. We actively encourage applications from everyone. All qualified job applicants will receive consideration without regard to race, color, religion, creed, national origin, aboriginality, genetic information, ancestry, marital status, sex, sexual orientation, gender identity or expression, physical or mental disability, pregnancy, veteran status, age, political affiliation or any other non‑merit characteristic.

Global Grade 12