Chief Data Software Engineer

EPAM Systems, Inc.; Brasil; Teletrabalho; BRL 350 000 - 700 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Healthcare benefits

Paid time off

Upskilling and certification courses

Global career opportunities

Resumo da oferta

EPAM Systems, Inc. is seeking a Chief Data Software Engineer to design and scale cloud data pipelines for analytics, reporting, and AI initiatives. You will collaborate with product, engineering, and business teams to deliver dependable solutions on Azure Databricks, Spark, Kafka, and modern governance practices.

You will lead data modeling, quality, and governance efforts while enabling enterprise reporting, dashboards, and self-service analytics across global teams.

Qualificações

• 7+ years of experience in data engineering or a related field.
• Hands-on proficiency in SQL, Python, PySpark, Scala, and Java.
• Deep expertise in Apache Spark, Spark SQL, Kafka, and Delta Lake.
• Strong experience with Azure Databricks, Unity Catalog, and Databricks Asset Bundles (DAB).
• Familiarity with Azure Data Factory (ADF), ADLS Gen2, Azure Key Vault, Cosmos DB, and Monitor.

Responsabilidades

• Architect scalable batch and streaming data pipelines.
• Engineer and optimize Databricks, Spark, and Kafka-based solutions.
• Establish data quality, governance, and observability standards.
• Create data models and reporting foundations for analytics and AI initiatives.
• Partner with Product, Engineering, and Business teams to deliver data-driven solutions.
• Enable enterprise reporting, dashboards, and self-service analytics platforms.
• Use AI tools and apply MCP, prompt engineering, and multiple LLMs in AI-assisted workflows.

Conhecimentos

Leadership

Data governance

Mentoring

Ferramentas

SQL

Python

PySpark

Scala

Java

Apache Spark

Spark SQL

Kafka

Delta Lake

Azure Databricks

Unity Catalog

Databricks Asset Bundles (DAB)

Azure Data Factory

ADLS Gen2

Azure Key Vault

Azure Cosmos DB

Azure Monitor

Git

CI/CD

Gradle

Descrição da oferta de emprego

We are seeking a Chief Data Software Engineer to build cloud-scale data pipelines and platforms for analytics, reporting, and AI-driven initiatives. You will partner with Product, Engineering, and Business to ship dependable solutions on Azure Databricks, Spark, Kafka, and modern governance practices.ResponsibilitiesArchitect scalable batch and streaming data pipelinesEngineer and optimize Databricks, Spark, and Kafka-based solutionsEstablish data quality, governance, and observability standardsCreate data models and reporting foundations for analytics and AI initiativesPartner with Product, Engineering, and Business teams to deliver data-driven solutionsEnable enterprise reporting, dashboards, and self-service analytics platformsUse AI tools such as Claude Code, GitHub Copilot, and similar platforms for development, testing, and productivity improvementsApply MCP, prompt engineering, and multiple LLMs in AI-assisted development workflowsRequirementsProven track record with 7+ years of experience in data engineering or a related fieldHands-on proficiency in SQL, Python, PySpark, Scala, and JavaDeep expertise in Apache Spark, Spark SQL, Kafka, and Delta LakeStrong experience with Azure Databricks, Unity Catalog, and Databricks Asset Bundles (DAB)Solid familiarity with Azure Data Factory (ADF), ADLS Gen2, Azure Key Vault, Azure Cosmos DB, and Azure MonitorThorough knowledge of Data Modeling, Data Quality, Data Governance, and PII HandlingDemonstrated background in Medallion Architecture (Bronze/Silver/Gold), CDC, and SCD Type 1 & Type 2Practical competency in Azure DevOps, Git, CI/CD, and GradleEnglish proficiency at B2+ (Upper-Intermediate) levelNice to haveFamiliarity with Tableau, ThoughtSpot, Cognos, and Data Visualization Best PracticesKnowledge of Semantic Layer Concepts, AI/BI Dashboards, and Databricks GenieUnderstanding of scalable data platforms, analytics, and reporting solutionsWe offerInternational projects with top brandsWork with global teams of highly skilled, diverse peersHealthcare benefitsEmployee financial programsPaid time off and sick leaveUpskilling, reskilling and certification coursesUnlimited access to the LinkedIn Learning library and 22,000+ coursesGlobal career opportunitiesVolunteer and community involvement opportunitiesEPAM Employee GroupsAward-winning culture recognized by Glassdoor, Newsweek and LinkedInEPAM is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, age, sexual orientation, gender identity or expression, disability, protected veteran status, or any other characteristic protected by applicable law.