Sr. Data Engineer

The Coca-Cola Company; Morelia; On-site; MXN 900,000 - 1,300,000; Full time

Job summary

The Coca‑Cola Company is seeking a Senior Data Engineer to design and implement scalable data integration pipelines using Spark with Scala, targeting batch and streaming workloads across Microsoft Fabric and Synapse Analytics.

You will optimize performance, tune memory and partitions, and develop REST-based JVM microservices. Emphasis on SOLID principles, testable code, and robust CI/CD pipelines using GitHub Actions, Maven, and SBT.

Qualifications

• Strong proficiency in Scala programming and functional concepts.
• Deep Spark experience (3+ years) with Scala/Java.
• Experience designing data models for analytics.
• Experience building REST-based microservices on the JVM.

Responsibilities

• Design and develop data integration pipelines and backend services using Apache Spark with Scala.
• Build and optimize distributed applications for batch and streaming workloads in Microsoft Fabric environments.
• Perform Spark performance tuning, memory configuration, partitioning, and query optimization.
• Develop RESTful microservices on the JVM for system interoperability.
• Apply functional programming and SOLID principles to clean, modular Scala code.
• Optimize data workflows for high-performance querying and cost efficiency.
• Champion the You Build It, You Run It philosophy and ensure reliability and maintainability.
• Lead CI/CD pipelines using GitHub Actions, Maven, and SBT for automation.

Skills

Scala programming

Apache Spark

REST microservices

JVM

Tools

Maven

SBT

GitHub Actions

Job description

At The Coca‑Cola Company, we believe data is the foundation for creating personalized experiences and powering sustainable growth in today’s digital-first world. As consumers engage with our brands in more connected ways than ever before, we are investing in advanced data and analytics platforms to unlock deeper insights, accelerate decision-making, and enable seamless innovation at scale.

In this role as a Sr. Data Engineer, you will play a critical part in shaping how data flows across our enterprise ecosystem. By leveraging your deep expertise in Spark, Scala development, and JVM-based engineering, you will design and implement integration frameworks that power both batch and streaming workloads on Microsoft Fabric and Synapse Analytics.

Core Responsibilities

• Design and develop data integration pipelines and backend services for structured and unstructured data, using Apache Spark with Scala.
• Build and optimize distributed computing applications that deliver scalable batch and streaming workloads within Microsoft Fabric environments.
• Perform advanced Spark performance tuning, including partitioning strategies, memory configuration, query optimization, and workload balancing across large datasets.
• Develop REST-based microservices and APIs on the JVM to enable seamless interoperability between internal and external systems.
• Engineer modular, testable, and maintainable code applying functional programming principles and industry-best patterns for reliability and performance.
• Optimize workflows through data partitioning strategies, storage formats, and platform configurations to enable high-performance querying and cost efficiency.
• Engineering Rigor: Champion the "You Build It, You Run It" philosophy. Apply strict functional programming and SOLID principles to write clean, modular, and testable Scala code.
• Performance Optimization: Conduct deep Spark performance tuning - managing memory, query plans, partitioning strategies, and capacity optimization to deliver highly efficient batch and streaming workloads within Microsoft Fabric.
• CI/CD & Automation: Architect and maintain robust CI/CD pipelines using GitHub Actions, Maven, and SBT to automate testing, deployment, and configuration of data artifacts.

Required Qualifications & Experience

• Strong proficiency in Scala programming with demonstrated knowledge of functional programming concepts, concurrency models, and modular system design.
• Spark Expertise (3+ years): Deep, hands‑on experience building, debugging and optimizing distributed computing applications using Apache Spark (Scala/Java preferred).
• Experience designing data models (STAR, Vault, Tabular) for analytics.
• Experience building REST based microservices on JVM.
• Synapse/Fabric Experience (3+ years of combined experience); Designing and transforming large data using Azure Data Services (Synapse, ADF, Azure Functions, ARM Templates).
• DevOps & CI/CD: Proven ability to build automated release cycles. Hands‑on expertise with Git, GitHub Actions, and build tools (Maven/SBT, UV are required).
• Demonstrated experience working with big data ecosystems such as Hadoop, Delta Lake, or similar technologies within cloud platforms (AWS, Azure, or GCP).
• Delivery: Experience in Agile development (Scrum, lean techniques) and collaborating with global engineering teams.