Senior Data Engineer

Cofco International; Barcelona; On-site; EUR 90,000 - 130,000; Full time

Job summary

COFCO International in Barcelona seeks a Senior Data Engineer to design, deliver and support scalable, cost-conscious data solutions across the enterprise data-lake and related platforms. You will own data pipelines end-to-end, mentor engineers, collaborate with analytics and governance teams, and guide Azure-based transformations and production stability in a fast-paced, global agri-business.

This role requires 10+ years in data engineering, Azure expertise, and strong coding skills in Python,

Qualifications

• 10+ years hands-on experience in designing, delivering and supporting enterprise data engineering solutions
• Proven Azure data engineering expertise and architecture knowledge

Responsibilities

• Deliver engineering and support work; mentor engineers; coordinate contributors
• Translate business data requirements into technical designs and delivery plans
• Design, develop and maintain end-to-end ETL/ELT pipelines and data models
• Guide Azure Data Factory and Azure Synapse delivery including SQL and Spark transformations
• Deliver integrations between source systems and data platforms; manage connectivity and security
• Support analytics and financial reporting data flows; validate extraction logic and reconciliation
• Own production support: monitoring, incident handling, root-cause analysis, improvements
• Implement data quality rules and remediation in pipelines and catalogs
• Ensure version control, code reviews, testing and controlled CI/CD releases
• Improve pipeline stability, scalability, and cloud consumption planning
• Plan technical modernization and runtime upgrades with Architecture and Operations
• Contribute to knowledge transfer, support coverage and documentation

Skills

Azure

Data pipelines

Mentoring

Team collaboration

Education

Bachelor’s or Master’s in CS/Engineering/IS

Tools

Azure Data Factory

Azure Synapse Analytics

SQL

Apache Spark

Python

Git

CI/CD

Job description

Select how often (in days) to receive an alert:

Barcelona, Barcelona, ES

COFCO International is a global agri-business with a clear vision, strong values and a positive culture, focused on being a leader in the global grains, oilseeds and sugar supply chains. We provide the food the world needs in a responsible way. Headquartered in Geneva, Switzerland, we are ambitious, with the right structures and culture to meet the world's increasing and changing needs. With 12,000+ people in 35 countries, our global portfolio includes assets across the Americas, Europe, Africa, Middle East, and Asia-Pacific. We trade with over 50 nations, while providing farmers unique direct access to the growing Chinese market.

JOB PURPOSE:

Provide hands-on expertise in designing, delivering and supporting reliable, secure, scalable and cost-conscious data solutions across COFCO International as a senior/specialist contributor within the Data Engineering team.

Take technical ownership of assigned data pipelines, integrations and data models, including the enterprise data-lake ecosystem and other business data solutions. Guide ingestion, transformation, storage and consumption of data for analytics, reporting and downstream applications.

Combine architecture, coding and troubleshooting with technical mentoring and coordination of assigned work. May lead engineers or external contributors on specific technical initiatives without holding a formal team-leader position. Work with business analysts, data product owners, project managers, Architecture, Data Governance, Security and Operations to translate requirements into maintainable solutions and ensure production continuity.

RESPONSIBILITIES:

• Deliver assigned engineering and support work; contribute to prioritization and estimates, mentor engineers and, where assigned, coordinate contributors on specific technical initiatives. Formal team management and overall capacity allocation remain with the line manager.
• Translate business and data requirements into technical designs, development estimates and delivery plans; communicate dependencies, risks and decisions early.
• Design, develop and maintain end-to-end ETL/ELT pipelines and data models across enterprise data-lake and other business data solutions; remain hands-on in coding, reviews and complex troubleshooting.
• Guide Azure Data Factory and Azure Synapse delivery, including SQL, Spark-based transformations, notebooks and pipeline orchestration; promote reusable patterns and maintainable technical documentation.
• Deliver integrations between source systems, data platforms and downstream consumers, including secure tabular-data extracts and file transfers; coordinate connectivity and access requirements with infrastructure and security teams.
• Support analytics and financial-reporting data flows, working with business and application teams to validate extraction logic, reporting periods, reconciliations and downstream data consistency.
• Take technical ownership of production support for assigned solutions: maintain monitoring, review alerts, investigate incidents, elevate promptly and deliver root-cause analysis and permanent corrective actions against agreed service levels; coordinate incident resolution where assigned.
• Implement agreed data-quality rules, validation and technical remediation in pipelines and catalogs, working with Data Governance, data product owners and business analysts; maintain clear ownership boundaries for functional data issues.
• Ensure version control, code reviews, automated testing and controlled CI/CD releases; maintain regression coverage, rollback arrangements, runbooks and production-readiness checks.
• Improve pipeline stability, scalability, performance and cloud consumption; evaluate load strategies, scheduling and environment usage to avoid unnecessary processing and cost.
• Plan technical modernization and runtime upgrades with Architecture and Operations; assess compatibility, security and operational impacts before deployment.
• Contribute to knowledge transfer, support coverage and technical documentation to reduce reliance on individuals; report delivery, service and capacity risks to the line manager.

REQUIREMENTS:

• Bachelor’s or Master’s degree in Computer Science, Engineering, Information Systems or a related discipline, or equivalent relevant professional experience.
• Relevant Azure or data-engineering certifications are desirable.
• 10+ years of hands‑on experience designing, delivering, and supporting enterprise data‑engineering solutions, including experience in Microsoft Azure.
• Experience providing technical guidance to data engineers, including mentoring, code reviews and collaboration with external service providers; experience coordinating delivery for specific technical initiatives is desirable. Formal people‑management experience is not required.
• 5+ years of practical experience with Azure Data Factory, Azure Synapse Analytics, SQL and Apache Spark, including pipeline orchestration and notebook‑based transformations.
• 3+ years of hands‑on experience using Python for data engineering, including data ingestion, transformation, validation, and automation.
• Experience with Microsoft Fabric is desirable to support a future migration.
• Experience with enterprise data lakes, ETL/ELT, data modeling, source‑system integration, and analytics/reporting data consumption.
• Experience troubleshooting production pipelines and data discrepancies, handling incidents, and implementing root‑cause fixes.
• Experience with Git, CI/CD, testing, environment promotion and regression validation for data‑platform changes and runtime upgrades.
• Experience optimizing pipeline performance and cloud consumption, balancing delivery priorities with ongoing operational support.

COFCO International is an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, color, religion, gender, sexual orientation, age, national origin, disability status, protected veteran status or any other characteristic protected by law.