Lead Data Engineer

JR Spain; Málaga; Presencial; EUR 60.000 - 90.000; Jornada completa

Descripción de la vacante

A growing company in the tech industry is seeking a Data Engineering Technical Lead to join their Data Products team based in Málaga. The role involves leading a team to design and maintain customer-facing data products while ensuring high engineering standards. Ideal candidates should have strong experience in data engineering, cloud platforms, and collaborative environments.

Formación

• Strong background in Data Engineering.
• Experience with creating automated, reliable data pipelines.
• Knowledge of data orchestration tools and cloud platforms.

Responsabilidades

• Lead a team of data engineers in designing and operating data systems.
• Collaborate with stakeholders to implement data product strategies.
• Ensure engineering excellence through best practices in CI/CD.

Conocimientos

Data Engineering

Python

SQL

AWS

Spark

DevOps

Herramientas

Airflow

Terraform

DBT

Kinesis

Descripción del empleo

Social network you want to login/join with:

About us

At Auctane, we are united by a passion to help sellers — wherever they are, however they operate — fulfill the promises they make to consumers. The Auctane mission is to fuel commerce through exceptional delivery. We enable businesses to meet rising customer expectations and make the world more accessible. Our brands deliver billions of products annually, totaling over $200 billion in value, worldwide. Auctane is a team of shipping and software experts committed to helping merchants move their ideas globally. Our family includes ShipStation, ShipWorks, ShipEngine, ShippingEasy, Stamps, Endicia, Metapack, Shipsi, GlobalPost, and Packlink. We partner with Amazon, UPS, USPS, eBay, BigCommerce, Shopify, WooCommerce, and Walmart.

Our values

[Insert values here]

About the role

This is a hands-on role for a Data Engineering Technical Lead within the Data Products team. You will impact the design, implementation, and maintenance of customer-facing data products. Data is central to Auctane's strategy. We operate at a fast pace, using the latest architecture patterns and technologies, processing thousands of events per second with a continuously growing dataset. We strive to improve our data platform and engineering stack to support growth and innovation, providing excellent service to our customers. Our culture is flat and open, emphasizing data-driven decisions, autonomy, and collaboration. We value energy, passion, and working with like-minded individuals.

What you'll be doing

• Lead and manage a team of data engineers, contributing to data pipeline and analytics system design, build, and operations using AWS technologies like S3, Athena, Lambda, Kinesis, and ECS.
• Motivate and develop team members, enhancing their skills and ownership.
• Collaborate with product owners and stakeholders to implement data product strategies.
• Develop frameworks and solutions for data acquisition, processing, monitoring, and value extraction.
• Design and architect data products, contribute to system implementation and operations.
• Support data analysts and scientists with automation, tooling, and data engineering expertise.
• Promote data quality and observability, utilizing tools like Airflow, dbt, and Spark.
• Define team roadmaps based on stakeholder input.
• Ensure engineering excellence through reliable software and data pipelines, following best practices like automation, version control, CI/CD, testing, and security.
• Implement and enforce data security and governance standards.
• Mentor junior colleagues and coach the team on best practices and patterns.

What are we looking for?

• Strong background in Data Engineering.
• Experience with automated, reliable data pipelines in Python and SQL.
• Experience with data processing frameworks like Spark, Trino (Athena), Pandas, or DBT.
• Experience with streaming data processing on cloud platforms (AWS, Azure, Google Cloud).
• Familiarity with CI/CD environments and automation.
• Knowledge of data orchestration tools like Airflow, Oozie, Luigi, or Prefect.
• Understanding of relational and non-relational database design.
• Experience designing distributed systems and understanding trade-offs.
• Familiarity with software engineering best practices, source control, automated deployment, and DevOps tools like Terraform.
• Comfort working in a geographically distributed team.

What will make you stand out?

• Production experience with large datasets.
• Experience with AWS and big data cloud technologies like EMR, Athena, Glue, BigQuery, Dataproc, Dataflow.
• Experience with Infrastructure as Code tools such as Terraform or CloudFormation.
• Knowledge of BI and analytics tools.