Data Engineer: Scale Big Data Pipelines on Databricks

Auctane; Madrid; On-site; EUR 43,000 - 52,000; Full time

Benefits offered by this job

Salary range 43,000–52,000 € per year

Cobee benefits for expenses

Private health insurance via Cigna

26 days of holiday

Mac or Windows preference

Annual salary review

Up to €2,000/year training

LinkedIn Learning access

Wellness program

Volunteer day

Gym/fitness allowance up to €55/month

English language classes available

Work-life balance emphasis

Madrid central office

Referral bonuses

Packlink Pro discount

Job summary

Auctane is seeking a Data Engineer in Madrid to design, build, and operate data pipelines and analytics solutions. You will collaborate with cross-functional teams to implement the ShipStation Global data strategy and enable value extraction from large datasets.

You will contribute to the data platform architecture, ensure data quality and observability, and apply best practices in automation, CI/CD, and security to deliver reliable data products for our customers.

Qualifications

• Data engineering background in a lakehouse or data warehouse architecture.
• Experience developing and supporting robust, automated, and reliable data pipelines in Python and SQL.
• Mastered Python and SQL skills.
• Experience with data processing frameworks like Spark or dbt.
• Knowledge of Data Orchestration solutions, such as Databricks Lakeflow or Airflow.
• Knowledge of relational database design.
• Desire to challenge the norm with high engineering standards.
• Fast learner with interest in new technologies.

Responsibilities

• Design, build, and operate data pipelines and analytics solution using Databricks.
• Collaborate with Product Owner to implement ShipStation Global data strategy.
• Develop frameworks to acquire, process, monitor and extract value from enterprise-wide datasets.
• Contribute to the design and architecture of ShipStation Global's data platform.
• Contribute directly to the implementation and operations of our systems.
• Advocate data quality and observability principles using Databricks Lakeflow and Spark.
• Foster engineering excellence with automation, CI/CD, testing, security, etc.

Skills

Data Engineering

Python

SQL

Spark

Airflow

Tools

Databricks

Databricks Lakeflow

Terraform

CloudFormation

Tableau

Looker

Power BI

Job description

Auctane is seeking a Data Engineer in Madrid to design, build, and operate data pipelines and analytics solutions. You will collaborate with cross-functional teams to implement the ShipStation Global data strategy and enable value extraction from large datasets.

You will contribute to the data platform architecture, ensure data quality and observability, and apply best practices in automation, CI/CD, and security to deliver reliable data products for our customers.