Data Engineer

Shopfully; Town of Italy (NY); On-site; USD 90,000 - 120,000; Full time

Job summary

Shopfully is seeking a Data Engineer to join our Engineering team. In this role, you'll play a key part in enhancing our digital shopping marketplace by utilizing technologies like Spark, Kafka, and AWS. You will be responsible for building and maintaining data pipelines that drive data-driven decisions. The ideal candidate has a bachelor's degree in Computer Science, at least 2 years of experience with data pipelines, and is passionate about utilizing data in a global team environment.

Qualifications

• 2+ years of work experience in building data pipelines ingesting and transforming large data sets.
• 2+ years of work experience in big data technologies such as Spark, Kafka, Airflow.
• Track record of shipping quality code and delivering high quality features.

Responsibilities

• Join a team of talented data engineers using big data technologies.
• Create real-time streaming and batch data pipelines to support data-driven decisions.
• Improve and maintain data warehousing solutions.

Skills

Experience with Spark

Experience with Kafka

Experience with AWS

Experience with Scala

Experience with Python

Experience with Airflow

Education

Bachelor’s degree in Computer Science/Engineering or equivalent

Tools

Databricks

Job description

Data Engineer – Europe

We are looking for a Data Engineer to join our Engineering team in Europe. In this role, you will be a key player in building the next generation of our digital shopping marketplace. You’ll work with massive datasets and cutting‑edge technologies like Spark, Kafka, and AWS to ingest, process, and distribute data at scale.

Responsibilities

• Join a team of talented data engineers who use cutting‑edge big data technologies to solve impactful business problems.
• Work directly with Engineering, Data Science & Data Analysts teams to create both real‑time streaming and batch data pipelines that power data‑driven decisions across the organization.
• Improve and maintain our data warehousing solutions and deliver trusted and easy‑to‑use datasets to both internal & external stakeholders.
• Participate in design discussions with other team members and find innovative solutions to new and existing business problems.
• Develop and enhance continuous integration and continuous delivery (CI/CD) pipelines for the team.
• Explore new technology options for data processing, storage, and share them with the team.
• Develop tools and contribute to internal & open source projects wherever possible.

Qualifications

• Bachelor’s degree in Computer Science/Engineering or equivalent.
• 2+ years of work experience in building data pipelines ingesting and transforming large data sets.
• 2+ years of work experience in big data technologies such as Spark, Kafka, Airflow, etc.
• Work experience in one or more general purpose programming languages, preferably Scala, Python.
• Track record of shipping quality code and delivering high quality features.
• You are passionate about data and driving a data‑driven culture in the organization.
• Hands‑on experience with AWS ecosystem and Databricks.
• Prior experience working in a distributed, global team across time zones.