Data Engineer (Remote)

TN Germany; Bergisch Gladbach; Remote; EUR 60.000 - 100.000; Vollzeit

Zusammenfassung

Join a forward-thinking company as a Data Engineer and be part of an innovative team driving data-driven solutions. You'll leverage your expertise in Apache Spark and cloud technologies to design efficient data pipelines and improve customer experiences. This role offers you the opportunity to shape the future of the organization while enjoying a supportive work environment with coaching and training opportunities. If you're passionate about data and want to make a significant impact, this is the perfect role for you.

Leistungen

Sports Subscription

German classes

€1000 yearly self-development budget

Qualifikationen

• 5+ years of experience as a Data Engineer with Apache Spark expertise.
• Strong proficiency in SQL and experience with CI/CD processes.

Aufgaben

• Design and maintain data processing workflows and pipelines.
• Collaborate with teams to deliver impactful features.

Kenntnisse

Apache Spark (Python, Scala)

Apache Kafka

SQL

CI/CD processes

AWS

Terraform

Problem-solving skills

Tools

AWS (S3, EKS, Quicksight)

Databricks

Google Maps API

Segment.io

Blueshift

Zendesk

Jobbeschreibung

Social network you want to login/join with:

col-narrow-left

Client:

Location:

Job Category:

-

EU work permit required:

Yes

col-narrow-right

Job Reference:

07e163b5863a

Job Views:

7

Posted:

30.04.2025

Expiry Date:

14.06.2025

col-wide

Job Description:

About TechBiz Global

TechBiz Global is a leading recruitment and software development company headquartered in Germany, with a diverse, globally distributed team. We provide IT recruitment, outstaffing, outsourcing, software development, and consulting services, focusing on helping our partners achieve their business goals. Our team has extensive experience with the challenges of rapid growth in the IT sector.

About the Data Solution Team

As a Data Engineer, you will join our Data Solution Team, which drives data-driven innovation and enhances customer experiences through effective data utilization. Our focus areas include:

• Developing integrations between systems.
• Improving customer experience by leveraging statistical and machine learning models.

Our tech stack includes:

• Cloud & Infrastructure: AWS (S3, EKS, Quicksight, monitoring tools).
• Data Engineering & Analytics: Apache Spark (Scala and PySpark on Databricks), Apache Kafka (Confluence Cloud).
• Infrastructure as Code: Terraform.
• Integration Tools & APIs: Segment.io, Blueshift, Zendesk, Google Maps API, and other external systems.

Responsibilities include:

• Designing, building, and maintaining near-time and batch data processing workflows.
• Developing efficient, low-latency data pipelines and systems.
• Maintaining high data quality and GDPR compliance.
• Analyzing customer data to extract insights for business decisions.
• Collaborating with Product, Backend, Marketing, and other teams to deliver impactful features.

Requirements

• 5+ years of experience as a Data Engineer, with expertise in Apache Spark using Python and Scala.
• 3+ years of experience with Apache Kafka.
• Strong proficiency in SQL.
• Experience with CI/CD processes and platforms.
• Hands-on experience with cloud technologies such as AWS, GCP, or Azure.
• Familiarity with Terraform.
• Comfortable working in an agile environment.
• Excellent problem-solving and self-learning skills, with the ability to operate both independently and as part of a team.

Nice to have

• Hands-on experience with Databricks.
• Experience with document databases, particularly Amazon DocumentDB.
• Familiarity with handling high-risk data.
• Exposure to BI tools such as AWS Quicksight or Redash.
• Work experience in a Software B2C company, especially in the FinTech industry.

What we offer

Our goal is to create a great working environment. As part of our team, you will:

• Shape the future of our organization as part of the international founding team.
• Take on responsibility from day one.
• Benefit from various coaching and training opportunities, including a Sports Subscription, German classes, and a €1000 yearly self-development budget.