Data Engineer (Remote)

TN Germany; Karlsruhe; Remote; EUR 60.000 - 100.000; Vollzeit

Zusammenfassung

Ein führendes Unternehmen in der Technologiebranche sucht einen erfahrenen Data Engineer, um innovative Datenlösungen zu entwickeln. In dieser Rolle werden Sie Teil eines dynamischen Teams, das sich auf die Verbesserung der Kundenerfahrung durch Datenanalysen und maschinelles Lernen konzentriert. Sie werden die Möglichkeit haben, an der Gestaltung der Zukunft der Organisation mitzuwirken und Verantwortung von Anfang an zu übernehmen. Das Unternehmen bietet eine unterstützende Arbeitsumgebung mit vielfältigen Coaching- und Weiterbildungsmöglichkeiten, einschließlich eines jährlichen Budgets für persönliche Entwicklung. Wenn Sie leidenschaftlich an Daten interessiert sind und in einem agilen Umfeld arbeiten möchten, ist dies die perfekte Gelegenheit für Sie.

Leistungen

Sports Subscription

German classes

€1000 yearly self-development budget

Qualifikationen

• 5+ Jahre Erfahrung als Data Engineer mit Expertise in Apache Spark.
• Starke SQL-Kenntnisse und Erfahrung mit CI/CD-Prozessen.
• Erfahrung mit Cloud-Technologien wie AWS oder GCP.

Aufgaben

• Entwicklung von Integrationen zwischen Systemen zur Verbesserung der Kundenerfahrung.
• Analyse von Kundendaten zur Unterstützung von Geschäftsentscheidungen.
• Entwicklung effizienter, latenzarmer Datenpipelines und Systeme.

Kenntnisse

Apache Spark (Python, Scala)

Apache Kafka

SQL

CI/CD processes

AWS

Terraform

Problem-solving

Tools

AWS (S3, EKS, Quicksight)

Databricks

Google Maps API

Segment.io

Blueshift

Zendesk

Jobbeschreibung

Social network you want to login/join with:

About TechBiz Global TechBiz Global is a leading recruitment and software development company. Our diverse, globally distributed team provides IT recruitment, outstaffing, outsourcing, software development, and different consulting services with a primary focus on making our partners achieve their business goals successfully. With headquarters in Germany we have successful clients all over the world. We can understand your unique needs. Our team has hands-on experience with the challenges that come with rapid growth and the IT sector. That’s why all of our offerings are built with a tech mindset.

About the Data Solution Team As a Data Engineer, you will join our Data Solution Team, which drives our data-driven innovation. The team is pivotal to powering our business processes and enhancing customer experiences through effective data utilization. Our focus areas include:

● Developing integrations between systems.

● Improving customer experience by leveraging statistical and machine learning models. Our tech stack includes:

● Cloud & Infrastructure: AWS (S3, EKS, Quicksight, and monitoring tools).

● Data Engineering & Analytics: Apache Spark (Scala and PySpark on Databricks), Apache Kafka (Confluence Cloud).

● Infrastructure as Code: Terraform.

● Integration Tools & APIs: Segment.io, Blueshift, Zendesk, Google Maps API, and other external systems

● Design, build, and own near-time and batch data processing workflows.

● Develop efficient, low-latency data pipelines and systems.

● Maintain high data quality while ensuring GDPR compliance.

● Analyze customer data and extract insights to drive business decisions.

● Collaborate with Product, Backend, Marketing, and other teams to deliver impactful features.

Requirements

● 5+ years of experience as a Data Engineer, with expertise in Apache Spark using Python and Scala.

● 3+ years of experience with Apache Kafka.

● Strong proficiency in SQL.

● Experience with CI/CD processes and platforms.

● Hands-on experience with cloud technologies such as AWS, GCP or Azure.

● Familiarity with Terraform.

● Comfortable working in an agile environment.

● Excellent problem-solving and self-learning skills, with the ability to operate both independently and as part of a team.

Nice to have

● Hands-on experience with Databricks.

● Experience with document databases, particularly Amazon DocumentDB.

● Familiarity with handling high-risk data.

● Exposure to BI tools such as AWS Quicksight or Redash.

● Work experience in a Software B2C company, especially in the FinTech industry.

What we offer

Our goal is to set up a great working environment. Become part of the process and:

● Shape the future of our organization as part of the international founding team.

● Take on responsibility from day one.

● Benefit from various coaching and training opportunities, including a Sports Subscription, German classes, and a €1000 yearly self-development budget.