Data Engineer (Remote)

TN Germany; Darmstadt; Remote; EUR 55.000 - 85.000; Vollzeit

Zusammenfassung

Ein innovatives Unternehmen sucht einen erfahrenen Data Engineer, um die Zukunft der Datenverarbeitung zu gestalten. In dieser Schlüsselrolle werden Sie Teil eines internationalen Gründungsteams und tragen dazu bei, die Kundenbindung durch datengestützte Lösungen zu verbessern. Sie werden an der Entwicklung von Integrationen zwischen Systemen arbeiten und statistische sowie maschinelle Lernmodelle nutzen, um die Kundenerfahrung zu optimieren. Diese Position bietet Ihnen die Möglichkeit, von Anfang an Verantwortung zu übernehmen und von Coaching- und Schulungsmöglichkeiten zu profitieren, einschließlich eines jährlichen Budgets für persönliche Entwicklung. Wenn Sie eine Leidenschaft für Daten und innovative Technologien haben, ist dies die perfekte Gelegenheit für Sie.

Leistungen

Sports Subscription

German classes

€1000 yearly self-development budget

Qualifikationen

• 5+ Jahre Erfahrung als Data Engineer mit Schwerpunkt auf Apache Spark.
• Starke SQL-Kenntnisse und Erfahrung mit CI/CD-Prozessen.

Aufgaben

• Entwerfen und Verwalten von Datenverarbeitungs-Workflows.
• Entwickeln von effizienten Datenpipelines und Systemen.

Kenntnisse

Apache Spark (Python, Scala)

SQL

Apache Kafka

AWS

CI/CD processes

Terraform

Problem-solving

Self-learning

Tools

AWS (S3, EKS, Quicksight)

Databricks

Google Maps API

Segment.io

Blueshift

Zendesk

Jobbeschreibung

Social network you want to login/join with:

About TechBiz Global: TechBiz Global is a leading recruitment and software development company. Our diverse, globally distributed team provides IT recruitment, outstaffing, outsourcing, software development, and consulting services, with a primary focus on helping our partners achieve their business goals successfully. Headquartered in Germany, we serve successful clients worldwide. We understand your unique needs, and our team has extensive experience with the challenges of rapid growth and the IT sector. All our offerings are built with a tech mindset.

About the Data Solution Team: As a Data Engineer, you will join our Data Solution Team, which drives data-driven innovation. The team is key to powering our business processes and enhancing customer experiences through effective data utilization. Our focus areas include:

• Developing integrations between systems.
• Improving customer experience by leveraging statistical and machine learning models.

Our tech stack includes:

• Cloud & Infrastructure: AWS (S3, EKS, Quicksight, monitoring tools).
• Data Engineering & Analytics: Apache Spark (Scala and PySpark on Databricks), Apache Kafka (Confluence Cloud).
• Infrastructure as Code: Terraform.
• Integration Tools & APIs: Segment.io, Blueshift, Zendesk, Google Maps API, and other external systems.

Responsibilities include:

• Designing, building, and managing near-time and batch data processing workflows.
• Developing efficient, low-latency data pipelines and systems.
• Maintaining high data quality while ensuring GDPR compliance.
• Analyzing customer data to extract insights for business decisions.
• Collaborating with Product, Backend, Marketing, and other teams to deliver impactful features.

Requirements

• 5+ years of experience as a Data Engineer, with expertise in Apache Spark using Python and Scala.
• 3+ years of experience with Apache Kafka.
• Strong proficiency in SQL.
• Experience with CI/CD processes and platforms.
• Hands-on experience with cloud technologies such as AWS, GCP, or Azure.
• Familiarity with Terraform.
• Comfortable working in an agile environment.
• Excellent problem-solving and self-learning skills, with the ability to operate independently and as part of a team.

Nice to have

• Hands-on experience with Databricks.
• Experience with document databases, particularly Amazon DocumentDB.
• Familiarity with handling high-risk data.
• Exposure to BI tools such as AWS Quicksight or Redash.
• Work experience in a Software B2C company, especially in the FinTech industry.

What we offer

We aim to create a great working environment. As part of our team, you will:

• Shape the future of our organization as part of the international founding team.
• Take on responsibility from day one.
• Benefit from coaching and training opportunities, including a Sports Subscription, German classes, and a €1000 yearly self-development budget.