Senior Data Engineer - Data/Backend

TN Germany; Berlin; Vor Ort; EUR 60.000 - 100.000; Vollzeit

Zusammenfassung

An established industry player is seeking a Senior Data Engineer to enhance its Data Platform team, pivotal in ensuring efficient and secure data flow across the organization. This role involves designing scalable real-time data pipelines and collaborating with infrastructure teams to facilitate seamless data integration. With a strong emphasis on data-driven decision-making, the ideal candidate will possess a robust background in back-end engineering and a passion for tackling complex technical challenges. Join a forward-thinking company where your contributions will significantly impact the future of data management and analytics.

Qualifikationen

• 3+ Jahre Erfahrung in der Back-End-Entwicklung mit Fokus auf Datenverarbeitung.
• Erfahrung in der Gestaltung und Implementierung von Echtzeit-Datenverarbeitungssystemen.

Aufgaben

• Zusammenarbeit mit Infrastrukturengineering zur Integration und Softwareentwicklung.
• Entwicklung sicherer und skalierbarer Datenservices mit Go, Scala und Java.

Kenntnisse

Back-end Engineering

Data Processing Pipelines

Real-time Data Processing

Problem Solving

Tools

Google Cloud Platform

Kafka

Kubernetes

Spark

Airflow

Terraform

Jobbeschreibung

SoundCloud empowers artists and fans to connect and share through music. Founded in 2007, SoundCloud is an artist-first platform empowering artists to build and grow their careers by providing them with the most progressive tools, services, and resources. With over 400 million tracks from 40 million artists, the future of music is SoundCloud.

Job Title: Senior Data Engineer

We’re looking for a Senior Data Engineer to join our Data Platform team, which is responsible for the efficient, reliable, secure, and compliant propagation of all datasets across the company to our data warehouses. At SoundCloud, we rely heavily upon data-driven, informed decision making, and the Data Platform team is key to enabling that.

Key Responsibilities:

1. Collaborate with infrastructure engineering on the back-end side, focusing on integrations and building software to facilitate data flow from source to data warehouse and real-time data transformation systems.
2. Design and implement highly scalable, distributed, real-time data pipelines.
3. Develop secure and scalable data services using languages like Go, Scala, and Java.
4. Utilize Google Cloud Platform services such as DataFlow, BigTable, AI Platform, BigQuery, Kafka, Kubernetes, Spark, Airflow, and Terraform.

Experience and Background:

• 3+ years of experience in back-end engineering, including 1-2 years setting up data processing pipelines, preferably in GCP.
• Experience designing and implementing real-time data processing systems and making informed technical decisions.
• Strong individual contributor with a passion for solving challenging technical problems.
• Comfortable participating in architecture discussions and planning improvements.
• Experience with large-scale data infrastructure (PBs scale) and understanding associated tradeoffs.

Nice-To-Have:

• Experience with Cloud Migrations.
• Experience deploying ML models in production.
• Experience with DevOps tools and technologies.