Data streaming architect

Job Title: Data Streaming Architect (GCP)

We are seeking a highly skilled Data Streaming Architect with expertise in GCP to design and implement real-time data streaming solutions. The ideal candidate will have a deep understanding of event-driven architectures, streaming technologies, and cloud-based data platforms, ensuring optimal performance, scalability, and reliability of enterprise data streaming solutions.

Responsibilities:

1. Design and implement real-time data streaming architectures using GCP services and other technologies.
2. Develop solutions leveraging Apache Kafka, Cassandra, GCP, and other real-time data streaming technologies.
3. Handle real-time streaming data pipelines for network performance and customer insights.
4. Design and implement cloud data warehousing architectures, with a preference for GCP BigQuery.
5. Architect, deploy, and optimize event-driven and microservices-based architectures.
6. Define and enforce best practices for data ingestion, transformation, and pipeline optimization.
7. Ensure high availability, fault tolerance, and security of data streaming solutions.
8. Collaborate with data engineers, cloud architects, DevOps teams, and stakeholders to align strategies.
9. Implement monitoring and alerting mechanisms for streaming pipelines.
10. Evaluate and recommend emerging technologies to enhance capabilities.

Required Qualifications:

1. 12+ years of experience in data architecture, cloud computing, and real-time data processing.
2. Hands-on experience with Apache Kafka (Confluent), Cassandra, and related technologies.
3. Strong expertise in GCP, including Pub/Sub, Cloud Functions, Datastore, and Cloud Spanner.
4. Experience with message queues (e.g., RabbitMQ) and event-driven patterns.
5. Proficiency with data serialization formats like Avro, Parquet, JSON, and schema registries.
6. Understanding of DevOps and CI/CD pipelines for data streaming solutions.
7. Familiarity with containerization and orchestration tools.
8. Excellent communication and leadership skills, with cross-team collaboration experience.
9. Knowledge of programming languages such as Python, Java, or Scala for real-time processing.

Additional Notes:

Please note that if you are not a passport holder of the country for the vacancy, you might need a work permit. Check our Blog for more information.

Bank or payment details should not be provided when applying. All applications should be made via the 'Apply now' button.

Created on 26/04/2025 by TN United Kingdom