Lead Data & Streaming Architect — Java, Spark, Kafka

Talan Group; Bogotá; Hybrid; COP 172,723,504 - 241,812,905; Full time

Benefits offered by this job

Career development opportunities

Training opportunities in finance and technology

Job summary

Talan Group is seeking an experienced Tech Lead to drive the design and development of scalable data processing solutions in Bogotá, Colombia. As a Tech Lead, you will provide technical leadership across data engineering initiatives and mentor teams, ensuring high-performance distributed systems built on modern cloud and big data technologies.

The ideal candidate will have strong expertise in Java, Apache Spark, Kafka, and cloud platforms like AWS, emphasizing collaboration and innovation.

Qualifications

• Strong experience with Java development in enterprise environments.
• Solid expertise in Apache Spark, including Spark SQL and Structured Streaming.
• Hands-on experience with the Cloudera ecosystem.

Responsibilities

• Lead the technical design and implementation of large-scale data applications.
• Define architecture standards and best practices for data platforms.
• Design, develop, and optimize data pipelines using Apache Spark and Kafka.

Skills

Java development

Apache Spark

Apache Kafka

Cloud platforms (AWS)

API design (OpenAPI)

Tools

Cloudera ecosystem

Databricks

Job description

Talan Group is seeking an experienced Tech Lead to drive the design and development of scalable data processing solutions in Bogotá, Colombia. As a Tech Lead, you will provide technical leadership across data engineering initiatives and mentor teams, ensuring high-performance distributed systems built on modern cloud and big data technologies.

The ideal candidate will have strong expertise in Java, Apache Spark, Kafka, and cloud platforms like AWS, emphasizing collaboration and innovation.