Data Engineer - Databricks - Mid Level

Lumenalta (formerly Clevertech); Calgary; Remote; CAD 80,000 - 120,000; Full time

Job summary

An innovative company is seeking a skilled professional to drive the evolution of a data-intensive platform. This role involves optimizing data pipelines and systems using cutting-edge technologies such as Scala, Spark, and Kafka, while balancing DevOps and development tasks. With a fully remote work environment and a focus on meaningful projects, you will collaborate with a talented team that values your growth. If you're ready to make an impact and shape the future of technology, this opportunity is perfect for you.

Benefits

Fully remote work

Rapid growth opportunities

Self-Improvement

Flexible work environment

Qualifications

• Expert-level experience with Hadoop, HDFS, Scala, Java, Apache Spark, and Kafka.
• Strong understanding of DevOps and infrastructure.

Responsibilities

• Drive the evolution of a data-intensive platform with a vision for AWS transformation.
• Lead efforts to optimize data pipelines and systems with Scala, Spark, Kafka, and Java.

Skills

Hadoop

HDFS

Scala

Java

Apache Spark

Kafka

DevOps

Job description

At Lumenalta, we create impactful software solutions that drive innovation and transform businesses. Since 2000, we’ve partnered with visionary leaders to build cutting-edge tech, solve complex challenges, and deliver results faster through our elite teams and tech-driven approach. Join us in shaping the future of technology.

With over 20 years of fully remote experience, Lumenalta offers:

• Fully remote work
• Rapid growth opportunities
• Self-Improvement

What You Will Work On:

• Drive the evolution of a data-intensive platform with a vision for AWS transformation
• Lead efforts to optimize data pipelines and systems with Scala, Spark, Kafka, and Java
• Assess and streamline the development team, enhancing architecture efficiency in AWS
• Balance DevOps and development, overseeing Spark/HDFS on bare metal and refining Scala code

Requirements:

• Expert-level experience with Hadoop, HDFS, Scala, Java, Apache Spark, and Kafka
• Strong understanding of DevOps and infrastructure, especially with Spark/HDFS on bare metal servers
• CET working hours (location in CET not required)
• Proactive and team-oriented approach

Why Lumenalta?

• Work on meaningful, impactful projects.
• Collaborate with a talented, supportive team
• Enjoy a flexible, remote-first environment
• Join a company that values your growth