Data Engineer – Future Talent Pool

Blue Bean Software; Centurion; On-site; ZAR 300,000 - 900,000; Full time

Job summary

Join a pioneering software company that is shaping the future of technology. As a Data Engineer, you will design and manage robust data pipelines, enabling organizations to harness data's power for insights and innovation. This role offers the chance to work in a collaborative environment with a flat organizational structure, where your contributions directly impact groundbreaking projects. If you are passionate about solving real-world problems with cutting-edge tech and want to be part of a community that values creativity and excellence, this opportunity is for you. Step into a world where your work makes a difference.

Qualifications

• Proven experience as a Data Engineer or in a similar role.
• Strong proficiency in big data tools and frameworks.
• Experience with ETL/ELT processes and tools.

Responsibilities

• Design and maintain scalable data pipelines for large data volumes.
• Integrate data from various sources ensuring quality and reliability.
• Collaborate with stakeholders to support data-driven decision-making.

Skills

Data Engineering

Problem Solving

Communication

Collaboration

Attention to Detail

Education

Relevant Certifications (e.g., AWS Certified Data Analytics)

Tools

Hadoop

Apache Spark

Kafka

Talend

Informatica

Apache NiFi

AWS

Azure

Google Cloud

Apache Airflow

Docker

Kubernetes

Git

Job description

What We Do

At Blue Bean Software, we’re not just building software—we’re shaping the future. As a leading custom software and product development company, we partner with both large enterprises and dynamic start-ups to solve their most complex challenges. From high-stakes projects in the financial services industry to groundbreaking ventures in agritech and healthtech, we deliver tailored solutions that blend cutting-edge technology with a deep understanding of our clients’ needs.

We’re pioneers in our field, constantly pushing boundaries and redefining what’s possible. If you’re passionate about solving real-world problems with innovative tech, you’ll find a home here.

Who We Are

Blue Bean Software is more than a workplace—it’s a community of brilliant minds. We’ve created an environment where software engineers, developers, and tech enthusiasts can thrive, grow, and express themselves freely. Here, you’ll have the freedom to master your craft, collaborate with like-minded professionals, and tackle challenges that inspire you.

We’re committed to fostering a culture of trust, integrity, and self-motivation. At Blue Bean, you’re not just an employee—you’re a valued member of a team that’s driven by curiosity, innovation, and a shared passion for excellence.

How We Work

Forget rigid hierarchies and red tape. At Blue Bean, we operate with a flat organisational structure that empowers every team member to make an impact. Collaboration is at the heart of everything we do, and we believe in giving our people the autonomy to make agile decisions and drive results.

We’re all about streamlined communication, creative problem-solving, and delivering exceptional customer service. Whether you’re working on a high-profile project or brainstorming the next big idea, you’ll have the support and freedom to excel.

Role Overview

We are continuously seeking skilled Data Engineers to join our talent pool for future opportunities. By submitting your details, you can be pre-vetted for roles where you can design, build, and manage robust data pipelines and infrastructure. Your expertise will enable organisations to harness the power of data, driving insights and innovation.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines to process and transform large volumes of data.
• Integrate data from various sources, ensuring data quality, consistency, and reliability.
• Optimise data storage and processing for performance, scalability, and cost efficiency.
• Collaborate with data scientists, analysts, and business stakeholders to support data-driven decision-making.
• Implement and manage big data platforms and tools suchstrong>Hadoop,Apache Spark, andKafka.
• Ensure data security, compliance, and governance across all data processes.
• Monitor and troubleshoot data pipelines to ensure smooth operation and minimal downtime.
• Stay updated with the latest trends and technologies in data engineering and big data.

Your Skills and Experience

• Proven experience as a Data Engineer or in a similar role.
• Strong proficiency in big data tools and frameworks (e.g.,Hadoop,Apache Spark,Kafka,Apache Flink).
• Expertise in programming languages such asPython,Java,Scala, orSQL.
• Experience with ETL/ELT processes and tools (e.g.,Talend,Informatica,Apache NiFi).
• Familiarity with cloud-based data solutions and services, including:
  • AWS(Redshift, Glue, EMR, S3)
  • Azure(Synapse, Data Factory, Databricks)
  • Google Cloud(BigQuery, Dataflow, Pub/Sub)
• Knowledge of database systems, including:
  • Relational databases (e.g.,PostgreSQL,MySQL,SQL Server)
  • NoSQL databases (e.g.,MongoDB,Cassandra,DynamoDB)
  • Data warehousing solutions (e.g.,Snowflake,Redshift,BigQuery)
• Experience with data modeling, data architecture, and data governance best practices.
• Familiarity with workflow orchestration tools likeApache AirfloworLuigi.
• Strong understanding of data security, compliance, and privacy regulations (e.g.,POPIA,GDPR).
• Knowledge of containerisation and orchestration tools (e.g.,Docker,Kubernetes) is a plus.
• Experience with version control systems (e.g.,Git) and CI/CD pipelines.
• Strong problem-solving skills and attention to detail.
• Excellent communication and collaboration skills.
• Relevant certifications (e.g.,AWS Certified Data Analytics,Google Cloud Data Engineer,Azure Data Engineer Associate) are a plus.

Additional Information

Competencies

• Capable of contributing to the development of innovative solutions.
• Proven ability to perform effectively under pressure and meet tight deadlines.
• Self-driven with a proactive approach to tasks and challenges.
• Strong team player with the ability to collaborate effectively in a team environment.

Why Submit Your Details?

By joining our talent pool, you’ll be first in line for exciting opportunities to become a part of our team, working on innovative projects and cutting-edge technologies.

Here, you’re more than just a developer or a designer—you’re a catalyst for change in how people interact with technology. Step into a world where digital products don’t just function—they make an impact. A world where you carve your own path to success, surrounded by a team that’s as authentic as it is exceptional.

Sound like your kind of place?

Take the leap and join us!