Data Engineer Manager

Vivadata; Jakarta Pusat; On-site; IDR 420,000,000 - 600,000,000; Full time

Job summary

Artefact in Jakarta continues to grow as a data service leader, seeking a Data Engineer Manager to design and maintain robust data pipelines using Python and SQL, ensuring efficient ETL across systems.

You will mentor engineers, partner with stakeholders, and leverage Azure, AWS or GCP, Spark and Kafka to deliver scalable data solutions and ML-enabled data flows.

Qualifications

• 8+ years of industry experience in data engineering.
• Proficiency in Python, SQL, and database management.
• Experience with Data Pipelines ETL, Cloud Services (Azure, AWS, GCP), ML Modeling, Spark & Kafka.
• Data modelling and modern data platform design concepts.
• Building and maintaining data platforms in Azure/AWS or GCP.
• Experience working with business stakeholders.
• Excellent communication skills to collaborate with teams and stakeholders.
• Strong business acumen with a start-up mindset.

Responsibilities

• Data Pipeline Development: Build and optimise data pipelines for seamless data flow across systems.
• Database Management: Ensure data integrity and implement storage/retrieval solutions.
• Cloud Services Integration: Architect scalable data solutions on Azure/AWS/GCP.
• Machine Learning Integration: Collaborate to integrate ML models into data pipelines.
• Utilising Spark & Kafka: Implement real-time data processing and analytics.
• Mentor and guide engineers, sharing knowledge and best practices.

Skills

Python

SQL

Data pipelines

Data modelling

Cloud services

Spark

Kafka

ML modeling

Stakeholder communication

Mentoring

Education

Bachelor's degree in Computer Science, Electronics and Communication Engineering

Tools

Azure

AWS

Google Cloud Platform

Job description

Artefact is a new generation of data service providers specialising in data consulting and data-driven digital marketing. It is dedicated to transforming data into business impact across the entire value chain of organisations. We are proud to say we’re enjoying skyrocketing growth. The backbone of our consulting missions, today our Data consulting team has more than 400 consultants covering all Artefact's offers (and more): data marketing, data governance, strategy consulting, product owner…

What you will be doing?

As a Data Engineer Manager, your role involves crafting and maintaining robust data pipelines, utilising Python and SQL, to ensure efficient extraction, transformation, and loading (ETL) of data.

Your Responsibilities Will Include

• Data Pipeline Development: Building and optimising data pipelines to facilitate seamless data flow across systems and platforms.
• Database Management: Managing databases, ensuring their integrity, and implementing data storage and retrieval solutions.
• Cloud Services Integration: Leveraging cloud services such as MS Azure, GCP, and AWS to architect and deploy scalable data solutions.
• Machine Learning Integration: Collaborating with teams to integrate machine learning models into data pipelines for enhanced data processing.
• Utilising Spark & Kafka: Implementing and working with Spark and Kafka for real-time data processing and analytics.
• Mentor and guide engineers, fostering knowledge sharing and best practices.

What we are looking for?

• 8+ years of industry experience in data engineering.
• Proficiency in Python, SQL, and database management.
• Experience with Data Pipelines ETL, Cloud Services (MS Azure, GCP, AWS), ML Modeling, Spark & Kafka.
• Data modelling and modern data platform design concepts
• Building and maintaining data platforms in Azure/AWS or GCP
• Experience working with business stakeholders either internally or externally
• Excellent communication skills to collaborate effectively within teams and with stakeholders.
• Strong business acumen with an interest in business-facing roles.
• Adaptability and a start-up mentality to thrive in a dynamic environment.
• Minimum of a bachelor's degree in Computer Science, Electronics, and Communication Engineering degrees.
• Already have authorization to work and already working in the market

Artefact is the place to be: come and build the future of data and AI

Innovation: We have a passion for creating impacting projects and believe innovation can come from anyone.

Action: We make things rather than telling people how to make them.

Collaboration: We believe in bringing talented people together, winning together, and in learning from each other.

Teamwork makes the dream works.

Artefact’s teams are made up of the best experts in their fields, and it’s our biggest responsibility to ensure their professional development and personal wellbeing.