Solution Engineer (Data)

Copious Software; Johannesburg; On-site; ZAR 40 000 - 80 000; Full time

Job summary

An established industry player is seeking a skilled Solution Engineer to join their Data vertical. In this exciting role, you will design and implement data solutions on the Microsoft Azure cloud platform, ensuring data-driven decision-making across the organization. You will be responsible for creating and maintaining data pipelines, storage solutions, and integration processes while collaborating with talented teams to meet data needs. This innovative firm offers a dynamic work environment with opportunities for professional growth and development, making it an excellent choice for those passionate about technology and data engineering.

Benefits

Better income structure

Team get-togethers

Workation trips

Up-skilling & re-skilling

Dedicated account manager

Qualifications

• 5+ years of experience in Data Engineering with expert knowledge in SQL.
• Experience with Azure tools for data processing and storage solutions.

Responsibilities

• Design and maintain data pipelines for ingestion and processing in Azure.
• Collaborate with teams to create effective data workflows.

Skills

SQL

Data Engineering

Azure Data Factory

Pyspark

Machine Learning

Unix/Linux Administration

Big Data Principles

DevOps/DataOps

Education

Bachelor's degree in Computer Science

BCA or MCA

Tools

Azure SQL Database

Azure Data Lake

Azure Blob Storage

Synapse Analytics

Databricks

PowerBI

Job description

Ready to embark on this thrilling journey? Apply now and let's revolutionize the economic and technology landscape together!

About Copious

At Copious, we believe in People, Knowledge, and Solutions.

We believe that when you bring those three things together, you can create something truly valuable.

That's why we bring together engaged talents to provide high-value technology services that help our consultants and clients succeed.

Copious is a Talent & Technology services company dedicated to helping businesses grow.

Since [year], we've been partnering with our talents and clients to create Career and Business solutions for the Peoples in the business and technology ecosystem.

We're here to help you thrive in today's fast-paced world of work.

We offer API Test Automation, Salesforce Services, Business Intelligence & Analytics, SAP Services, and Talent Solutions Services.

We are present in South Africa, India, Singapore & soon in UAE.

Why Work with Us

• Better income structure for more take-home.
• Team get-togethers & workation trips.
• Work on the latest Tech Stacks with a choice from many clients.
• Up-skilling & re-skilling.
• A dedicated account manager is assigned who works closely with your engagement.

About Clients

Imagine working with industry-leading customers who are changing the game and disrupting the landscape in sectors like Finance, Insurance, Banking, and Retail.

Role

As a Solution Engineer in the Data vertical, you will be expected to design, implement, and manage data solutions on the Microsoft Azure cloud platform.

You will be in charge of creating and maintaining data pipelines, data storage solutions, data processing, and data integration to enable data-driven decision-making inside a company.

Responsibilities

1. Design, implement, and maintain data pipelines for data ingestion, processing, and transformation in Azure.
2. Work together with data teams and analysts to understand the needs for data and create effective data workflows.
3. Create and maintain data storage solutions including Azure SQL Database, Azure Data Lake, and Azure Blob Storage.
4. Utilize Azure Data Factory or comparable technologies to create and maintain ETL (Extract, Transform, Load) operations.
5. Implement data validation and cleansing procedures to ensure data quality, integrity, and dependability.
6. Improve the scalability, efficiency, and cost-effectiveness of data pipelines.
7. Monitor and resolve data pipeline problems to guarantee data consistency and availability.

Requirements

1. Minimum 5+ years of experience in Data Engineering.
2. Expert knowledge in SQL and experience with MS Azure tools such as Data Factory, Synapse Analytics, Data Lake, Databricks, Pyspark, Azure Stream Analytics, and PowerBI.
3. Modern Azure data warehouse skills.
4. Expertise in Unix / Linux administration including shell script development.
5. Experience working on large and complex datasets.
6. Understanding and application of Big Data and distributed computing principles (Hadoop and MapReduce).
7. ML model optimization skills in a production environment.
8. Experience with machine learning and AI in a production environment.
9. DevOps / DataOps and CI / CD experience.

Qualification & Certifications

Bachelor's degree in Computer Science or BCA or MCA or a related tech education.