ETL Developer - Big Data Analytics

Mission Consultancy Services

Kuala Lumpur

On-site

MYR 60,000 - 100,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Qualifications

Writes advanced SQL with some tuning for performance.
Identifies data quality issues and ensures data integrity.
Some database design experience is helpful.
Experience building ETL pipelines with listed technologies (SSIS/ODI/Informatica/Hadoop/Kafka/Teradata/Oracle/PostgreSQL).
Experience with real-time and batch data ingestion and Big Data concepts.
Familiar with Agile development processes and Linux environments.
Strong leadership and communication skills are required.

Responsibilities

Consults with users and technology groups to propose advanced solutions.
Manages all phases of the development process from analysis to implementation.
Provides user and operational support for applications.
Develops and troubleshoots Informatica code and ETL workflows.
Contributes to design and code reviews and adheres to ETL best practices.

Skills

Advanced SQL

Data quality

Ad-hoc data analysis

Leadership

Communication

Tools

SSIS

ODI

Informatica

Hadoop

Kafka

Teradata

Oracle

PostgreSQL

Linux

Job description

JOB SUMMARY

Our client is looking for ETL Analyst Developers to join their team. This role is responsible for all phases of the development process, including analysis, design, construction, testing, implementation, and providing application support while working with ETL technologies and Big Data solutions.

JOB DESCRIPTION

Consults with users, clients and other technology groups on issues and recommends advanced programming solutions.
Accountable for all phases of development process, analysis, design, construction, testing and implementation.
Provides user and operational support on applications to business users.
Solves / works complex problems / projects through in-depth evaluation of business processes, system processes and industry standards; performs root cause analyses.
Engages in post implementation analysis of business usage to ensure successful system design and functionality.
Provides sound understanding of Big Data apps development concepts and principles and knowledge of concepts and principles in other technology areas.
Provides evaluative judgment based on analysis of factual information in complicated and unique situations.
Directly impacts the business by ensuring the quality of work provided by self and others.
Impacts own team and closely related work teams. Exhibits sound and comprehensive communication and diplomacy skills to exchange complex information.
Building/interpreting design documents.
Building/interpreting mapping documents.
Building/completing test documents.
Participate in technical design & code reviews.
Understand & adhere to ETL best practice.
Develop & troubleshoot Informatica code.
Convert SQL scripts from Teradata syntax to GaussDB (PostgreSQL) syntax.

JOB REQUIREMENTS

Writes advanced SQL including some query tuning.
Experience in the identification of data quality.
Some database design experience is helpful.
Experience designing and building complete ETL (moving and transforming data) in either of these technologies:
- SSIS, ODS
- ODI, Informatica
- Hadoop, Kafka
- Data warehousing
- Teradata
- Oracle
- PostgreSQL
Utilize ad-hoc techniques to perform on-the-fly analysis of data.
Proficient in how to deploy to and debug a production environment.
Experience with real time and batch data ingestion frameworks.
Prefer Data management or data modeling experience within Big Data (Hive/Impala/Hbase).
Hands on Experience with open source software platforms Linux.
Agile development processes experience a plus.
Strong leadership, interpersonal, influence, negotiation, and written and verbal communication skills required.