Data Engineer (Analytics)

Experian; Dengkil; On-site; MYR 60,000 - 80,000; Full time

Job summary

A global data and technology company is seeking an Analytics Engineer to work within their Analytics Center of Excellence. This role will involve managing data at scale using various big data technologies, creating and maintaining data pipelines, and supporting client organizations in optimizing customer value through analytics-driven decisions. The ideal candidate will have experience in data warehouse technologies, SQL coding, strong interpersonal skills, and cloud platform knowledge, particularly with Azure.

Benefits

Competitive salary

Work-life balance

Professional development opportunities

Qualifications

• Strong coding skills in SQL, Python, Java, or Scala.
• Experience managing data at scale on cloud platforms.
• Knowledge of Lambda Architecture and its trade-offs.

Responsibilities

• Work on data productization using big data technologies.
• Manage and optimize data pipelines and workflows.
• Create measurable value for clients through analytics.

Skills

Data warehouse technologies

Data modeling

ETL development

SQL

Python

Java

Scala

Hadoop management

Big Data ML tools

Cloud experience

Tools

Apache Spark

Airflow

Kafka

RabbitMQ

Cloudera

MapR

Hortonworks

Job description

Experian is a global data and technology company, powering opportunities for people and businesses around the world. We help to redefine lending practices, uncover and prevent fraud, simplify healthcare, create marketing solutions, and gain deeper insights into the automotive market, all using our unique combination of data, analytics and software. We also assist millions of people to realize their financial goals and help them save time and money.

We operate across a range of markets, from financial services to healthcare, automotive, agribusiness, insurance, and many more industry segments.

We invest in people and new advanced technologies to unlock the power of data. As a FTSE 100 Index company listed on the London Stock Exchange (EXPN), we have a team of 22,500 people across 32 countries. Our corporate headquarters are in Dublin, Ireland. Learn more at experianplc.com.

Job Description

The role sits within our Decision Analytics, one of our four Global Business Lines.

Experian Decision Analytics helps client achieve and sustain significant growth. We do this by enabling clients to make analytics-based customer decisions that support their strategic goals. As experts in uniting business understanding with consumer and business information, analytics and strategy execution, we empower clients to optimise customer value and actively manage it over time. This role therefore has clear accountability for creating measurable value within our client organisations.

What you’ll be doing

In this role, you’ll be working as an Analytics Engineer within Analytics Center of Excellence on Experian’s internal Cloud Platform. You’ll be managing data at scale and working on key initiatives such as Data Productizations where we employ different big data technologies and back/front ends to build solutions for our clients.

More about you

• Experience in data warehouse technologies, data modeling and ETL development
• Experience in a high-performing, large-scale technology driven environment
• Exposure in creating/maintaining Data pipeline (Apache Spark or similar) and workflow tools (Airflow or similar) for both Realtime and batch use cases. Cloud experience (Azure is preferred)
• Basic understanding of ML, Deep learning, Wrappers and APIs
• Experience with Big Data ML toolkits, such as Mahout, SparkML, or H2O (Mandatory)
• Strong coding skill in SQL and (Python or Java or Scala)
• Exposure to Database architecture using RDBMS or NoSQL: Views/Tables, Disk usage and relational diagram
• Excellent communication, interpersonal skills, and proven project management skills.
• Management of Hadoop cluster, with all included services, and ability to solve any ongoing issues with operating the cluster
• Experience with building stream-processing systems, using solutions such as Storm or Spark-Streaming (Good to have)
• Good knowledge of Big Data querying tools, such as Pig, Hive, and Impala
• Experience with integration of data from multiple data sources
• Knowledge of various ETL techniques and frameworks, such as Flume
• Experience with various messaging systems, such as Kafka or RabbitMQ
• Good understanding of Lambda Architecture, along with its advantages and drawbacks
• Experience with Cloudera/MapR/Hortonworks

Qualifications

• Experience in data warehouse technologies, data modeling and ETL development
• Experience in a high-performing, large-scale technology driven environment
• Exposure in creating/maintaining Data pipeline (Apache Spark or similar) and workflow tools (Airflow or similar) for both Realtime and batch use cases. Cloud experience (Azure is preferred)
• Basic understanding of ML, Deep learning, Wrappers and APIs
• Experience with Big Data ML toolkits, such as Mahout, SparkML, or H2O (Mandatory)
• Strong coding skill in SQL and (Python or Java or Scala)
• Exposure to Database architecture using RDBMS or NoSQL: Views/Tables, Disk usage and relational diagram
• Excellent communication, interpersonal skills, and proven project management skills.
• Management of Hadoop cluster, with all included services, and ability to solve any ongoing issues with operating the cluster
• Experience with building stream-processing systems, using solutions such as Storm or Spark-Streaming (Good to have)
• Good knowledge of Big Data querying tools, such as Pig, Hive, and Impala
• Experience with integration of data from multiple data sources
• Knowledge of various ETL techniques and frameworks, such as Flume
• Experience with various messaging systems, such as Kafka or RabbitMQ
• Good understanding of Lambda Architecture, along with its advantages and drawbacks
• Experience with Cloudera/MapR/Hortonworks

Additional Information

Our uniqueness is that we celebrate yours. Experian's culture and people are important differentiators. We take our people agenda very seriously and focus on what matters; DEI, work/life balance, development, authenticity, collaboration, wellness, reward & recognition, volunteering... the list goes on. Experian's people first approach is award-winning; World's Best Workplaces™ 2024 (Fortune Top 25), Great Place To Work™ in 24 countries, and Glassdoor Best Places to Work 2024 to name a few. Check out Experian Life on social or our Careers Site to understand why.

Experian is proud to be an Equal Opportunity and Affiantative Action employer. Innovation is an important part of Experian's DNA and practices, and our diverse workforce drives our success. Everyone can succeed at Experian and bring their whole self to work, irrespective of their gender, ethnicity, religion, colour, sexuality, physical ability or age. If you have a disability or special need that requires accommodation, please let us know at the earliest opportunity.

Experian Careers - Creating a better tomorrow together

Find out what its like to work for Experian by clicking here

Be careful - Don’t provide your bank or credit card details when applying for jobs. Don't transfer any money or complete suspicious online surveys. If you see something suspicious, report this job ad.