Business Intelligence Analyst

Arrow Components; Penang; On-site; MYR 150,000 - 200,000; Full time

Job summary

A leading technology company in Malaysia is seeking a skilled Business Intelligence Analyst to leverage Databricks for data analytics tasks. The ideal candidate should have at least 6 years of experience in Spark ecosystems, possess strong technical skills in data manipulation and Azure services. This role offers competitive salary, medical insurance, year-end bonuses, and growth opportunities.

Benefits

Medical Insurance

Life Insurance

Year-end bonus

Performance Bonus

5-Day Work Week

Growth Opportunities

Qualifications

• Overall 10 years of experience in the industry including 6+ years as a developer.
• Experience in developing Spark applications in Databricks.
• Proficiency with Azure services related to data analytics.

Responsibilities

• Develop Spark applications for data extraction and transformation.
• Manage and monitor Databricks clusters.
• Collaborate with teams to deliver projects on time.

Skills

Spark Data Frame API

Python for Data Science

Spark Programming

SQL for Data Analysis

Data Extraction and Transformation

Education

Bachelor’s Degree in IT relevant field

Tools

Azure Data Factory

Databricks

Spark SQL

Job description

Position

Business Intelligence Analyst

Job Description

What we're looking for:

• Overall 10 years of experience in Industry including 6+Years of experience as developer using Databricks/Spark Ecosystems.
• Hands on experience on Unified Data Analytics with Databricks, Databricks Workspace User Interface, Managing Databricks Notebooks, Delta Lake with Python, Delta Lake with Spark SQL.
• Good understanding of Spark Architecture with Databricks, Structured Streaming. Setting Microsoft Azure with Databricks, Databricks Workspace for Business Analytics, Manage Clusters In Databricks, Managing the Machine Learning Lifecycle
• Hands on experience Data extraction (extract, Schemas, corrupt record handling and parallelized code), transformations and loads (user - defined functions, join optimizations) and Production (optimize and automate Extract, Transform and Load)

Technical Skills

• Spark Data Frame API
• Python for Data Science
• Spark Programming
• SQL for Data Analysis
• Simplify Data analysis With Python
• Manage Clusters Databricks
• Databrick Administration
• Data Extraction and Transformation and Load
• Implementing Partitioning and Programming with MapReduce
• Setting up Azure Databricks Account
• Linux Command

What You'll Be Doing

• Experience in developing Spark applications using Spark-SQL in Databricks for data extraction, transformation, and aggregation from multiple file formats for Analyzing & transforming the data to uncover insights into the customer usage patterns.
• Extract Transform and Load data from sources Systems to Azure Data Storage services using a combination of Azure Data factory, T-SQL, Spark SQL, and U-SQL Azure Data Lake Analytics. Data ingestion to one or more Azure services (Azure Data Lake, Azure Storage, Azure SQL, Azure DW) and processing the data in Azure Databricks
• Develop Spark applications using pyspark and spark SQL for data extraction, transformation, and aggregation from multiple file formats for analyzing and transforming the data uncover insight into the customer usage patterns
• Hands on experience on developing SQL Scripts for automation
• Responsible for estimating the cluster size, monitoring, and troubleshooting of the Spark databricks cluster
• Ability to apply the spark DataFrame API to complete Data manipulation within spark session
• Good understanding of Spark Architecture including spark core, spark SQL, DataFrame, Spark streaming, Driver Node, Worker Node, Stages, Executors and Tasks, Deployment modes, the Execution hierarchy, fault tolerance, and collection
• Collaborate with delivery leadership to deliver projects on time adhering to the quality standards
• Contribute to the growth of the Microsoft Azure practice by helping with solutioning for prospects
• Problem-solving skills along with good interpersonal & communication skills
• Self-starter who can pick up any other relevant Azure Services in the Analytics space

What We Are Looking For

• Bachelor’s Degree in IT relevance field
• Minimum of 6-8 years of related experience;
• Excellent verbal and written communication and negotiations skills.
• Ability to build good relationship with internally with cross function teams.
• Proactive and strategic mindset
• Resilience, energetic and positive attitude

What’s In It For You

At Arrow, we recognize that financial rewards and great benefits are important aspects of an ideal job. That’s why we offer competitive financial compensation, including various compensation plans, and a solid benefits package.

• Medical Insurance
• Life Insurance
• Year-end bonus
• Performance Bonus
• 5-Day Work Week
• Growth Opportunities
• And more!

About Arrow

Arrow Electronics, Inc. (NYSE: ARW), an award-winning Fortune 154 and one of Fortune Magazine’s Most Admired Companies. Arrow guides innovation forward for over 220,000 leading technology manufacturers and service providers. With 2024 sales of USD $27.9 billion, Arrow develops technology solutions that improve business and daily life. Our broad portfolio that spans the entire technology landscape helps customers create, make and manage forward-thinking products that make the benefits of technology accessible to as many people as possible. Learn more at www.arrow.com.

Our strategic direction of guiding innovation forward is expressed as Five Years Out, a way of thinking about the tangible future to bridge the gap between what's possible and the practical technologies to make it happen. Learn more at https://www.fiveyearsout.com/.

For more job opportunities, please visit https://careers.arrow.com/us/en

Location

MY-Penang, Malaysia (Jalan Sultan Ahmad Shah)

Time Type

Full time

Job Category

Information Technology