Big Data Engineer

INTECH Process Automation; Al Jubayl; On-site; SAR 260,000 - 420,000; Full time

Benefits offered by this job

Global Exposure

Competitive Compensation

Annual Bonus

Health & Wellness

Learning Opportunities

Work-Life Balance

Inclusive Environment

Job summary

INTECH AutomationIntelligence is seeking a Big Data Engineer to join our team and drive end-to-end analytics across Oil and Gas, Petrochemicals, Utilities and Manufacturing. You will design scalable ETL pipelines, ingest industrial sensor data, and deliver insights that boost safety and efficiency.

You’ll optimize the Cloudera/Hadoop stack, build real-time dashboards in Power BI and Tableau, and collaborate on OSI PI integrations, translating data into clear visuals for diverse stakeholders

Qualifications

• Bachelor's or Master's degree in Computer Science, Electrical Engineering, Telecommunication, or a related field.
• 5+ years of experience in data engineering, big data development, or BI.
• Strong hands-on experience with the Apache Hadoop ecosystem (Cloudera preferred): HDFS, Hive, Impala, Oozie.
• Expert PySpark/Scala for building data pipelines; real-time ingestion tools like NiFi; data migration with Sqoop.
• Strong SQL with relational databases (SQL Server, Oracle, IBM DB2, AWS RDS).
• Power BI and Tableau dashboards, server administration, performance tuning.
• Python for data analysis and scripting. Cloud AWS experience is a plus.
• Familiarity with OSI PI System for sensor data integration is beneficial.

Responsibilities

• Design, develop, and maintain robust ETL/ELT pipelines for pre-production and production.
• Ingest data from industrial sensors and enterprise sources.
• Implement data integration and transformation logic using PySpark, Scala, Sqoop, NiFi in Cloudera/Hadoop.
• Manage and schedule data workflows with Oozie or similar tools.
• Optimize storage and query performance with Hive, Impala, and HDFS.
• Develop real-time dashboards in Power BI and Tableau for KPIs.
• Translate complex datasets into user-friendly visuals for stakeholders.
• Lead dashboards for real-time monitoring and safety/performance use cases.
• Support predictive models by engineering necessary data features.
• Perform data analysis and ad-hoc reporting for manufacturing, energy, safety insights.
• Ensure data accuracy and reliability across reporting platforms.
• Assist in maintenance, configuration, and performance tuning of Cloudera and BI servers.
• Collaborate on OSI PI System integration with the data lake.

Skills

PySpark

Scala

SQL

Python

ETL/ELT

Big data

Data integration

Oozie

NiFi

Sqoop

Hive

Impala

Power BI

Tableau

OSI PI System

Education

Bachelor's or Master's in CS/EE/Telecom or related field

Tools

Cloudera Hadoop

HDFS

Hive

Impala

Oozie

NiFi

Sqoop

Job description

Description

About the job

Join our Team-Your career journey starts here - not just a job, but a future.

Our Potential Opportunity

INTECH AutomationIntelligenceis seeking aBig Data Engineerto join our dynamic team. This role is pivotal in supporting Industrial Digitalization Solutions across industries such as Oil & Gas, Petrochemicals, Utilities, and Manufacturing.Design and operate end-to-end big data and analytics solutions building scalable ETL/ELT pipelines, integrating industrial and enterprise data, optimizing Hadoop/Cloudera platforms, and delivering real-time, predictive dashboards that drive operational efficiency, safety, compliance, and data-driven decision-making.INTECH's commitment to providing cutting-edgeDigitalSolutions ensures you will contribute to transformative projects that enhance operational efficiency and productivity.

Our Digital Solutions

are a testament to our dedication to driving innovation and optimizing industrial processes, reflecting our focus on excellence, reliability, and overcoming industry challenges.

What You’ll Lead and Deliver

• Design, develop, and maintain robust ETL/ELT pipelines for both pre-production and production environments.
• Ingest data from diverse sources, including industrial sensors (pumps, boilers, storage tanks), relational databases (SQL, Oracle), and enterprise applications.
• Implement data integration and transformation logic using Scala, PySpark, Sqoop, and Apache NiFi within the Cloudera/Hadoop ecosystem.
• Manage and schedule data workflows using Oozie or similar orchestration tools.
• Optimize data storage and query performance using Hive, Impala, and HDFS for efficient analytics.
• Develop interactive and real-time dashboards in Power BI and Tableau to monitor critical business and operational KPIs.
• Translate complex technical datasets into user-friendly visualizations for stakeholders, enabling data-driven decision-making.
• Design dashboards for specific use cases such as:

• i) Real-time monitoring of sensor data (pumps, boilers) to improve plant uptime and save costs.
• ii) Track safety permits (ESWP), monitor workplace hazards (SHER, risk scores), and perform root-cause analysis on incidents.

• Support the development of predictive models, such as Hazard Prediction dashboards, by preparing and engineering the necessary data features.
• Perform data analysis and ad-hoc reporting to answer complex business questions related to plant manufacturing, energy, and safety.
• Ensure data accuracy, consistency, and reliability across all reporting and analytics platforms.
• Assist in the maintenance, configuration, and performance tuning of the Big Data platform (Cloudera) and BI servers (Tableau/Power BI).
• Collaborate on the integration of industrial systems (e.g., OSI PI System) with the big data lake for advanced analytics.

Requirements

To Be Successful in This Role, You Must Have:

• Bachelor's or Master's degree in Computer Science, Electrical Engineering, Telecommunication, or a related field.
• 5+ years of experience in data engineering, big data development, or business intelligence.
• Strong hands-on experience with the Apache Hadoop ecosystem (Cloudera distribution preferred) including HDFS, Hive, Impala, and Oozie.
• Expert-level proficiency in PySpark and Scala for building data pipelines. Experience with real-time data ingestion tools like Apache NiFi and data migration tools like Sqoop.
• Strong SQL skills and experience with relational databases (e.g., Microsoft SQL, Oracle, IBM DB2, Amazon RDS).
• Proficiency in Power BI and Tableau, including dashboard design, server administration, and performance optimization.
• Working knowledge of Python for data analysis and scripting.
• Cloud (Optional but beneficial): Experience with AWS data services (Amazon RDS, Glue, Redshift) is a plus.
• Industrial Systems (Optional but beneficial): Familiarity with OSI PI System for sensor data integration.

Local Saudi Nationals would be preferred for this role.

We Offer Competitive Benefits:

• Global Exposure:Opportunities to work on international projects and collaborate with global teams.
• Competitive Compensation:A salary package that recognizes your expertise and contributions.
• Annual Bonus:Performance-driven rewards based on your gross pay to celebrate yourachievements and contributions.
• Health & Wellness:Comprehensive medical insurance for you and your dependents.
• Learning Opportunities:Access to training programs, workshops, and certifications to enhance your skills.
• Work-Life Balance:Paid time off, including annual leave and holidays.
• Inclusive Environment: A workplace that celebrates diversity and fosters collaboration.

Why Join INTECH AutomationIntelligence?

At INTECH, you will have the opportunity to work with a globally renowned industrial automation and digitalization technology company. For nearly 30 years, INTECH has partnered with major oil and gasglobal giantsto deliver innovative solutions. As we continue to lead in the Industry 4.0 era, you will be at the forefront of transformative technologies that solve real-world challenges.

What to Expect After Applying?

Explore howINTECH'sTalent Acquisitionteam ensures a seamless hiring journey. From embracing talent with a passion for innovation to fostering a culture of continuous learning and growth, we're dedicated to finding and supporting the best minds in the industry.

Our hiring process is designed to assess your skills and potential in a fair and inclusive manner. After applying, you will be guided through a structured evaluation process to ensure mutual alignment.

INTECH Automation Intelligenceis an equal opportunity employer committed to fostering an inclusive hiring environment where qualified individuals with disabilities are encouraged to apply.