Senior, Lead Data Engineer

Nu10 Technologies; Riyadh; On-site; SAR 120,000 - 150,000; Full time

Job summary

A leading company in the IT software services sector is seeking a Senior Data Engineer to design and manage data infrastructure. This role involves optimizing data workflows, managing ETL processes, and ensuring data governance standards. Ideal candidates will have expertise in tools like Cloudera, PySpark, and Spark, and will collaborate with various teams to deliver data solutions aligned with business objectives.

Qualifications

• Deep technical expertise with data tools and governance.
• Experience in designing scalable data platforms.

Responsibilities

• Lead design and implementation of scalable data platforms.
• Build and maintain robust data pipelines using PySpark and Spark.
• Implement validation and cleansing mechanisms for data accuracy.

Skills

Data Governance

Data Quality

Optimization

Tools

Cloudera

PySpark

Spark

Hadoop

Job description

As a Senior Data Engineer, you will be responsible for the design, implementation, and maintenance of our data infrastructure, ensuring it meets the evolving demands of our clients. You will lead initiatives to optimize data workflows, manage ETL processes, and enforce data governance standards, bringing deep technical expertise with tools like Cloudera, PySpark, Spark, and Hadoop.

Responsibilities

1. Data Infrastructure Setup: Lead the design and implementation of scalable, secure, and efficient data platforms, primarily using the Cloudera ecosystem.
2. ETL Pipeline Management: Build and maintain robust data pipelines using PySpark and Spark to ingest, transform, and manage large datasets from diverse sources.
3. Data Warehouse Management: Oversee and maintain scalable data warehousing solutions, ensuring high availability and reliability.
4. Optimization: Optimize Spark jobs and ETL workflows for performance and cost efficiency.
5. Data Quality & Governance: Implement validation and cleansing mechanisms to maintain data accuracy and integrity.
6. Role-Based Access Control (RBAC): Enforce data access policies to ensure compliance and security, especially for sensitive and regulated data.
7. Collaboration: Work closely with data scientists, business analysts, and application developers to deliver data solutions aligned with business objectives.
8. Scalability Design: Design systems capable of handling increasing data volumes with reliability.

Company Industry

• IT - Software Services

Department / Functional Area

Not specified

Keywords

• Senior

Note: Naukrigulf.com is a platform connecting jobseekers and employers. Candidates should verify the legitimacy of potential employers independently. We do not endorse requests for money payments and advise against sharing personal or bank details. For security tips, visit our Security Advice page. If you suspect fraud, email us at [e-mail].

People Looking for Senior Data Engineer Jobs also searched