Data Engineer - Consultant

Bachelors in Computer Application (Computers)

Nationality: Any

Vacancy: 1

Job Description

This is a 6-month contract role, with the possibility of extension based on client discretion.

Minimum Requirements: 2+ years of experience. Compensation includes a salary of 10k to 12k AED, plus Visa, Medical Insurance, and Work Permit.

Responsibilities:

1. Design, develop, and maintain data pipelines for ingestion, transformation, and loading of data into the data warehouse.
2. Utilize PySpark and Azure Data Factory (ADF) to build data pipelines.
3. Implement data governance frameworks, ensuring data quality, security, and compliance with industry standards.
4. Develop complex SQL queries and manage relational databases for data accuracy and performance.
5. Maintain data lineage tracking to ensure transparency and traceability.
6. Implement ETL processes to uphold data integrity and quality.
7. Optimize data pipelines for performance, scalability, and reliability.
8. Create data transformation processes and algorithms for data standardization, cleansing, and enrichment.
9. Apply data quality checks and validation rules.
10. Mentor junior team members, review code, and promote best practices in data engineering.
11. Collaborate with data scientists, analysts, and engineers to meet data requirements.
12. Maintain documentation of data infrastructure, ETL processes, and data lineage.
13. Ensure compliance with data governance policies, security standards, and regulations.

Desired Candidate Profile

What You’ll Bring:

• Proficiency in SQL and at least one programming language (e.g., Python).
• Experience with PySpark, ADF, Databricks, and SQL.
• Preferable experience with MS Fabric.
• Knowledge of data warehousing concepts and methodologies.
• Experience with Azure Synapse, Azure Databricks, and data warehouse platforms like Snowflake, Redshift, or BigQuery.
• Understanding of data modeling, integration, and governance best practices.
• Optional experience with Power BI or other visualization tools.

Disclaimer: Naukrigulf.com is a platform connecting jobseekers and employers. Applicants should independently verify the legitimacy of prospective employers. We do not endorse requests for money payments and advise against sharing personal or banking information. For security tips, visit our Security Advice page. Report any fraud or malpractice to abuse@naukrigulf.com.