Senior Pipeline Engineer

A Leading Engineering Company In UAE; Business Bay; On-site; AED 200,000 - 300,000; Full time

Job summary

A prominent engineering firm in Dubai is seeking an experienced data engineer to lead the development and implementation of robust data pipelines. This role involves collaborating with cross-functional teams to ensure seamless data flow, maintaining high performance, and providing mentorship to junior engineers. Candidates should have at least 10 years of experience in data pipeline design and a relevant engineering degree. The position offers an opportunity to work in a dynamic environment focused on technical excellence and data processing solutions.

Qualifications

• 10 years of experience in designing, building, and maintaining data pipelines.
• Familiarity with data warehousing and ETL processes.
• Strong commitment to delivering high-quality work and meeting deadlines.

Responsibilities

• Lead the development and implementation of robust data pipelines.
• Design, build, and maintain automated data ingestion processes.
• Collaborate with cross-functional teams to understand data needs.
• Implement monitoring and alerting systems for pipeline failures.
• Provide technical guidance and mentorship to junior engineers.

Skills

Data pipeline development

Data integration

Problem-solving skills

Communication skills

Analytical skills

Education

Bachelor's or Master's degree in Mechanical Engineering

Job description

Responsibilities

• Lead the development and implementation of robust and scalable data pipelines, ensuring seamless data flow from source to destination, optimizing performance and minimizing bottlenecks.
• Design, build, and maintain automated data ingestion processes, including data validation, transformation, and cleansing, to guarantee data integrity and reliability.
• Proactively identify and resolve pipeline performance issues, optimizing code and infrastructure to maintain data processing efficiency and reduce latency.
• Collaborate with cross-functional teams, including data scientists, analysts, and engineers, to understand data needs and translate them into effective pipeline solutions.
• Develop and maintain comprehensive documentation, including pipeline architecture, data flows, and operational procedures, to promote knowledge sharing and facilitate troubleshooting.
• Implement monitoring and alerting systems to proactively identify and address pipeline failures, ensuring data availability and timely resolution of issues.
• Stay abreast of the latest advancements in pipeline technologies and tools, recommending and implementing new solutions to improve data processing capabilities.
• Provide technical guidance and mentorship to junior engineers, fostering their growth and development within the data engineering team.
• Conduct thorough code reviews and ensure adherence to coding standards and best practices, maintaining high-quality code and minimizing technical debt.
• Manage and optimize cloud infrastructure resources for pipeline execution, ensuring cost-effectiveness and scalability of data processing operations.

Qualifications

• Bachelor's or Master's degree in Mechanical Engineering, or a related field, providing a strong foundation in piping engineering principles.
• Proven experience (10 years) in designing, building, and maintaining data pipelines, showcasing expertise in data integration and processing.
• Familiarity with data warehousing and ETL processes, including data modeling and schema design, ensuring data quality and consistency.
• Strong problem-solving and analytical skills, demonstrating the ability to identify and resolve complex technical issues effectively.
• Excellent communication and collaboration skills, showcasing the ability to work effectively with cross-functional teams and stakeholders.
• Possesses a proactive and results-oriented mindset, with a strong commitment to delivering high‑quality work and meeting deadlines.