Data Engineering Consultant (Category - Architect)

Codvo.ai; Pune District; On-site; INR 1,500,000 - 2,500,000; Full time

Job summary

A leading data solutions firm is seeking a Data Engineering Consultant to define and maintain enterprise data architecture, design scalable data systems, and support AI/ML models. The role demands over 10 years of experience, expertise in data modeling, and proficiency in cloud services, particularly Azure. Ideal candidates will thrive in a collaborative environment and possess strong communication skills. This position is based in Pune District, Maharashtra, India.

Qualifications

• 10+ years of experience in data architecture, data engineering, or enterprise analytics roles.
• Strong experience designing enterprise-scale data platforms in cloud and hybrid environments.
• Hands-on experience with cloud data services, especially Azure.

Responsibilities

• Define and maintain the enterprise data architecture blueprint.
• Design and implement data models optimized for time-series data.
• Build the data infrastructure to support AI/ML models.

Skills

SQL

Python

Data modeling

Cloud data services

DevOps practices

Communication skills

Distributed computing frameworks

Education

Certifications such as Azure Data Engineer Expert

Relevant degree in Computer Science or related field

Tools

Microsoft Azure

Apache Spark

Git

Kafka

Job description

Data Engineering Consultant (Category - Architect)

Sector: Oil and Gas

Location: Doha, Qatar

About Us

At Codvo, we are committed to building scalable, future-ready data platforms that power business impact. We believe in a culture of innovation, collaboration, and growth, where engineers can experiment, learn, and thrive. Join us to be part of a team that solves complex data challenges with creativity and cutting‑edge technology.

Job Description

Key Responsibilities

• Define and maintain the enterprise data architecture blueprint, including data lakes, warehouses, streaming platforms, and analytics layers.
• Design logical, physical, and conceptual data models to support operational, analytical, and AI use cases.
• Ensure architecture supports scalability, performance, and high availability.
• Design, construct, install, test, and maintain highly scalable data management systems and ETL/ELT pipelines.
• Develop processes to ingest and integrate high-volume, high-velocity data from SCADA systems, historians (like OSIsoft PI, Aspen InfoPlus.21), DCS, PLC, and IoT sensors.
• Implement and manage data solutions on the Microsoft Azure cloud platform, leveraging services such as Azure IoT Hub, Azure Event Hubs, and Azure Stream Analytics for real‑time ingestion and processing of operational technology data.
• Design and implement data models optimized for time‑series data from industrial assets, supporting operational dashboards and real‑time analytics.
• Build the data infrastructure to support AI/ML models for predictive maintenance, operational anomaly detection, and process optimization using real‑time OT data.

Required Skills and Qualifications

• 10+ years of experience in data architecture, data engineering, or enterprise analytics roles.
• Strong experience designing enterprise‑scale data platforms in cloud and hybrid environments.
• Expertise in data modelling (conceptual, logical, physical) and data integration patterns.
• Deep understanding of data lakes, data warehouses, Lakehouse architectures, and real‑time streaming platforms.
• Hands‑on experience with cloud data services (Azure preferred).
• Strong knowledge of SQL, data transformation frameworks, and metadata management.
• Familiarity with DevOps and DataOps practices.
• Strong communication skills with the ability to engage both technical and business stakeholders.

Technical Proficiencies

• Expert‑level proficiency in SQL and Python for data manipulation and pipeline development.
• Hands‑on experience with distributed computing frameworks like Apache Spark (PySpark). Experience with streaming technologies like Kafka is a plus.
• Deep experience with Microsoft Azure (Azure Data Lake Storage, Azure Data Factory, Azure Databricks, Azure Synapse).
• Proven experience with modern data platforms Databricks Delta Lake.
• Understanding of machine learning lifecycles and the data requirements for training and deploying AI/ML models.
• Proficiency with Git and CI/CD best practices.

Preferred Qualifications

• Certifications such as Azure Data Engineer Expert, Azure Solutions Architect, or equivalent.
• Hands‑on experience with the OSDU™ Data Platform.
• Experience in Oil & Gas, energy, or industrial data environments.
• Understanding of cybersecurity considerations for OT environments and data segregation.
• Experience integrating data from ERP systems like SAP.
• Experience working within AI‑first or analytics‑driven transformation programs.
• Advanced SQL skills, including query optimization and performance tuning.
• Experience constructing and maintaining enterprise knowledge graphs.

Note

Please apply via our official careers portal only, as applications sent directly to executives may not be considered.