Senior Data Engineer – Cognite Data Fusion

Jobtailor

Pune District

On-site

INR 1,200,000 - 3,400,000

Full time

8 days ago

Application generator

Turn this role into an interview — a resume and cover letter built around what this employer wants.

Get past ATS filters

Job summary

Jobtailor in Pune, India is seeking an experienced Data Ingestion Engineer to design and deploy end-to-end data pipelines into Cognite Data Fusion. You will integrate industrial data sources, ensure reliable and secure architectures, and optimize performance.

The role requires strong SQL and Python scripting, cloud deployment experience, and hands-on work with PI Systems, SCADA, SAP, and MES. You will collaborate with clients and cross-functional teams to deliver scalable, governance-driven data

Qualifications

Bachelor's degree in CS/IT/Data Eng or related technical discipline.
5+ years in data engineering, deployment engineering, or industrial digitalization.

Responsibilities

Design, configure, and deploy end-to-end data ingestion pipelines into Cognite Data Fusion.
Integrate CSV, SQL databases, PI Systems, SCADA, SAP, and other data sources.
Ensure reliable, scalable, and secure data ingestion architectures.
Troubleshoot ingestion issues and optimize pipeline performance.
Transform raw data into consumable business and engineering datasets.
Develop mapping strategies aligning source systems with enterprise models.
Configure and maintain metadata structures and contextualization frameworks.
Assess data quality and deployment readiness; perform data profiling.
Collaborate with client data owners to resolve data issues.
Document data flows, deployment steps, and runbooks.
Support cloud deployment, testing, and production rollout.

Skills

Data engineering

SQL scripting

Python scripting

Data integration

Cloud deployment

ETL/ELT

Data modeling

Agile methodologies

Documentation

Workshop facilitation

Education

Bachelor's degree in Computer Science or related

Tools

Cognite Data Fusion

Azure

AWS

Google Cloud Platform

Git

GitHub

Confluence

SharePoint

OptiFlow

OptiSite

SCADA Systems

Job description

Design, configure, and deploy end-to-end data ingestion pipelines into Cognite Data Fusion
Integrate CSV and flat files, SQL and relational databases, PI Systems, SCADA systems, SAP systems, historians, operational databases, unstructured documents, and other industrial and enterprise data sources
Ensure reliable, scalable, and secure data ingestion architectures
Troubleshoot ingestion issues and optimize pipeline performance
Transform raw source data into consumable business and engineering datasets
Perform data contextualization and establish relationships between assets, events, time series, documents, and engineering objects
Develop mapping strategies aligning source systems with enterprise data models
Configure and maintain metadata structures and contextualization frameworks within CDF
Assess data quality, completeness, accuracy, consistency, and deployment readiness
Perform data profiling and validation; identify data gaps, anomalies, inconsistencies, and missing relationships
Establish data quality checks and validation procedures throughout the deployment lifecycle
Work with client data owners to resolve data issues and improve reliability
Design, implement, and maintain CDF data models, entities, relationships, metadata structures, and governance approaches
Configure and deploy client digital solutions including OptiFlow and OptiSite
Configure backend workflows, business logic, and application integrations
Support UI configuration and solution customization based on customer requirements
Validate end-to-end functionality and participate in testing, commissioning, and production deployment
Gather technical requirements and source-system information from stakeholders
Facilitate workshops, data discovery sessions, and deployment planning
Communicate data findings, risks, and recommendations to technical and non-technical audiences
Collaborate with developers, architects, project managers, customer teams, and client stakeholders
Support cloud-based deployment and operational activities
Contribute to deployment methodology improvements, internal knowledge sharing, and capability development
Stay current with OptiFlow, OptiSite, and Cognite Data Fusion capabilities and best practices

Requirements

Bachelor's degree in computer science, Information Technology, Data Engineering, Engineering, or a related technical discipline
5+ years of experience in data engineering, deployment engineering, industrial digitalization, or related fields
Experience implementing enterprise-scale data integration and data management solutions
Experience working with cloud-based platforms and deployments
Strong understanding of data integration, ETL/ELT, and data management practices
Hands-on experience with structured and unstructured data
Expertise in data profiling, cleansing, validation, and quality assessment
Experience with enterprise and industrial data architectures
Advanced SQL scripting and query optimization skills
Experience with relational databases and data warehousing concepts
Intermediate to advanced Python scripting skills
Experience developing automation scripts for data validation, transformation, and deployment tasks
Familiarity with APIs and integration frameworks
Experience with Cognite Data Fusion (CDF) or similar industrial data platforms
Knowledge of contextualization, data modeling, and industrial data management solutions
Experience with one or more industrial systems such as PI Systems, SCADA, SAP, MES, industrial historians, engineering information management systems, or industrial IoT platforms
Experience with Azure, AWS, or Google Cloud Platform
Understanding of cloud deployment, security, networking, and operational concepts
Understanding of SDLC and familiarity with Agile delivery methodologies
Experience collaborating with software engineering and product development teams
Working knowledge of Git and GitHub, including repository management, branching strategies, commits, pull requests, code reviews, and issue tracking
Experience creating and maintaining technical documentation, deployment guides, runbooks, and operational procedures
Ability to document data flows, system configurations, troubleshooting steps, and deployment activities
Experience with Confluence, SharePoint, or similar knowledge management tools

Core Competencies

Demonstrates expertise in designing and deploying end-to-end data ingestion pipelines, ensuring data quality and contextualization within Cognite Data Fusion. Proficient in data integration, ETL/ELT processes, and cloud-based solutions, with strong skills in SQL and Python scripting.

Highest-signal resume keywords