Senior Technical Consultant (Data Engineer) - RDAF

o9solutions; Bengaluru; On-site; INR 1,800,000 - 2,800,000; Full time

Job summary

o9 Solutions in Bengaluru, India is seeking a Senior Technical Consultant - MFG with strong data engineering, ETL, and cloud-based data platforms. You will design and implement ingestion and transformation pipelines, collaborating with cross-functional teams to ensure seamless data integration across systems.

You will build large-scale data pipelines using Python, PySpark, SQL, Airflow, and SSIS, and integrate Teradata, SAP ERP, SQL Server, Oracle, and other sources via API or batch methods.

Qualifications

• 3+ years of experience in Data Architecture, Data Engineering or related fields.
• Strong experience in data modelling, ETL processes, and cloud-based data platforms.
• Hands-on experience with Python, PySpark, SQL.
• Experience with workflow management tools such as Airflow and SSIS.
• Experience with Parquet, JSON, RESTful APIs, HDFS, Delta Lake, Hive and Presto.
• Strong SQL expertise including query writing and working with relational databases.
• Experience with GitHub or Azure DevOps.
• Familiarity with Agile development methodologies.
• Strong problem-solving and proactive learning mindset.
• Excellent verbal and written communication skills.

Responsibilities

• Manage and execute complex data ingestion, transformation, validation, and publishing tasks.
• Review and analyze data provided by customers and understand dependencies.
• Collaborate with functional teams to understand end-to-end data flows and integration requirements.
• Build and maintain data ingestion and egress pipelines capable of handling large volumes of data.
• Develop data transformation functions using Python, PySpark, SQL, and SSIS.
• Integrate data from Teradata, SAP ERP, SQL Server, Oracle, Sybase, ODBC, and flat files via API or batch integrations.
• Support production deployment activities and assist in issue triaging and root cause analysis.
• Resolve batch automation disruptions to ensure SLA compliance and accurate data delivery.
• Provide technical guidance to junior consultants and ensure alignment with best practices.

Skills

Data Architecture

Data Engineering

Python

PySpark

SQL

Airflow

SSIS

Delta Lake

Hive

Presto

GitHub/Azure DevOps

Agile methodologies

Communication

Tools

Teradata

SAP ERP

SQL Server

Oracle

Sybase

ODBC connectors

API integrations

Job description

Transforming the Future of Enterprise Planning

At o9, our mission is to be the Most Value-Creating Platform for enterprises by transforming decision-making through our AI-first approach. By integrating siloed planning capabilities and capturing millions-even billions-in value leakage, we help businesses plan smarter and faster.

This not only enhances operational efficiency but also reduces waste, leading to better outcomes for both businesses and the planet. Global leaders like Google, PepsiCo, Walmart, T-Mobile, AB InBev, and Starbucks trust o9 to optimize their supply chains.

Job Description

We are looking for a Senior Technical Consultant - MFG with strong experience in data engineering, ETL pipelines, and cloud-based data platforms . The role involves designing and implementing data ingestion and transformation pipelines, collaborating with functional teams, and ensuring seamless data integration across multiple systems.

Key Responsibilities

Advanced Execution & Data Management

• Manage and execute complex project tasks related to data ingestion, transformation, validation, and publishing .
• Review and analyze data provided by customers, understanding its technical and functional intent along with dependencies .
• Work closely with functional teams to understand end-to-end data flows and integration requirements .

Data Integration & Pipeline Development

• Build and maintain data ingestion and egress pipelines capable of handling large volumes of data .
• Develop data transformation functions using technologies such as Python, PySpark, SQL, and SSIS .
• Integrate data from various sources including Teradata, SAP ERP, SQL Server, Oracle, Sybase, ODBC connectors, and flat files using API or batch integrations .

Production Deployment & Hypercare

• Support production deployment activities .
• Assist in issue triaging, testing, and root cause analysis .
• Resolve batch automation disruptions in a timely manner to ensure customer SLA compliance and accurate data delivery .

Technical Leadership

• Provide technical guidance to junior consultants and review their code to ensure alignment with best practices and quality standards .
• Follow and promote o9 ways of working and industry standards for efficient project execution.

Required Skills & Qualifications

• 3+ years of experience in Data Architecture, Data Engineering, or related fields .
• Strong experience in data modelling, ETL processes, and cloud-based data platforms .
• Hands-on experience with:
• Python
• PySpark
• SQL
• Experience with workflow management tools such as Airflow and SSIS .
• Experience working with Parquet, JSON, RESTful APIs, HDFS, Delta Lake , and query frameworks such as Hive and Presto .
• Strong SQL expertise , including query writing and working with relational databases.
• Experience with version control platforms such as GitHub or Azure DevOps .
• Familiarity with Agile development methodologies .
• Strong problem-solving skills and a proactive learning mindset .
• Excellent verbal and written communication skills .

Good to Have

• Hands-on experience with Delta Lake .
• Experience working with Supply Chain Planning applications .
• Exposure to cloud platforms such as AWS, Azure, or Google Cloud .

More about us...

At o9, transparency and open communication are at the core of our culture. Collaboration thrives across all levels-hierarchy, distance, or function never limit innovation or teamwork. Beyond work, we encourage volunteering opportunities, social impact initiatives, and diverse cultural celebrations.

With a $3.7 billion valuation and a global presence across Dallas, Amsterdam, Barcelona, Madrid, London, Paris, Tokyo, Seoul, and Munich, o9 is among the fastest-growing technology companies in the world. Through our aim10x vision, we are committed to AI-powered management, driving 10x improvements in enterprise decision-making. Our Enterprise Knowledge Graph enables businesses to anticipate risks, adapt to market shifts, and gain real-time visibility. By automating millions of decisions and reducing manual interventions by up to 90%, we empower enterprises to drive profitable growth, reduce inefficiencies, and create lasting value.

o9 is an equal-opportunity employer that values diversity and inclusion. We welcome applicants from all backgrounds, ensuring a fair and unbiased hiring process. Join us as we continue our growth journey!