Senior Data Engineer

S&P Global Market Intelligence; Hyderabad, Gurugram District; On-site; INR 1,800,000 - 3,000,000; Full time

Job summary

SP Global Energy is seeking a Senior Data Engineer to design and optimize our data platform, pipelines, and database infrastructure. You will build scalable data solutions and ensure data quality and accessibility for analytics and decision making.

Collaborate with Product, Engineering, Analytics, and Architecture teams, develop APIs and automation, and help improve reliability, observability, and scalability across data services in a fast-paced Agile environment.

Qualifications

• Experience designing scalable data pipelines and architectures.
• Proficiency with SQL, Python and cloud platforms (AWS/Azure/GCP).
• Experience with data modeling, data quality, and performance tuning.

Responsibilities

• Design and maintain scalable data pipelines and database architectures.
• Develop and optimize data solutions using SQL, NoSQL, and cloud services.
• Build data ingestion, transformation, and storage solutions.
• Collaborate with cross-functional teams to address data challenges.
• Develop APIs, data services, and automation to improve accessibility.
• Enhance data platform reliability, observability, and scalability.

Skills

Data pipeline design

NoSQL databases

Relational databases

Cloud platforms

Workflow orchestration

Version control & CI/CD

Python

SQL

RESTful APIs

Job description

Job Summary

Grade Level (for internal use): 10

SP Global Energy

The Role: Senior Data Engineer

The Team: The Data Engineering team expands and optimizes our data pipeline architecture, working collaboratively with cross-functional teams to build scalable data systems that support next-generation products and analytics initiative.

Responsibilities

As a Senior Database Engineer, you will directly contribute to the company's data platform, database infrastructure, and analytics capabilities. By designing and maintaining scalable data pipelines and database solutions, you enable the organization to make informed business decisions based on accurate, reliable, and accessible data. This role directly impacts our clients and markets by ensuring the availability, performance, and quality of critical data assets.You will be responsible for:

• Design and maintain scalable data pipeline and database architectures to support operational and analytical workloads.
• Develop and optimize data solutions using relational and NoSQL databases while ensuring data quality, consistency, and performance.
• Build and support data ingestion, integration, transformation, and storage solutions using SQL, Python, cloud platforms, and distributed processing technologies.
• Collaborate with Product, Engineering, Analytics, and Architecture teams to address data and database-related technical challenges.
• Develop APIs, data services, and automation frameworks to improve data accessibility and operational efficiency.
• Partner with cross-functional teams to continuously enhance data platform reliability, observability, and scalability.

What We're Looking For

Technical Skills

• Data pipeline design and architectures
• NoSQL databases
• Relational databases, data modeling, indexing
• Cloud platforms (AWS, Azure, or GCP) and cloud-native data services
• Workflow orchestration
• Version control and CI/CD practices
• Python
• SQL
• RESTful APIs

Professional Skills

• Strong analytical and problem-solving skills.
• Ability to collaborate and communicate effectively with both technical and non-technical stakeholders.
• Experience building solutions and working in Agile environments (e.g., Scrum, Kanban).