Senior Data Engineer

Prescience Decision Solutions; Bengaluru; On-site; INR 2,500,000 - 5,000,000; Full time

Benefits offered by this job

Competitive salary

Performance-based bonuses

Insurance plans

Learning and growth opportunities

Job summary

Prescience Decision Solutions in Bengaluru, India, is seeking a Senior Data Engineer with 6+ years of experience to own end-to-end data pipelines and enterprise-grade data solutions. The role requires strong Python, SQL, data architecture, workflow orchestration, and governance for highly regulated data domains such as finance, risk, or compliance.

You will design scalable data models, build production-grade pipelines, and ensure data quality, lineage, and deployment monitoring.

Qualifications

• 6+ years of experience in Data Engineering or related field.
• Strong data architecture and system design skills for scalable pipelines.
• End-to-end ownership of production data pipelines including deployment and monitoring.
• Expertise in Python and SQL with relevant libraries (pandas, SQLAlchemy).
• Experience with data governance, lineage, and regulatory data domains.
• Familiarity with workflow orchestration tools like Airflow.

Responsibilities

• Own end-to-end data pipelines from design to deployment and operation.
• Develop scalable data models and warehousing solutions for finance/risk data.
• Build and maintain production-grade pipelines with data quality checks.
• Collaborate with stakeholders to ensure data governance and lineage.
• Utilize Python, SQL, Hive/Hadoop and Spark in daily work.
• Implement and maintain workflow orchestration and CI/CD practices.

Skills

Python

SQL

Data engineering

Airflow

Data modeling

Data quality

Pandas

Tools

Hive/Hadoop

Spark

Job description

Prescience Decision Solutions | Full time

Prescience Decision Solutions, established in 2017, partners with Fortune 500 and mid-sized companies globally to unlock enterprise data and drive improved decision-making. We specialize in Data Science, Advanced Analytics, and Data Engineering, integrating AI and machine learning to deliver measurable business value and ROI.

Headquartered in Bangalore, our 'Business Backward' approach ensures a deep understanding of your challenges, enabling us to provide tailored, impactful solutions.

Founded by industry leaders from IIT and IIM, Prescience is a bootstrapped and profitable company with a strong project pipeline.

Our commitment to excellence has earned us recognition as one of the top three startups in the People Excellence category by xto10x, with a 97 percentile employee NPS, 100% mutual respect among employees, and a 98% employee pride rate.

As an equal opportunity employer, we are dedicated to fostering a diverse and inclusive workplace, free from discrimination based on caste, religion, gender, sexual orientation, nationality, or other protected characteristics.

To learn more, subscribe to our YouTube channel: YouTube Link .

Role Overview

Seeking a Senior Data Engineer with 6+ years of experience in building scalable data pipelines, data models, and enterprise-grade data solutions. The role requires strong expertise in Python, SQL, data architecture, workflow orchestration, and data quality frameworks, along with experience handling highly governed finance, risk, or compliance data. The ideal candidate will own end-to-end data engineering processes, from solution design and development to deployment, monitoring, and operational support.

Job Description

Job Description:

• 6+ years of experience in Data Engineering.
• Strong data architecture and system design skills with the ability to make sound trade-offs around data modeling, partitioning, and scalability.
• Demonstrated end-to-end ownership of production data pipelines, including design, deployment, monitoring, and operational support.
• Expertise in Python and SQL as primary tools; experience with Hive/Hadoop is a plus.
• Strong focus on data quality, validation, reconciliation, anomaly detection, and audit ability.
• Experience working with finance, risk, compliance, or other highly regulated data domains requiring strong data lineage and governance.
• Proven experience designing and building transaction and fact tables.
• Advanced SQL skills, including window functions, CTEs, CASE statements, and working across MySQL/PostgreSQL environments.
• Strong Python expertise, including pandas, SQLAlchemy, type hints, data classes, and object-oriented pipeline development.
• Experience with workflow orchestration platforms such as Airflow or similar tools.
• Strong understanding of data modeling concepts including fact/dimension modeling, normalization, and medallion architecture.
• Experience with YAML-based configurations, CI/CD practices, and Git-based development workflows.

Requirements

Strongly Preferred:

• Experience with enterprise data platforms, internal data tooling ecosystems, metadata/catalog solutions, secrets management tools, developer productivity platforms, and ETL orchestration frameworks.

Nice-to-Have:

• Experience with Hive, Hadoop, Spark, or related big data technologies.

• Competitive salary and performance-based bonuses.
• Comprehensive insurance plans.
• Collaborative and supportive work environment.
• Chance to learn and grow with a talented team.