Data Engineer

Money Forward; Chennai District; Hybrid; INR 1,400,000 - 2,400,000; Full time

Job summary

Money Forward in Chennai is seeking a Mid-level Data Engineer for the MIDAS Data Platform Team. You will build and maintain a central data hub, ingest data from banking systems using cloud technologies, and implement data quality and governance across platforms.

With 5–8 years of data engineering experience, strong SQL/Python, and Databricks/dbt expertise, you will collaborate with senior engineers in a hybrid setup, contributing to enterprise-wide analytics and regulatory reporting initiatives.

Qualifications

• 5-8 years in data engineering or analytics engineering.
• Strong SQL and Python experience.
• Experience building data pipelines with Databricks, dbt, or similar.
• Experience with AWS and object storage.
• Knowledge of dimensional modeling and fact/dimension tables.
• Data quality validation and testing experience.
• Ability to debug data pipelines.
• Git version control and CI/CD basics.
• Understanding of data governance, access control and audit logging.
• Strong problem solving and independent work capabilities.
• Good communication and willingness to ask questions.
• Bachelor's degree in CS/Engineering/Math or equivalent.

Responsibilities

• Build from scratch and maintain the central data hub connecting most systems.
• Ingest data from banking systems using cloud-based technologies.
• Apply complex business logic and serve data to downstream systems.
• Address data quality, reconciliation, and time-critical processing with traceability.
• Collaborate with senior engineers and the technical lead for guidance.

Skills

SQL

Python

Data pipelines

Problem solving

Communication

Independent work

Team collaboration

Education

Bachelor's degree in CS/Engineering/Math

Tools

Databricks

dbt

Spark

Git

CI/CD

Terraform

S3

Unix/Linux

REST APIs

Job description

Overview

Under the mission of "Money Forward. Move your life forward," Money Forward aims to resolve the financial concerns and anxieties of individuals and businesses through the power of technology. We have partnered with Sumitomo Mitsui Financial Group, Inc. and Sumitomo Mitsui Banking Corporation to establish a new company in preparation for the launch of a new digital bank. We are currently seeking candidates for the position of Data Engineer as part of this initiative. *Based on the press release announced on April 16, 2025. This position involves employment with Money Forward, Inc., and a secondment to the new company (SMBC Money Forward Bank Preparatory Corporation). The evaluation system and employee benefits will follow the policies of Money Forward, Inc.

Responsibilities and Duties

As a Mid-level Data Engineer in the MIDAS (Management Integration & Data Analytics System) Data Platform Team, you will build from scratch and maintain the central data hub connecting most systems within one of Japan's more innovative digital banks. You will work with modern cloud-based data technologies to ingest data from various banking systems, apply complex business logic, and serve it to downstream systems for enterprise management, regulatory reporting, risk management, and many other applications. Due to the high expectations in the banking domain, you will face complex data engineering challenges including data quality, reconciliation across systems, time-critical data processing, and complete traceability. This mid-level position allows you to work with increasing independence on data pipeline development while collaborating closely with senior engineers and the technical lead for guidance on complex problems.

Required Skills and Experience

• 5-8 years of experience in data engineering or analytics engineering
• Strong proficiency in SQL and working knowledge of Python
• Hands-on experience building data pipelines using tools like Databricks, dbt, or similar
• Experience with AWS and its object storage
• Understanding of data modeling concepts including dimensional modeling and fact/dimension tables
• Experience with data quality validation and testing
• Ability to debug and troubleshoot data pipeline issues
• Experience with version control (Git) and basic understanding of CI/CD concepts
• Understanding of basic data governance: access control and audit logging
• Good problem-solving skills and ability to work with moderate independence
• Good communication skills and willingness to ask questions when blocked
• Bachelor's degree in Computer Science, Engineering, Mathematics, or a related field, or equivalent practical experience

Preferred Skills and Experience

While not specifically required, tell us if you have any of the following.

• Experience in financial services, fintech, or regulated industries
• Basic knowledge of banking domain concepts: core banking, payments, or regulatory reporting
• Exposure to data platforms in regulated environments (FISC Guidelines, GDPR, APPI)
• Hands-on experience with Databricks platform or AWS native data services
• Experience with performance tuning: partitioning strategies, file formats, query optimization
• Experience building REST APIs with Python (FastAPI, Flask, or similar)
• Knowledge of streaming data pipelines (Kafka, Kinesis, or similar)
• Basic experience with Terraform
• Experience with BI tools (QuickSight, Tableau, Looker, PowerBI)
• Experience with data visualization and dashboard design
• Interest in obtaining certifications (AWS Certified Data Analytics, Databricks certifications)
• Experience in AI development and/or experience in using AI tools to improve development processes.
• Money Forward recently announced our AI Strategy roadmap which focuses on improving AI-driven operational efficiencies, as well as integrating AI agents into our products to deliver better value to our users.

Technology Stack

• Cloud Infrastructure :
  • AWS (primary cloud platform in Tokyo region)
  • S3 for data lake storage with VPC networking for secure connectivity
  • AWS IAM for security and access management
• Orchestration & Processing :
  • Databricks Workflows for managed workflow orchestration
  • Distributed data processing with Apache Spark on Databricks clusters
  • Serverless compute and auto-scaling clusters for cost optimization
  • Streaming and batch ingestion patterns with Databricks AutoLoader
• Data Transformation :
  • dbt (data build tool) for SQL-based analytics engineering
  • Delta Live Tables for declarative ETL pipelines with built-in data quality
  • SQL and Python for data transformations
  • Incremental materialization strategies for efficiency
• Query & Analytics :
  • Databricks SQL for high-performance analytics queries
  • Serverless and auto-scaling SQL warehouses for variable workloads
  • Auto-scaling compute for variable workloads
  • Query result caching and optimization
  • REST APIs for data serving to downstream consumers
• Data Quality & Governance :
  • Automated data quality with Delta Live Tables expectations and Great Expectations
  • Cross-system reconciliation and validation logic
  • Fine-grained access control with column/row-level security using Unity Catalog
  • Automated data lineage tracking for regulatory compliance
  • Audit logging and 10-year data retention policies
• Business Intelligence :
  • Amazon QuickSight and/or Databricks SQL Dashboards
  • Integration with enterprise BI tools (Tableau, PowerBI, Looker)
• Version Control : GitHub
• CI/CD : GitHub Actions
• Infrastructure as Code : Terraform
• Monitoring : Databricks monitoring, AWS CloudWatch integration
• AI-Assisted Development : Claude Code, GitHub Copilot, ChatGPT

Development Structure

We operate in a small, agile team while collaborating closely with partners from the banking industry. The MIDAS team is growing rapidly, aiming for more than 10 data engineers within this year.

Location: Chennai
Work Mode: Hybrid 3 days from office and 2 days work from home.