Data Engineer (Billing & Revenue)

Simplify3x Software; Bengaluru; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Simplify3x Software in Bengaluru, India, seeks an experienced Data Engineer to design and support high-volume ETL/ELT pipelines, leveraging AWS Glue, Redshift, PostgreSQL, Python, PySpark, and Tableau to deliver reliable data processing and reporting.

You will work with billing and revenue data (ORMB knowledge preferred), build and optimize data models, and publish dashboards via Tableau Server or Tableau Cloud, while collaborating with stakeholders and following Scrum processes.

Qualifications

• Experience in designing and maintaining data pipelines for high-volume ETL/ELT.
• Strong SQL and data modeling skills.
• Experience with billing and revenue data, ORM B knowledge preferred.
• Proficiency in Tableau dashboards and data visualization.

Responsibilities

• Design and maintain ETL/ELT pipelines using AWS Glue, S3, PostgreSQL, and Redshift.
• Develop complex SQL queries, stored procedures, functions, views, and materialized views.
• Build AWS Glue jobs using Python and PySpark for large-volume data processing.
• Publish dashboards through Tableau Server/Tableau Cloud.
• Troubleshoot production issues and provide performance improvements.
• Work with business stakeholders to understand requirements and deliver technical solutions.
• Participate in Jira/Scrum activities including sprint planning, development, testing, and delivery.

Skills

AWS Glue

Amazon Redshift

PostgreSQL

SQL

Python

PySpark

Tableau

ETL/ELT

Data Modeling

Tableau Server

Tableau Cloud

Jira/Scrum

SCD

CDC

Billing Data

ORMB

Education

Bachelor's degree in CS/Engineering/IT

Tools

Tableau Server

Tableau Cloud

Jira

Job description

We are looking for an experienced Data Engineer with strong hands-on experience in AWS Glue, Amazon Redshift, PostgreSQL, Python, PySpark, and Tableau. The candidate will be responsible for developing and supporting high-volume ETL/ELT pipelines, data processing solutions, database development, and reporting dashboards. The role involves working with billing and revenue data, including data from Oracle Revenue Management and Billing (ORMB).

Key Responsibilities

• Design and maintain ETL/ELT pipelines using AWS Glue, S3, PostgreSQL, and Redshift.
• Develop complex SQL queries, stored procedures, functions, views, and materialized views.
• Build AWS Glue jobs using Python and PySpark for large-volume data processing.
• Perform data transformation, cleansing, validation, and reconciliation.
• Optimize SQL, ETL, Glue, and Spark processes for better performance.
• Work with data modeling, incremental loads, CDC, and SCD.
• Develop and maintain Tableau dashboards using PostgreSQL and Redshift.
• Publish dashboards through Tableau Server/Tableau Cloud.
• Troubleshoot production issues and provide performance improvements.
• Work with business stakeholders to understand requirements and deliver technical solutions.
• Participate in Jira/Scrum activities including sprint planning, development, testing, and delivery.

Required Skills

• AWS Glue
• Amazon Redshift
• PostgreSQL & Strong SQL
• Python & PySpark
• Amazon S3
• ETL/ELT & Data Modeling
• Spark Performance Optimization
• Data Quality & Reconciliation
• Tableau Desktop & Dashboard Development
• Tableau Server/Tableau Cloud
• Billing & Revenue Data
• ORMB knowledge is preferred

Good to Have

• Healthcare revenue management/billing experience
• AWS Lambda & DMS
• Glue Data Catalog & Crawlers
• Redshift Spectrum, WLM & Materialized Views
• AWS/Redshift cost and performance optimization

Education: Bachelor's degree in Computer Science, Engineering, IT, Information Systems, or a related field.