Senior Data Engineer

Birlasoft; Dadri; On-site; INR 800,000 - 1,200,000; Full time

Job summary

A leading IT services company is seeking an experienced Data Engineer based in India, Uttar Pradesh. The ideal candidate should have robust expertise in AWS Database Migration Service (DMS), Python, and Oracle PL/SQL. Responsibilities include designing and implementing large-scale data migration solutions and ensuring data quality. Candidates must possess strong skills in AWS services and proficiency in Python. Join a dynamic team and help drive innovative data solutions!

Qualifications

• Strong hands-on experience with AWS DMS.
• Proficiency in Python for data engineering & automation.
• Advanced skills in Oracle SQL/PLSQL development.
• Experience with AWS services including EC2 and S3.
• Good understanding of ETL/ELT concepts.

Responsibilities

• Design, configure, and manage AWS DMS replication tasks.
• Troubleshoot migration issues including latency and replication.
• Develop and optimize complex PL/SQL procedures.
• Prepare technical documentation including design specs.
• Ensure data security, quality, and compliance.

Skills

AWS DMS

Python

Oracle SQL/PLSQL

ETL/ELT concepts

Agile/Scrum

Tools

AWS EC2

AWS S3

AWS RDS

AWS CloudWatch

AWS Lambda

Job description

Job Summary

We are seeking an experienced Data Engineer with strong expertise in AWS Database Migration Service (DMS), Python, and Oracle PL/SQL. The ideal candidate will be responsible for designing, developing, and supporting large-scale data migration, transformation, and integration solutions across cloud.

Key Responsibilities

AWS DMS (Primary Skill)

• Design, configure, and manage AWS DMS replication tasks for full-load and CDC.
• Troubleshoot migration issues including latency, table mapping, LOB handling, and replication instance tuning.
• Fine-tune DMS task parameters and validate data consistency post migration.
• Automate monitoring and alerting DMS using CloudWatch, SNS, or Lambda.

Python

• Data validation and reconciliation
• API integrations and utility tools
• Build ETL/ELT orchestration using Python frameworks or AWS services (Lambda, Glue, Step Functions).
• Write modular, scalable, production-ready code following best practices.

Oracle PL/SQL

• Develop and optimize complex PL/SQL procedures, functions, triggers, and packages.
• Analyze and optimize SQL queries for performance tuning.
• Work closely with DBAs on schema design, indexing, and performance optimization.
• Understanding of Oracle partitioning, materialized views, and transaction management.

General Responsibilities

• Prepare technical documentation including design specs, runbooks, and migration plans.
• Participate in code reviews and ensure adherence to engineering standards.
• Ensure data security, quality, and compliance throughout the migration lifecycle.

Required Skills & Qualifications

• Strong hands-on experience with AWS DMS.
• Proficiency in Python for data engineering & automation.
• Advanced skills in Oracle SQL/PLSQL development.
• Experience with AWS services such as: EC2, S3, IAM, RDS, CloudWatch, Lambda.
• Good understanding of ETL/ELT concepts and data modeling.
• Familiarity with Agile/Scrum practices.

Preferred Skills

• Knowledge of Redshift / Aurora / PostgreSQL.
• Exposure to DevOps tools (Git, Jenkins, CI/CD).
• Experience with performance tuning during large-scale migrations.
• Familiarity with Unix shell scripting.