Lead Data Engineer

Vericence; India; On-site; INR 4,000,000 - 6,000,000; Full time

Job summary

Vericence is seeking a Lead Data Engineer in India to design, develop, and maintain scalable ETL/ELT pipelines using Python and PL/SQL. You will build data integration on OCI, optimize ingestion and transformation, and ensure data quality across enterprise platforms.

You'll work with Oracle Database, Autonomous Database, OCI Data Integration, and various cloud services while collaborating with analysts and developers to meet data requirements.

Qualifications

• 8-10 years of experience in Data Engineering or ETL development.
• Strong programming experience in Python.
• Advanced SQL/PLSQL development skills.
• Hands-on with OCI.
• Experience with Oracle Database (12c/19c) and Autonomous Database.
• Knowledge of ETL/ELT concepts, data warehousing and dimensional modeling.
• Experience with OCI Data Integration, Object Storage, Data Flow.
• Familiarity with REST, JSON, XML and file-based integrations.
• Experience with Git and CI/CD pipelines.

Responsibilities

• Design, develop, and maintain scalable ETL/ELT pipelines using Python and PL/SQL.
• Develop data integration solutions on OCI.
• Build and optimize data ingestion, transformation, and validation processes.
• Write complex SQL and PL/SQL packages, procedures, functions, and triggers.
• Design and maintain data models to support analytics and reporting.
• Optimize queries and database objects for performance and scalability.
• Work with Oracle Database, Autonomous Database, and OCI Object Storage.
• Develop data workflows using OCI Data Integration and related services.
• Ensure data quality, governance, and security across the platform.
• Troubleshoot production issues and implement permanent fixes.
• Collaborate with analysts, developers, and data architects on requirements.
• Automate operational tasks using Python and cloud-native services.

Skills

Python

OCI

PL/SQL

ETL

Data Modeling

Performance Tuning

Oracle Autonomous DB

Oracle DB

OCI Data Integration

Object Storage

REST APIs

JSON/XML

Git

CI/CD

Airflow

Spark

Docker

Kubernetes

Linux Shell

OAC/OIC/GoldenGate

Data Governance

Education

Bachelor's degree

OCI Certifications

Tools

Oracle SQL Developer

VS Code

Postman

Job description

Vericence is a digital engineering and technology consulting firm helping enterprises build AI-driven platforms, modernize legacy systems, and scale innovation through cloud, data, and intelligent engineering. We partner with global organizations to deliver high-impact technology solutions and build world-class engineering teams.

Job Summary

We are looking for a skilled Lead Data Engineer with 8-10 years of experience in designing, developing, and maintaining scalable data pipelines and data integration solutions. The ideal candidate should have strong expertise in Python, Oracle Cloud Infrastructure (OCI), and PL/SQL, along with hands-on experience in ETL development, data modeling, and database performance optimization. Experience working with cloud-native data services and large-scale enterprise data platforms is highly preferred.

Key Responsibilities

• Design, develop, and maintain scalable ETL/ELT pipelines using Python and PL/SQL.
• Develop data integration solutions on Oracle Cloud Infrastructure (OCI).
• Build and optimize data ingestion, transformation, and validation processes.
• Write complex SQL and PL/SQL packages, procedures, functions, and triggers for enterprise applications.
• Design and maintain data models to support analytics and operational reporting.
• Optimize SQL queries and database objects for high performance and scalability.
• Work with Oracle Autonomous Database, Oracle Database, and OCI Object Storage.
• Develop data workflows using OCI Data Integration and related cloud services.
• Ensure data quality, integrity, governance, and security across the data platform.
• Troubleshoot production issues, perform root cause analysis, and implement permanent fixes.
• Collaborate with business analysts, application developers, and data architects to gather and implement data requirements.
• Automate operational tasks using Python scripts and cloud-native services.
• Participate in code reviews, documentation, and deployment activities.

Required Skills

• 8-10 years of experience in Data Engineering or ETL development.
• Strong programming experience in Python.
• Advanced SQL and PL/SQL development skills.
• Hands-on experience with Oracle Cloud Infrastructure (OCI).
• Experience with Oracle Database (12c/19c), Autonomous Database, and Oracle SQL Developer.
• Strong understanding of ETL/ELT concepts, data warehousing, and dimensional modeling.
• Experience with OCI Data Integration, Object Storage, Data Flow, or related OCI services.
• Knowledge of REST APIs, JSON, XML, and file-based integrations.
• Experience with Git and CI/CD pipelines.
• Strong debugging, analytical, and performance tuning skills.

Preferred Skills

• Experience with Apache Airflow or other workflow orchestration tools.
• Familiarity with Spark or distributed data processing frameworks.
• Experience with Docker and Kubernetes.
• Knowledge of Linux shell scripting.
• Exposure to Oracle Analytics Cloud (OAC), Oracle Integration Cloud (OIC), or Oracle GoldenGate.
• Understanding of data governance and security best practices.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
• Oracle Cloud certifications (OCI Foundations, OCI Data Management, or Oracle Database certifications) are a plus.

Preferred Technologies

• Programming: Python, PL/SQL, SQL
• Database: Oracle Database, Autonomous Database
• Data Services: OCI Data Integration, Object Storage, Data Flow
• Version Control: Git

Tools

Oracle SQL Developer, VS Code, Postman