Data Engineer with Data Operations

ADV TECHMINDS; Kolkata District; On-site; INR 2,009,000 - 2,678,000; Full time

Job summary

ADV TECHMINDS in Kolkata is seeking a Data Engineer with Data Operations for a 6-month contract to build and maintain robust data pipelines from Oracle Flexcube, feeding the Cloudera Data Platform. You will use Hadoop, Hive, and Impala to enable reliable data processing and scalable analytics.

The role requires 7+ years of data engineering/operations experience, with strong SQL, Python, and API skills, and a proactive approach to data governance and security.

Qualifications

• Bachelor’s or Master’s degree in CS/IT or related field.
• 7+ years in data engineering and data operations, banking sector preferred.
• Strong knowledge of Oracle Flexcube, Hadoop, and data pipelines.
• Cloud knowledge is a plus.
• Excellent analytical and communication skills.

Responsibilities

• Design, develop, and maintain data pipelines from Oracle Flexcube and other sources into the Cloudera Data Platform.
• Utilize Hadoop for storage and Hive+Impala for querying and processing.
• Ensure reliability, scalability, and performance of data operations.
• Implement data quality, governance, and data security practices.
• Monitor pipelines and troubleshoot issues; collaborate with cross-functional teams.
• Automate data workflows and document processes.

Skills

Analytical thinking

Communication

Education

Bachelor's or Master's in CS/IT

Tools

Oracle Flexcube

SQL

Python

Spark/PySpark

Cloudera Data Platform

Hadoop

Hive/Impala

JDBC/ODBC

APIs

Job description

About the job Data Engineer with Data Operations

Job Title: Data Engineer with Data Operations

Experience: 7+ Years Employment

Type: Contract Duration: 6 Months (Extendable)

Location: Kolkata

Key Responsibilities:

• Design, develop, and maintain robust data pipelines to support data integration from Oracle Flexcube and other data sources into the Cloudera Data Platform.
• Utilize Hadoop for efficient data storage and Hive+Impala for data querying and processing.
• Ensure the reliability, scalability, and performance of data operations.
• Implement best practices for data management, including data quality, data governance, and data security.
• Monitor and troubleshoot data pipelines to ensure smooth data flow and timely resolution of issues.
• Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs.
• Automate data workflows and processes to enhance operational efficiency.
• Develop and maintain documentation related to data engineering and operations processes.

Qualifications:

• Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
• 7+ Years of experience in data engineering and data operations, preferably in the banking sector.
• Strong knowledge of Oracle Flexcube, APIs, JDBC/ODBC connection, SQL, Python, Spark (PySpark), Cloudera Data Platform, Hadoop, Hive, and Impala.
• Cloud knowledge is a plus.
• Proven experience in designing and managing data pipelines.
• Excellent analytical and problem-solving skills.
• Strong communication and interpersonal skills.
• Ability to work independently and as part of a team.
• Certification in data engineering or related fields is a plus.