Oracle + PySpark Data Engineer (Remote)

PradeepIT Consulting Services Pvt Ltd; Bengaluru; Remote; INR 1,200,000 - 1,500,000; Full time

Job summary

A technology consulting firm is seeking an experienced Oracle + PySpark Data Engineer to optimize data processes and support decision-making. The ideal candidate should have 5 to 7 years of experience with Oracle databases and PySpark, alongside strong SQL and Python skills. Key responsibilities include data integration, transformation, and analysis. This remote position offers opportunities for professional growth and collaboration with cross-functional teams.

Qualifications

• 5 to 7 years of experience in data engineering or analytics.
• Strong proficiency in Oracle databases and PySpark.
• Ability to write complex SQL queries and Python scripts.

Responsibilities

• Integrate data from various sources into Oracle databases.
• Develop and maintain data transformation workflows using PySpark.
• Collaborate with business teams to provide insights through data analysis.

Skills

Oracle databases

PySpark

SQL

PL/SQL

Python

Job description

About the job Oracle + PySpark Data Engineer (Remote)

Job Description:

Experiance:5 to 7 Years

We are seeking a highly skilled and motivated Oracle + PySpark DataEngineer/Analyst to join our team. The ideal candidate will be responsible for leveraging theOracle database and PySpark to manage, transform, and analyze data to support ourbusiness's decision-making processes. This role will play a crucial part in maintainingdata integrity, optimizing data processes, and enabling data-driven insights.

Key Responsibilities:

• Data Integration: Integrate data from various sources into Oracle databases and design PySpark data pipelines to enable data transformation and analytics.
• Data Transformation: Develop and maintain data transformation workflows using PySpark to clean, enrich, and structure data for analytical purposes.
• Data Modeling: Create and maintain data models within Oracle databases, ensuring data is structured and indexed for optimal query performance.
• Query Optimization: Write complex SQL queries and PySpark transformations for efficient data retrieval and processing.
• Data Analysis: Collaborate with data analysts and business teams to provide insights through data analysis and reporting.
• Data Quality: Implement data quality checks, error handling, and validation processes to ensure data accuracy and reliability.
• Performance Tuning: Optimize Oracle database and PySpark jobs to improve performance.

Known Tools

• Proven experience in working with Oracle databases and PySpark. Strong proficiency in SQL, PL/SQL, Python, and PySpark.
• Familiarity with Oracle database administration, data warehousing, and ETL concepts.
• Understanding of big data technologies and distributed computing principles.
• Strong analytical and problem-solving skills.
• Excellent communication and teamwork abilities.
• Knowledge of data security and compliance standards and overall data processing and analysis performance.
• Documentation: Create and maintain comprehensive documentation for data models, ETL processes, and codebase.