Principal Software Developer

Oracle; Pleasanton (CA); On-site; USD 96,000 - 224,000; Full time

Job summary

A leading company is seeking a skilled PySpark Data Engineer to join its dynamic team in Pleasanton. The role involves designing and implementing data processing solutions using advanced technologies. Candidates should possess strong Python and PySpark skills with significant experience in big data environments. This position offers a competitive salary and an opportunity to innovate within the fast-paced world of Business Intelligence software.

Benefits

Medical, dental, and vision insurance

401(k) Savings and Investment Plan with company match

Paid time off and holidays

Paid parental leave

Employee Stock Purchase Plan

Qualifications

• 6+ years of hands-on experience in big data development.
• Strong understanding of data processing principles in a big data environment.
• Excellent communication and collaboration skills.

Responsibilities

• Design, develop, and test PySpark-based applications to process and analyze large-scale datasets.
• Implement efficient data transformation and aggregation using PySpark.
• Collaborate with cross-functional teams to deliver new features.

Skills

Python

PySpark

Apache Spark

ETL Development

Data Analysis

Education

Bachelor’s Degree in Computer Science/Engineering

Tools

Apache Airflow

Luigi

Job description

Oracle Fusion Analytics Warehouse is a pre-packaged analytical application offered to executive-level users. Content-packed analytical decks and data-rich visualizations are built on top of the Fusion Analytic Warehouse, geared towards helping executives make strategic & informed business decisions.
The development involves state-of-the-art technologies in a multi-tenant cloud-based application.

We are seeking a skilled PySpark Data Engineer to join our team and drive the development of robust data processing and transformation solutions within our data platform. You will be responsible for designing, implementing, and maintaining PySpark-based applications to handle complex data processing tasks, ensure data quality, and integrate with diverse data sources. The ideal candidate possesses strong python and PySpark development skills, experience with big data technologies, and the ability to work in a fast-paced, data-driven environment.

Join our team and you will,

• Use your creative power to build the next generation of Analytical products.
• Use your technical skills to create the best products and features for our customers and change the face of Business Intelligence software.
• Work with state-of-the-art cloud products.
• Join one of the most successful, dynamic, and fastest-growing business units at Oracle

Expected Skills & Qualifications:

• At a minimum, a Bachelor’s Degree in Computer Science/Engineering.
• Bachelor's degree in Computer Science, Information Technology, or a related field.
• 6+ years of hands-on experience in big data development, preferably with exposure to data-intensive applications.
• Strong understanding of data processing principles, techniques, and best practices in a big data environment.
• Proficiency in Python, PySpark, Apache Spark, and related big data technologies for data processing, analysis, and integration.
• Experience with ETL development and data pipeline orchestration tools (e.g., Apache Airflow, Luigi).
• Strong analytical and problem-solving skills, with the ability to translate business requirements into technical solutions.
• Excellent communication and collaboration skills to work effectively with data analysts, data architects, and other team members.

QualificationsDisclaimer:

Certain US customer or client-facing roles may be required to comply with applicable requirements, such as immunization and occupational health mandates.

Range and benefit information provided in this posting are specific to the stated locations only

US: Hiring Range in USD from: $96,800 to $223,400 per annum. May be eligible for bonus and equity.

Oracle maintains broad salary ranges for its roles in order to account for variations in knowledge, skills, experience, market conditions and locations, as well as reflect Oracle’s differing products, industries and lines of business.
Candidates are typically placed into the range based on the preceding factors as well as internal peer equity.

Oracle US offers a comprehensive benefits package which includes the following:
1. Medical, dental, and vision insurance, including expert medical opinion
2. Short term disability and long term disability
3. Life insurance and AD&D
4. Supplemental life insurance (Employee/Spouse/Child)
5. Health care and dependent care Flexible Spending Accounts
6. Pre-tax commuter and parking benefits
7. 401(k) Savings and Investment Plan with company match
8. Paid time off: Flexible Vacation is provided to all eligible employees assigned to a salaried (non-overtime eligible) position. Accrued Vacation is provided to all other employees eligible for vacation benefits. For employees working at least 35 hours per week, the vacation accrual rate is 13 days annually for the first three years of employment and 18 days annually for subsequent years of employment. Vacation accrual is prorated for employees working between 20 and 34 hours per week. Employees working fewer than 20 hours per week are not eligible for vacation.
9. 11 paid holidays
10. Paid sick leave: 72 hours of paid sick leave upon date of hire. Refreshes each calendar year. Unused balance will carry over each year up to a maximum cap of 112 hours.
11. Paid parental leave
12. Adoption assistance
13. Employee Stock Purchase Plan
14. Financial planning and group legal
15. Voluntary benefits including auto, homeowner and pet insurance

The role will generally accept applications for at least three calendar days from the posting date or as long as the job remains posted.

Career Level - IC4

Responsibilities

• Design, develop, and test PySpark-based applications to process, transform, and analyze large-scale datasets from various sources, including relational databases, batch files, and real-time data streams.
• Implement efficient data transformation and aggregation using PySpark and relevant big data frameworks.
• Develop robust error handling and exception management mechanisms to ensure data integrity and system resilience within Spark jobs.
• Optimize PySpark jobs for performance, including partitioning, caching, and tuning of Spark configurations.
• Collaborate with cross-functional teams to define, design, and deliver new features.
• Write clean, maintainable, and efficient code with a focus on performance and scalability.
• Participate in code reviews to maintain code quality
• As a member of the software engineering division, you will also take an active role in defining and evolving standard practices and procedures.
• Work is non-routine and complex, involving the application of advanced technical skills in an area of specialization. Leading contributor individually and as a team member, providing direction and mentoring to others. BS or MS degree or equivalent experience relevant to the functional area

#LI-AH4