SAP HANA Data Engineer Lead(Azure, Pyspark, sql and migration data from HANA to Databricks ) Remote

Radiansys Inc.; California (MO); Remote; USD 145,000 - 204,000; Full time

Job summary

A leading company is seeking a skilled SAP HANA Data Engineer Lead to oversee data engineering projects focused on migrating data from HANA to Databricks. The ideal candidate will have strong Azure, PySpark, and SQL skills, alongside experience in data profiling and performance optimization. This remote role offers a competitive salary and the opportunity to work on cutting-edge projects in data engineering.

Qualifications

• Experience integrating SAP data with other platforms.
• Proficient in building and managing ETL pipelines.
• Strong knowledge of Azure services related to data.

Responsibilities

• Oversee the design and implementation of large-scale data engineering projects.
• Manage and optimize data pipelines using Databricks and Azure.
• Ensure robust transformation and integration for data processing.

Skills

Data Engineering

Azure Skills

PySpark

SQL

Data Profiling

Performance Optimization

Education

Relevant degree in Computer Science or related field

Tools

Databricks

Azure Data Factory

SAP Data Services

Job description

SAP HANA Data Engineer Lead(Azure, Pyspark, sql and migration data from HANA to Databricks ) Remote

SAP HANA Data Engineer Lead(Azure, Pyspark, sql and migration data from HANA to Databricks ) Remote

2 days ago Be among the first 25 applicants

Direct message the job poster from Radiansys Inc.

Hi

We are looking for SAP HANA Data Engineer Lead(Azure, Pyspark, sql and migration data from HANA to Databricks ) Remote. Anyone interested can share your resume [e-mail]

Title: Technical Lead/San Jose, CA (Onsite)/Remote

Open for Remote

CLIENT UPDATE – In terms of skills, core expectation is Data Engineering, Azure skills – mainly PySpark and SQL. Experience of SAP HANA as they migrate data from HANA to Databricks.

• We are looking for a skilled Technical Lead to oversee the design and implementation of large-scale data engineering andmigration projects
• Databricks & Delta Lake — Evaluate good understanding of Hands-on experience with Databricks, including development using PySpark or Spark SQL, Efficient use of Delta Lake for scalable data pipelines, and data lineage in Databricks
• Azure Data Factory — Evaluate good understanding of Building and managing ETL pipelines using ADF, Using ADF for orchestration with Databricks, Blob Storage, SAP sources, Monitoring, error handling, and pipeline performance tuning
• Performance Optimization Evaluate good understanding of handling Performance optimization on Databricks
• Python & PySpark — Evaluate good understanding of Writing robust, maintainable data processing scripts, Using Python/Spark for custom transformations and integration logic
• SAP HANA Experience/knowledge — Integrating SAP data with other platforms, Handling large-scale SAP data extraction, transformation, and migration; Good understanding of SAP HANA architecture and data modeling
• ETL Tools, SAP Data Services — Evaluate good understanding of Creating, deploying, and optimizing data jobs in SAP BODS/Data Services, Working with complex mappings and SAP-specific data types, Handling change data capture (CDC) scenarios
• Data Profiling & Validation — Evaluate good understanding of Experience in data profiling, validation, and reconciliation during migrations
• Azure Cloud & Networking — Evaluate good understanding of Azure services related to compute, storage, networking, and security, Experience resolving firewall, VPN, and VNet issues impacting data pipelines, Familiarity with IAM, RBAC, and secure credential storage

Regards,

Pinku

Talent Acquisition – Radiansys Inc.

Direct: 510 790 2000 Ext 1006

Email: [e-mail]

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Full-time

Job function

• Job function

  Accounting/Auditing, Administrative, and Advertising

• Industries

  IT Services and IT Consulting, IT System Testing and Evaluation, and IT System Data Services

Referrals increase your chances of interviewing at Radiansys Inc. by 2x

Sign in to set job alerts for “Data Engineer” roles.

Continue with Google Continue with Google

Continue with Google Continue with Google

United States $170,000 - $720,000 1 day ago

San Francisco, CA $126,100 - $186,800 2 weeks ago

Mountain View, CA $67.30 - $77.30 1 week ago

United States
$145,000.00
-
$204,000.00
1 week ago

Los Angeles Metropolitan Area 2 weeks ago

California, United States
$80.57
-
$84.68
1 week ago

California, United States
$100,000.00
-
$720,000.00
2 weeks ago

San Francisco, CA
$120,000.00
-
$150,000.00
3 weeks ago

San Francisco, CA
$147,000.00
-
$217,800.00
2 weeks ago

Brisbane, CA
$74,000.00
-
$140,000.00
1 week ago

San Francisco, CA
$60,000.00
-
$60,000.00
1 month ago

Software Engineer (L5) - Open Connect Platform

San Francisco Bay Area
$104,286.00
-
$139,048.00
2 weeks ago

San Mateo, CA
$115,000.00
-
$135,000.00
1 day ago

Software Engineer, Python - AI Training (Freelance, Remote)

Alhambra, CA $105,000 - $115,000 2 hours ago

Palo Alto, CA $140,000 - $185,000 2 weeks ago

Software Engineer, SQL - AI Training (Freelance, Remote)

Software Engineer - AI Training (Freelance, Remote)

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.