Senior Data Platform Engineer (Databricks) - Remote

INSPYR Solutions; San Jose (CA); On-site; USD 110,000 - 130,000; Full time

Job summary

A leading technology solutions provider is seeking a Senior Data Platform Engineer for a remote position. The role demands expertise in Python/PySpark and the ability to enhance Data Platform Services. Responsibilities include designing onboarding capabilities and ensuring data integrity and compliance. Ideal candidates will have a strong understanding of Data Lakes and cloud services, particularly AWS.

Qualifications

• Strong Python/PySpark coding skills.
• Good understanding of Data Lakes and Warehouses.
• Familiar with cloud services, preferably AWS.

Responsibilities

• Enhance performance and reliability of Data Platform Services.
• Design self-servicing onboarding and automation capabilities.
• Develop scalable data platform solutions.

Skills

Python/PySpark expertise

Version control systems

Data Lakes and Warehouses

Data ingestion services

ANSI SQL and Spark SQL

Workflow automation tools

Databricks or Hadoop

Cloud services (AWS, GCP, Azure)

Streaming and batch data sources

Visualization experience

Agile methodologies

Job description

A leading technology solutions provider is seeking a Senior Data Platform Engineer for a remote position. The role demands expertise in Python/PySpark and the ability to enhance Data Platform Services. Responsibilities include designing onboarding capabilities and ensuring data integrity and compliance. Ideal candidates will have a strong understanding of Data Lakes and cloud services, particularly AWS.