Platform Strategy Data Engineer : 26-02792

Akraya, Inc.; San Jose (CA); Hybrid; USD 50,000 - 83,000; Full time

Job summary

Akraya, Inc. is seeking a data platform engineer in San Jose, CA to support critical data platforms and real-time services, including generative AI initiatives. You will focus on enhancing data operations processes and ensuring the reliability and scalability of existing applications during the contract period.

The role requires rapid ramp-up to contribute to ongoing projects and maintain system health on a W2 basis in a hybrid San Jose environment.

Qualifications

• Expertise in Databricks, Spark, and Python.
• Proficiency with Kafka and streaming technologies.
• Experience building and managing containerized applications with Kubernetes.

Responsibilities

• Implement solutions for robust data pipeline management and quality assurance.
• Operate and deploy applications that support data analytics and AI workloads.
• Develop systems for migrating from Kafka to Azure Event Hubs.
• Automate scaling, CI/CD, monitoring, and observability for data infrastructure.
• Sustain the performance and reliability of the data and analytics platforms.

Skills

Databricks

Kafka

Python

Azure Event Hubs

Kubernetes

Job description

Primary Skills: Databricks (advanced), Kafka (advanced), Python (advanced), Azure Event Hubs (intermediate), Kubernetes (intermediate) Contract Type: W2 Duration: 3+ Months Location: San Jose, CA (Hybrid) Pay Range: $50-$60/hr. on W2

Job Summary

This role involves supporting critical data platforms and real-time services, including generative AI initiatives. You will focus on enhancing data operations processes and ensuring the reliability and scalability of existing applications. The position requires a rapid ramp-up to contribute to ongoing projects and maintain system health during a contract period.

Key Responsibilities

• Implement solutions for robust data pipeline management and quality assurance.
• Operate and deploy applications that support data analytics and AI workloads.
• Develop systems for migrating from Kafka to Azure Event Hubs.
• Automate scaling, CI/CD, monitoring, and observability for data infrastructure.
• Sustain the performance and reliability of the data and analytics platforms.

Must-Have Skills

• Expertise in Databricks, Spark, and Python.
• Proficiency with Kafka and streaming technologies.
• Experience building and managing containerized applications with Kubernetes.
• This role requires experience within the data and analytics domain, with a focus on platform engineering and operational excellence.