Python SQL Developer

Apex Systems; Irving (TX); On-site; USD 90,000 - 150,000; Full time

Job summary

An established industry player is seeking a seasoned data engineer with over a decade of experience in Python and SQL. This role involves working on a significant project focused on migrating data warehouses and pipelines from GCP to Azure. You will collaborate on developing new data pipelines, ensuring data integrity, and implementing robust validation tools. The company offers a dynamic work environment where your expertise in Azure cloud technologies and distributed processing frameworks will be pivotal in driving the success of the project. If you thrive in a collaborative setting and have a passion for data engineering, this opportunity is perfect for you.

Qualifications

• 10+ years of experience in Python and SQL is required.
• Hands-on Azure knowledge with tools like Data Factory and Synapse.

Responsibilities

• Develop new data pipelines and connections in Azure.
• Handle data migration, transformation, and validation tools.

Skills

Python

SQL

Azure Data Factory

Azure Synapse

Event Hub

AKS

Kafka

Spark

Communication Skills

Problem-Solving Skills

Job description

Onsite 3 days/week - Dallas, Minneapolis, Atlanta or Bay Area

Job Description:

• Python > 10 years
• SQL > 10 years
• Experience with Azure Data Factory, Synapse, Event Hub, AKS Hands-on Azure cloud knowledge > 5 years
• Distributed processing frameworks such as Kafka, Spark
• Good communication and problem-solving skills

Project:

• Data warehouse migration and data pipeline from GCP to Azure.

Responsibilities:

• Work on new data pipeline and connections in Azure, data migration, data transformation, query conversion, new data validation tools and data API in Azure AKS. The duration of the resources is set as 6 months, covering MVP development/releases, additional scope, performance tuning, and documentation post MVP launch.

Requirements:

• Python > 10 years
• SQL > 10 years
• Experience with Azure Data Factory, Synapse, Event Hub, AKS Hands-on Azure cloud knowledge > 5 years
• Distributed processing frameworks such as Kafka, Spark
• Good communication and problem-solving skills

Preferred Skills:

• Graph QL API and REST API, data microservice Shell scripting

Interview Process:

• 3 rounds of technical interview
• Video, last round may be in person
• Includes technical best practices, coding, and technical system design questions.