Lead Data Engineer - Azure Databricks & API Pipelines

Euclid Innovations, Inc.; Charlotte (NC); On-site; USD 90,000 - 130,000; Full time

Job summary

Euclid Innovations, Inc. in Charlotte, NC is seeking a Data Engineer to design and build robust data pipelines in Azure environments. You will leverage Python, PySpark, SQL, and Databricks to transform financial market data into actionable insights.

The role requires experience with API development using FastAPI or similar frameworks, API gateway concepts, and applying CI/CD practices within a DevOps lifecycle. Equal opportunity employer.

Qualifications

• Proven experience as a Data Engineer with Azure cloud experience.
• Experience developing APIs using FastAPI or similar Python frameworks.
• Strong SQL skills with relational or NoSQL databases.
• Experience with API Gateway management.
• Familiar with ETL/ELT processes.
• Experience with PySpark, Python and its frameworks.
• Experience with Azure Databricks.
• DevOps familiarity (git, Jenkins, CI/CD).
• Experience in financial services industry is a plus.

Skills

Python

PySpark

SQL

API development

Azure cloud

Azure Databricks

DevOps CI/CD

Tools

Azure Databricks

Git

Jenkins

NoSQL databases

RDMS databases

FastAPI

Job description

Euclid Innovations, Inc. in Charlotte, NC is seeking a Data Engineer to design and build robust data pipelines in Azure environments. You will leverage Python, PySpark, SQL, and Databricks to transform financial market data into actionable insights.

The role requires experience with API development using FastAPI or similar frameworks, API gateway concepts, and applying CI/CD practices within a DevOps lifecycle. Equal opportunity employer.