Senior Data Analytics & Engineer

OnPoint Insights; North Carolina; Hybrid; USD 120,000 - 180,000; Full time

Job summary

OnPoint Insights in Durham, NC seeks a Senior Data Engineer / Data Analytics Consultant to design scalable data pipelines and APIs. The role emphasizes Databricks (preferred) or Snowflake, Python data processing, and Spark-based big data workflows.

You will collaborate with cross-functional teams, build REST APIs using FastAPI or Flask, and work on cloud platforms like Azure or AWS to deliver robust data solutions.

Qualifications

• 12+ years of experience in Data Engineering and Analytics.
• Strong hands-on experience with Databricks.
• Candidates with strong Snowflake experience and solid Data Engineering expertise will also be considered.
• Strong programming skills in Python.
• Experience with Apache Spark / PySpark and Big Data technologies.
• Hands-on experience with Azure and/or AWS.
• Experience building REST APIs using FastAPI (preferred), Flask, Streamlit, or Gradio.
• Strong understanding of REST API concepts including GET, POST, PUT, DELETE, request/response handling, and integration.
• Excellent analytical, problem-solving, and communication skills.

Responsibilities

• Design, develop, and optimize scalable data pipelines for large-scale data processing.
• Build and maintain modern data engineering solutions using Databricks (preferred) or Snowflake.
• Develop data transformation, automation, and processing frameworks using Python.
• Implement Big Data solutions using Apache Spark/PySpark.
• Design and develop REST APIs and lightweight microservices using FastAPI (preferred), Flask, Streamlit, or Gradio.
• Collaborate with cross-functional teams to integrate data services with enterprise applications.
• Optimize data workflows for performance, scalability, and reliability.
• Work with cloud platforms such as Azure or AWS to build and manage data solutions.

Skills

Data engineering

Databricks

Snowflake

Python

Apache Spark / PySpark

REST APIs

API development

Big Data

Azure

AWS

FastAPI

Flask

Streamlit

Gradio

Communication

Tools

Databricks

Snowflake

Azure

AWS

FastAPI

Flask

Streamlit

Gradio

Job description

Location: Durham, NC (Hybrid 3 days in week onsite)

We are looking for an experienced Senior Data Engineer / Data Analytics Consultant to join our team in Durham, NC. The ideal candidate will have deep expertise in modern data engineering, Databricks, Python, Spark, and cloud technologies, along with practical experience in API development.

Key Responsibilities

• Design, develop, and optimize scalable data pipelines for large-scale data processing.
• Build and maintain modern data engineering solutions using Databricks (preferred) or Snowflake.
• Develop data transformation, automation, and processing frameworks using Python.
• Implement Big Data solutions using Apache Spark/PySpark.
• Design and develop REST APIs and lightweight microservices using FastAPI (preferred), Flask, Streamlit, or Gradio.
• Collaborate with cross-functional teams to integrate data services with enterprise applications.
• Optimize data workflows for performance, scalability, and reliability.
• Work with cloud platforms such as Azure or AWS to build and manage data solutions.

Required Skills

• 12+ years of experience in Data Engineering and Analytics.
• Strong hands‑on experience with Databricks (preferred).
• Candidates with strong Snowflake experience and solid Data Engineering expertise will also be considered.
• Strong programming skills in Python.
• Experience with Apache Spark / PySpark and Big Data technologies.
• Hands-on experience with Azure and/or AWS.
• Experience building REST APIs using FastAPI (preferred), Flask, Streamlit, or Gradio.
• Strong understanding of REST API concepts including GET, POST, PUT, DELETE, request/response handling, and integration.
• Excellent analytical, problem-solving, and communication skills.

Preferred Skills

• Experience in the Healthcare or Pharmaceutical domain is a plus.
• Experience working in Agile environments