Development - Data Engineer

Spectraforce Technologies; Raleigh (NC); On-site; USD 120,000 - 180,000; Full time

Job summary

Spectraforce Technologies is seeking a Sr. Data & Full-Stack Engineer to design and deliver scalable cloud-native data platforms. You will lead API development in Python, build end-to-end web applications, drive system design, and architect data pipelines using AWS services, PySpark, and modern orchestration tools.

Candidates should excel in data modeling across PostgreSQL, SQL Server, and DynamoDB, and contribute to automated testing, CI/CD, and reliable deployments in a DevOps environment.

Qualifications

• Experience designing secure RESTful and GraphQL APIs.
• Strong Python and data-engineering background.
• Experience with AWS data services and pipelines.
• Data modeling across relational and NoSQL databases.
• Experience with microservices and CI/CD pipelines.
• Ability to lead end-to-end web app architecture.

Responsibilities

• Backend & APIs: Design, develop, and implement secure RESTful and GraphQL APIs, microservices, and low-latency data services integrated with data pipelines using Python, Boto3, and AWS services.
• Frontend UI: Build and maintain responsive, modular web applications utilizing React, JavaScript, HTML, and CSS.
• Data Pipelines & ETL: Architect, build, and maintain high-performance batch and near-real-time ETL pipelines using pySpark, AWS Glue, AWS Batch, or similar tools, orchestrated with Apache Airflow.
• Data Modeling & Storage: Optimize performance and design schema models across PostgreSQL, SQL Server and NoSQL DynamoDB databases, along with data warehouses like Snowflake.
• DevOps & Infrastructure: Manage infrastructure monitoring with CloudWatch, incident response, and CI/CD pipelines leveraging Jenkins, Docker, Kubernetes/EKS, and Git/GitHub. AWS services experience.
• Testing: Establish rigorous automated unit and integration test suites.
• Cloud Optimization: Optimize data storage and processing using AWS services.

Skills

Python

SQL

JavaScript

React

HTML

CSS

Java

Kotlin

C#

Tools

AWS

PySpark

Snowflake

Airflow

Jenkins

Docker

Kubernetes

Job description

Data Full Stack Engineer

12 months

REMOTE

Description

Seeking a Sr. Data & Full-Stack Engineer with strong experience in API development in Python and robust data engineering. Engineers should have a proven track record of writing reliable, high-performance, production-grade code grounded in strong system design, data modeling, and engineering best practices. The ideal candidate will provide technical leadership in building scalable end-to-end web applications, driving system design, and managing cloud-native data processing pipelines. Domain experience working within Identity and Access Management is a strong plus, but not strictly required.

Responsibilities

• Backend & APIs: Design, develop, and implement secure RESTful and GraphQL APIs, microservices, and low-latency data services integrated with data pipelines using Python, Boto3, and AWS services.
• Frontend UI: Build and maintain responsive, modular web applications utilizing React, JavaScript, HTML, and CSS.
• Data Pipelines & ETL: Architect, build, and maintain high-performance batch and near-real-time ETL pipelines using pySpark, AWS Glue, AWS Batch, or similar tools, orchestrated with tools like Apache Airflow. Process diverse data formats across SQL data warehouses and unstructured sources, collaborating cross-functionally to deliver scalable data solutions.
• Data Modeling & Storage: Optimize performance and design schema models across relational PostgreSQL, SQL Server and NoSQL DynamoDB databases, along with data warehouses like Snowflake.
• DevOps & Infrastructure: Manage infrastructure monitoring with CloudWatch, incident response, and CI/CD pipelines leveraging Jenkins, Docker, Kubernetes/EKS, and Git/GitHub. Experience utilizing and developing within AWS services. Troubleshoot and resolve issues related to AWS services and infrastructure.
• Testing: Establish rigorous automated unit and integration test suites to ensure high reliability and system stability.
• Cloud Optimization: Optimize data storage and processing using cloud-native services and technologies such as AWS S3, AWS Glue, AWS Batch, Lambda, and related AWS services.

Skills

• Languages & Frameworks: Python, Advanced SQL, JavaScript, HTML, CSS, React (Nice to have: Java, Kotlin, C#)
• Data Engineering & Analytics: Apache Spark, pySpark, Snowflake, AWS Glue, AWS Batch, ETL pipeline design, Apache Airflow
• Databases & Storage: AWS S3, Relational databases PostgreSQL, SQL Server, NoSQL DynamoDB
• API & Backend Development: REST API design, GraphQL/Apollo, Boto3, API contracts, microservices, low-latency API integration Nice to have: SQS/SNS messaging
• AWS Infrastructure & Cloud Services: Lambda, ECS, EC2, RDS, Route53, S3, CloudWatch, serverless architectures
• DevOps & Testing: Jenkins, Docker, Kubernetes/EKS, CI/CD pipelines, Git/GitHub, automated testing unit/integration
• Strategic Nice-to-Haves: IAM, cybersecurity data environments, access governance, identity platforms, Spring Batch, event-driven architectures