Data Engineer

Veridian Tech Solutions, Inc.; Raleigh (NC); On-site; USD 140,000 - 190,000; Full time

Job summary

Veridian Tech Solutions, Inc. in Raleigh, NC, is seeking an experienced AWS Python Data Engineer for a full-time onsite role. You will own end-to-end development of data solutions, utilizing AWS services and Python to build scalable pipelines.

Collaboration with cross-functional teams and a strong focus on design and hands-on coding are essential. The role requires 8+ years of experience, deep AWS expertise, and proficiency with CI/CD, Docker, Kubernetes, and Terraform.

Qualifications

• Experience with AWS services (EC2, ECS, ECR, EFS, EMR, Lambda, Step Functions, RDS, Glue, S3, API Gateway).
• Proficiency in Python libraries and scripting.
• Hands-on CI/CD experience with GitLab/Git and container orchestration (Docker, Kubernetes).
• Familiarity with cloud-native patterns, monitoring, reliability improvements.
• Experience in system design and scalability.

Responsibilities

• Responsibilities span full SDLC from requirements to deployment.
• Translate complex requirements into actionable development tasks.
• Collaborate with cross-functional teams to integrate software components.

Skills

AWS

Python

CI/CD

Docker

Kubernetes

Terraform

SDLC

Monitoring

Education

Bachelor’s degree

Tools

GitLab

Git

API Gateway

S3/EC2/ECS

RDS/Glue

Job description

Locations: Raleigh, NC / Richardson, TX / Hartford, CT (Onsite)

• A collaborative spirit and excellent communication skills.
• The ability to handle end to end SDLC phases from requirement gathering to implementation.
• A knack for translating complex requirements into actionable development tasks.
• A passion for design and hands-on coding experience
• A proactive approach to testing, troubleshooting, and refining our applications.
• The ability to work with cross-functional teams and do software integration.

Hi,

I hope you are doing good!

We have a Fulltime opportunity.

No C2C

Experience Required: 8+ Years

Job Title: AWS Python Data Engineer

Locations: Raleigh, NC / Richardson, TX / Hartford, CT (Onsite)

Below Detailed JD

• A collaborative spirit and excellent communication skills.
• The ability to handle end to end SDLC phases from requirement gathering to implementation.
• A knack for translating complex requirements into actionable development tasks.
• A passion for design and hands-on coding experience
• A proactive approach to testing, troubleshooting, and refining our applications.
• The ability to work with cross-functional teams and do software integration.

Required Skill And Experience

• Experience with AWS (EC2, ECS, ECR, EFS, EMR, Lambda, Step functions, RDS, Glue, S3, API Gateway), SQS/SNS, REST APIs & Microservices.
• Experience in Python libraries and scripting
• Experience with CI/CD (GitLab, Git), Docker & Kubernetes, Terraform (IaC), SDLC.
• Familiarities with Cloud-native architecture patterns, Production monitoring & reliability improvements
• Experience with System Design & Scalability.

Preferred Skill And Experience

• Experience with Pyspark
• Experience with Fast API/Flask frameworks, Large-scale data processing (JSON/XML/Parquet) is preferred
• Experience with Distributed Systems, SQL & NoSQL (PostgreSQL, DynamoDB)

Additional Required Qualifications

• Bachelor’s degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education.
• This position may require relocation and/or travel to work/project location.
• All applicants authorized to work in the United States are encouraged to apply.