Data Engineer

VivSoft Technologies; Athens (GA); Remote; USD 120,000 - 150,000; Full time

Job summary

VivSoft Technologies is looking for a Data Engineer to build a real-time data processing platform. You will design scalable systems and ensure efficient data flow while implementing security measures. This is a great opportunity to work remotely and join a diverse team focusing on cutting-edge technologies.

Benefits

Comprehensive Medical, Dental, and Vision Plans (100% employer-paid for employees)

Life Insurance

Paid Time Off (Flexible/Combined PTO, Bereavement Leave, 11 Company Paid Holidays)

401K Retirement Plan with employer match

Professional Development Training Reimbursement

Flexible/remote work schedules

Qualifications

• Proven hands-on experience as a Data Engineer, with a strong portfolio of successful data solutions.
• Solid understanding of databases and proficiency in writing efficient SQL queries.
• Experience working with big data technologies.

Responsibilities

• Design, implement, and maintain data infrastructure and pipelines for efficient data ingestion.
• Collaborate with data scientists and software engineers to integrate data solutions.
• Implement automation for data extraction, transformation, and loading processes.

Skills

Python

Data manipulation and analysis

Kubernetes

Terraform

ETL processes

Data integrity

Problem-solving

Education

Bachelor's or Master's degree in Computer Science, Data Science, or a related field

Tools

PostGres

SQLServer

MySQL

Oracle

Pandas

Numpy

Scikit Learn

Spark

Hadoop

AWS

Azure

Google Cloud

Job description

Job Description

Job Description

Location: Remote

About the company:
VivSoft is an emerging technology company that specializes in using modern technologies to solve our clients' toughest mission challenges. We are focused on Cloud, Enterprise DevSecOps, Artificial Intelligence, and Digital Customer Experience to drive mission-enabling digital transformation. Our passion is building mission-focused, open, scalable solutions. We are a diverse team of strategists, engineers, designers, and creators experienced in building high-performance software and AI factory accelerators by embracing automation.

Job Summary:
We are looking for a Data Engineer to build a real-time data processing platform that supports fast and reliable data ingestion. This role involves designing scalable systems, ensuring efficient data flow, and implementing security and compliance measures. The ideal candidate will help create a high-performance infrastructure that enables real-time access to critical data.

Key Responsibilities:

• Stay abreast of industry trends and best practices in data engineering.
• Design, implement, and maintain data infrastructure and pipelines for efficient data ingestion, profiling, conformance, ETL, analytics, cleansing, classification, visualization, and machine learning.
• Collaborate with data scientists, DevSecOps teams, and software engineers to integrate data solutions across environments.
• Implement automation for data extraction, transformation, and loading (ETL) processes.
• Collect data provenance and integrity requirements from government stakeholders
• Decompose requirements into technical development requirements that can be executed
• Proficiency with Kubernetes or Terraform for infrastructure management and automation.
• Work collaboratively with cross-functional teams to understand data requirements and deliver high-quality solutions.
• Utilize your problem-solving skills to design scalable and efficient data pipelines.

Required Skills/Qualifications:

• Bachelor's or Master's degree in Computer Science, Data Science, or a related field.
• Proven hands-on experience as a Data Engineer, with a strong portfolio of successful data solutions.
• Proficiency in Python and other programming languages for data manipulation and analysis.
• Strong knowledge and experience with libraries such as Pandas, Numpy, and Scikit Learn.
• Solid understanding of databases, including PostGres, SQLServer, MySQL, Oracle, and proficiency in writing efficient SQL queries.
• Familiarity with cloud platforms such as AWS, Azure, Google Cloud, and their data services.
• Experience working with big data technologies like Spark and Hadoop.
• Excellent communication and collaboration skills to work effectively with cross-functional teams.

Benefits:

• Comprehensive Medical, Dental, and Visions Plans (Healthcare benefits are 100% employer-paid for employees only)
• Life Insurance
• Paid Time Off (Flexible/Combined PTO, Bereavement Leave, 11 Company Paid Holidays)
• 401K Retirement Plan with employer match
• Professional Development Training Reimbursement
• Flexible/remote work schedules

Target salary range: $120,001 - $150,000. The estimate displayed represents the typical salary range for this position based on experience and other factors.