SME Software / Data Engineer

VTG; Chantilly (VA); On-site; USD 150,000 - 195,000; Full time

Job summary

VTG in Chantilly, VA is seeking an experienced Software & Data Engineer to support a social media data exploitation platform. You will join an established development team to enhance a service-based web application, build data ingestion and processing pipelines, integrate external APIs, and maintain database and infrastructure components.

Responsibilities include Python apps and API integrations, REST/GraphQL/sockets, Java components when needed, ETL with Apache NiFi, and working with

Qualifications

• Experience developing Python applications.
• Experience developing Python API integrations.
• Experience utilizing Anaconda and/or MicroMamba for Python package and environment management.
• Strong experience working within Linux environments.
• Experience with Bash scripting, Cron jobs, and IT automation.
• Experience developing and integrating APIs using REST, GraphQL, and/or socket-based communications.
• Professional development experience with Java.
• Experience with web application technologies and browser troubleshooting.
• Knowledge of SSL/TLS, certificates, and secure application communications.
• Experience designing, developing, and maintaining relational databases, including PostgreSQL and MySQL.
• Experience developing PL/SQL scripts, procedures, functions, exception handlers, and triggers.
• Experience developing and tuning complex queries against structured and unstructured datasets.
• Experience maintaining Jenkins CI/CD pipelines with automated testing and deployment.
• Experience with big-data and/or NoSQL technologies such as MongoDB, Elasticsearch, MapReduce, or HBase.
• Experience with Apache NiFi.
• Strong experience designing and supporting ETL processes and data pipelines.
• Experience maintaining and troubleshooting software, hardware, and network infrastructure.
• Experience using Git for source code management.

Responsibilities

• Design, develop, and maintain software for a social media data platform.
• Develop applications and services using Python.
• Develop and maintain Python-based API integrations.
• Design, develop, and integrate RESTful APIs, GraphQL, sockets, and other web-service protocols.
• Develop and maintain Java components as required.
• Enhance existing service-based web applications.
• Work with web technologies, cookies, transactions, host-to-host, browser tools, and mobile compatibility.
• Use Anaconda or MicroMamba for Python env management.
• Maintain source code in enterprise Git repositories.
• Design, develop, and maintain PostgreSQL and MySQL databases.
• Develop and maintain PL/SQL scripts (procedures, functions, triggers, etc.).
• Write, optimize, and tune complex database queries.
• Develop and maintain ETL processes and data pipelines.
• Develop and support data ingestion/ transformation pipelines with Apache NiFi.

Skills

Python

REST APIs

GraphQL

Sockets

Java

Linux

Bash scripting

Cron jobs

Education

Bachelor's degree in Computer Science, Information Technology, Engineering, or a related technical discipline

Tools

PostgreSQL

MySQL

MongoDB

Elasticsearch

MapReduce

HBase

Apache NiFi

Git

Jenkins CI/CD

Job description

Overview

We are seeking an experienced Software & Data Engineer to support the maintenance, enhancement, and continued development of an existing social media data exploitation platform.

The program applies technical resources to accelerate the timely, reliable, and secure delivery of open-source data, information, and insights. The Software & Data Engineer will work within an established development team to enhance a service-based web application, develop data ingestion and processing capabilities, integrate external APIs, and maintain supporting database and infrastructure components.

What will you do?

• Design, develop, enhance, and maintain software supporting a social media data exploitation platform.

• Develop applications and services using Python.

• Develop and maintain Python-based API integrations.

• Design, develop, and integrate APIs utilizing:

  • RESTful APIs

  • GraphQL

  • Sockets

  • Other web-service protocols

• Develop and maintain software components using Java as required.

• Develop enhancements to existing service-based web applications.

• Work with web technologies including cookies, web transactions, host-to-host communication, browser developer tools, and mobile compatibility capabilities.

• Utilize Anaconda and/or MicroMamba for Python environment and package management.

• Maintain application source code within enterprise Git repositories.

• Design, develop, and maintain SQL-based databases, including:

  • PostgreSQL

  • MySQL

• Develop and maintain PL/SQL scripts, including:

  • Procedures

  • Functions

  • Exception handlers

  • Triggers

• Write, optimize, and tune complex database queries.

• Work with both structured and unstructured datasets.

• Design and maintain Extract, Transform, and Load (ETL) processes.

• Develop and support data ingestion and transformation pipelines.

• Utilize Apache NiFi for data flow, ingestion, and processing.

• Work with NoSQL and big-data technologies including:

  • MongoDB

  • Elasticsearch

  • MapReduce

  • HBase

• Troubleshoot database, ingestion, transformation, and data-processing issues.

Do you have what it takes?

• Active TS/SCI with Polygraph

• Bachelor's degree in Computer Science, Information Technology, Engineering, or a related technical discipline preferred.

• Demonstrated professional experience developing applications with Python.

• Experience developing Python API integrations.

• Experience utilizing Anaconda and/or MicroMamba for Python package and environment management.

• Strong experience working within Linux environments.

• Experience with Bash scripting, Cron jobs, and IT automation.

• Experience developing and integrating APIs using REST, GraphQL, and/or socket-based communications.

• Professional development experience with Java.

• Experience with web application technologies and browser-based troubleshooting.

• Knowledge of SSL/TLS, certificates, and secure application communications.

• Experience designing, developing, and maintaining relational databases, including PostgreSQL and MySQL.

• Experience developing PL/SQL scripts, procedures, functions, exception handlers, and triggers.

• Experience developing and tuning complex queries against structured and unstructured datasets.

• Experience maintaining Jenkins CI/CD pipelines with automated testing and deployment.

• Experience with big-data and/or NoSQL technologies such as MongoDB, Elasticsearch, MapReduce, or HBase.

• Experience with Apache NiFi.

• Strong experience designing and supporting ETL processes and data pipelines.

• Experience maintaining and troubleshooting software, hardware, and network infrastructure.

• Experience using Git for source code management.

• Strong troubleshooting, analytical, and problem-solving abilities.