Senior Software & Data Engineer - Python, APIs & ETL

VTG; Chantilly (VA); On-site; USD 150,000 - 195,000; Full time

Job summary

VTG in Chantilly, VA is seeking an experienced Software & Data Engineer to support a social media data exploitation platform. You will join an established development team to enhance a service-based web application, build data ingestion and processing pipelines, integrate external APIs, and maintain database and infrastructure components.

Responsibilities include Python apps and API integrations, REST/GraphQL/sockets, Java components when needed, ETL with Apache NiFi, and working with

Qualifications

• Experience developing Python applications.
• Experience developing Python API integrations.
• Experience utilizing Anaconda and/or MicroMamba for Python package and environment management.
• Strong experience working within Linux environments.
• Experience with Bash scripting, Cron jobs, and IT automation.
• Experience developing and integrating APIs using REST, GraphQL, and/or socket-based communications.
• Professional development experience with Java.
• Experience with web application technologies and browser troubleshooting.
• Knowledge of SSL/TLS, certificates, and secure application communications.
• Experience designing, developing, and maintaining relational databases, including PostgreSQL and MySQL.
• Experience developing PL/SQL scripts, procedures, functions, exception handlers, and triggers.
• Experience developing and tuning complex queries against structured and unstructured datasets.
• Experience maintaining Jenkins CI/CD pipelines with automated testing and deployment.
• Experience with big-data and/or NoSQL technologies such as MongoDB, Elasticsearch, MapReduce, or HBase.
• Experience with Apache NiFi.
• Strong experience designing and supporting ETL processes and data pipelines.
• Experience maintaining and troubleshooting software, hardware, and network infrastructure.
• Experience using Git for source code management.

Responsibilities

• Design, develop, and maintain software for a social media data platform.
• Develop applications and services using Python.
• Develop and maintain Python-based API integrations.
• Design, develop, and integrate RESTful APIs, GraphQL, sockets, and other web-service protocols.
• Develop and maintain Java components as required.
• Enhance existing service-based web applications.
• Work with web technologies, cookies, transactions, host-to-host, browser tools, and mobile compatibility.
• Use Anaconda or MicroMamba for Python env management.
• Maintain source code in enterprise Git repositories.
• Design, develop, and maintain PostgreSQL and MySQL databases.
• Develop and maintain PL/SQL scripts (procedures, functions, triggers, etc.).
• Write, optimize, and tune complex database queries.
• Develop and maintain ETL processes and data pipelines.
• Develop and support data ingestion/ transformation pipelines with Apache NiFi.

Skills

Python

REST APIs

GraphQL

Sockets

Java

Linux

Bash scripting

Cron jobs

Education

Bachelor's degree in Computer Science, Information Technology, Engineering, or a related technical discipline

Tools

PostgreSQL

MySQL

MongoDB

Elasticsearch

MapReduce

HBase

Apache NiFi

Git

Jenkins CI/CD

Job description

VTG in Chantilly, VA is seeking an experienced Software & Data Engineer to support a social media data exploitation platform. You will join an established development team to enhance a service-based web application, build data ingestion and processing pipelines, integrate external APIs, and maintain database and infrastructure components.

Responsibilities include Python apps and API integrations, REST/GraphQL/sockets, Java components when needed, ETL with Apache NiFi, and working with