Cloud Data Engineer: OpenSearch & Big Data

VTG; Herndon (VA); On-site; USD 130,000 - 190,000; Full time

Job summary

VTG is seeking a Software Engineer to design, develop, and deploy cloud-based data tools in a mission-critical environment. The role emphasizes OpenSearch-based data layers, AWS pipelines, and scalable processing of large datasets.

You will collaborate with data scientists, analysts, and engineers, implement robust indexing strategies, optimize queries, and ensure robust documentation and continuous improvement.

Qualifications

• Active TS/SCI with Polygraph.
• 4+ years of experience in software engineering and development.
• Bachelor's degree in Computer Science, Information Technology, or related technical discipline, or equivalent.

Responsibilities

• Write cloud-based applications and tools to improve system performance and usability.
• Design, develop, test, debug, and deploy software to parse raw data for analysis.
• Collaborate with data scientists, analysts, project managers and other engineers.
• Deploy software into an AWS-based data ingest pipeline.
• Write software that stores data into S3 and is queried by Athena or OpenSearch.
• As an OpenSearch expert, drive indexing strategies and query optimizations.
• Troubleshoot complex problems and provide support for software systems.
• Maintain documentation for new software and procedures to be followed.
• Provide recommendations for continuous improvement.

Skills

OpenSearch

AWS

Big data analytics

Data ingestion

Cloud-based applications

Elasticsearch

Education

Bachelor's degree in Computer Science, Information Technology, or related field

Tools

Athena

S3

Elasticsearch

Job description

VTG is seeking a Software Engineer to design, develop, and deploy cloud-based data tools in a mission-critical environment. The role emphasizes OpenSearch-based data layers, AWS pipelines, and scalable processing of large datasets.

You will collaborate with data scientists, analysts, and engineers, implement robust indexing strategies, optimize queries, and ensure robust documentation and continuous improvement.