HL Software Engineer/Opensearch Developer

Probity; Chantilly (VA); On-site; USD 140,000 - 190,000; Full time

Job summary

Probity is seeking a HL Software Engineer/Opensearch Developer in Chantilly, VA to design and implement scalable data platforms and cloud-based tools. The role emphasizes hands-on development with OpenSearch/Elasticsearch, Python, and AWS services within an agile team.

The successful candidate will own data ingestion pipelines, optimize queries, and collaborate with data scientists and engineers to deliver robust solutions for large data sets in a mission-critical environment.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, or related technical discipline, or equivalent combination of education, certs, training, and experience.
• Hands-on experience with Python, Git, and unit testing frameworks.
• Experience building APIs and services using REST.
• Hands-on experience with OpenSearch or Elasticsearch.
• Experience with AWS CDK or Terraform.
• Experience applying OO design principles to architect scalable software systems.
• Experience with AWS core services: EC2, S3, IAM, VPC.

Responsibilities

• Write cloud-based software tools to parse raw data for analysis.
• Design, develop, test, and deploy software in AWS-based data ingest pipelines.
• Collaborate with data scientists, analysts, PMs and engineers.
• Drive OpenSearch data layer architecture including indexing strategies and query optimization.
• Troubleshoot complex issues in a mission-critical environment.
• Maintain documentation and contribute to continuous improvement.

Skills

Python development

REST API design

OpenSearch/Elasticsearch

AWS cloud

Agile methodologies

Education

Bachelor's degree in Computer Science or related field

Tools

Git

AWS CDK

Terraform

EC2

S3

IAM

VPC

NGINX

DynamoDB

RDS

Hive

Parquet/ORC

Hadoop

Spark

Dagster/Airflow/NiFi

CI/CD

Linux scripting

Job description

Position: HL Software Engineer/Opensearch Developer

Location: Chantilly, VA

# of Openings: 1

PLEASE NOTE: This position requires an ACTIVE Top Secret/SCI Clearance with Polygraph. To be considered for this position, you MUST have an ACTIVE Clearance Level of Top Secret/SCI with Polygraph

Position Code: 13-SO0825-1

JOB DESCRIPTION

The Software Engineer will design, develop, code, test, and debug complex software products to be deployed in a mission critical environment. The ideal candidate is a hands-on developer with significant experience in scalable data platforms, cloud-based services, and big data analytics, and OpenSearch or Elasticsearch. They must have strong, firsthand technical expertise in a variety of data ingestion/computation technologies and the proven ability to fashion robust scalable solutions that can manage large data sets. They must be at ease working in an agile environment with a cross-functional team. This person should embody a passion for innovation and continuous improvement.

KEY RESPONSIBILITIES

• Work with a team to write new cloud-based applications and tools and recommend new technologies and methodologies to improve system performance and usability.
• Design, develop, test, debug, and deploy new software tools that extend or replace existing capabilities to parse raw data for analysis.
• Collaborate cross-functionally with data scientists, analysts, project managers and other engineers and technical SMEs.
• Deploy new software into an AWS-based data ingest pipeline.
• Write software that interacts with multiple data types and stores data into S3 buckets that is queried by processes running Athena or OpenSearch.
• As an OpenSearch expert, drive the design of indexing strategies, query optimizations, and maintain overall architectural ownership of the OpenSearch data layer.
• Troubleshoot complex problems and provide support to mission areas for software systems and application issues.
• Maintain good documentation for new software written and new procedures to be followed.
• Provide recommendations for continuous improvement.
• Work alongside other engineers on the team to sustain and advance our organization’s capabilities.

EDUCATION AND EXPERIENCE

• Bachelor's degree in Computer Science, Information Technology, or other related technical discipline, or equivalent combination of education, technical certifications, training, and work/military experience.

REQUIRED QUALIFICATIONS

• Demonstrated hands-on experience with Python, Git, and unit testing frameworks.
• Demonstrated hands-on experience with building APIs and services using REST.
• Demonstrated hands-on experience with OpenSearch or Elasticsearch.
• Demonstrated hands-on experience with AWS CDK 1 and/or 2 or Terraform.
• Demonstrated hands-on experience applying object-oriented design principles and patterns to architect scalable, maintainable, and testable software systems in production environments.
• Demonstrated hands-on experience designing and developing applications using core AWS services, including EC2, S3, IAM, and VPC

DESIRED QUALIFICATIONS

• Demonstrated hands-on experience building event-driven or serverless architectures using AWS services such as Lambda, API Gateway, and SQS or SNS
• Demonstrated hands-on experience implementing data pipelines or analytics workflows using AWSnative services (Glue, Athena, EMR, S3)
• Demonstrated experience optimizing AWS costs using best practices such as right-sizing, storage tiering, and workload-aware architecture decisions.
• Demonstrated hands-on experience with PRESTO, Trino, or Apache Spark
• Demonstrated hands-on experience with reverse proxy solutions e.g NGINX
• Demonstrated hands on experience working with DynamoDB, RDS, or HIVE.
• Demonstrated hands-on experience with Parquet and/or ORC file formats.
• Demonstrated hands-on experience working with Hadoop, Apache Spark and their related ecosystems.
• Demonstrated hands-on experience building and managing ETL pipelines using orchestration frameworks like Dagster, Airflow, or NiFi.
• Demonstrated hands-on DevOps experience to include creation and deployment of container-based applications
• Demonstrated hands-on experience working with cloud formation for automation.
• Demonstrated hands-on experience building and deploying software within a CI/CD pipeline.
• Demonstrated hands-on experience with Linux-based systems and shell scripting.