Software Engineer (Developer, OpenSearch)

Bespoke Technologies, Inc.; Chantilly, Northern (VA, KY); Hybrid; USD 120,000 - 180,000; Full time

Job summary

Bespoke Technologies, Inc. in Chantilly, VA seeks a Software Engineer (Developer, OpenSearch) to design, develop, and deploy scalable data platform software in a mission-critical AWS environment.

The role requires hands-on OpenSearch expertise, cloud tooling, and API development, working closely with data scientists and engineers. The candidate will implement indexing strategies, optimize queries, and maintain the OpenSearch data layer while delivering robust, testable software in an agile team.

Qualifications

• Hands-on experience with Python, Git, and unit testing frameworks.
• Hands-on experience building APIs and services using REST.
• Hands-on experience with OpenSearch or Elasticsearch.
• Hands-on experience with AWS CDK 1/2 or Terraform.
• Experience applying OO design principles to architect scalable, production software using AWS services such as EC2, S3, IAM, and VPC.

Responsibilities

• Collaborate to write cloud-based applications and tools; evaluate new technologies to improve performance.
• Design, develop, test, debug, and deploy software to parse raw data for analysis.
• Work with data scientists, analysts, PMs, and engineers to deliver solutions.
• Deploy software into an AWS-based data ingest pipeline.
• Write code interfacing with multiple data types and store data into S3 queried by Athena or OpenSearch.
• Drive OpenSearch architecture, indexing, and query optimization.
• Troubleshoot complex issues and support mission areas for software systems.
• Maintain documentation and contribute to process improvements.
• Work with the team to advance organizational capabilities.

Skills

Python

Git

REST APIs

OpenSearch

Elasticsearch

Education

Bachelor's degree in CS/IT or related

Tools

OpenSearch

AWS CDK

Terraform

AWS services (EC2, S3, IAM, VPC)

Job description

Software Engineer (Developer, OpenSearch)

Chantilly, VA - Full Time

BT-391 - Software Engineer (Developer, OpenSearch)
Location: Chantilly, VA (fully on-site, no remote option)

BT-391 - Software Engineer (Developer, OpenSearch)
Location: Chantilly, VA (fully on-site, no remote option)

**Please do NOT apply if you do not have an active Poly clearance. Those without a Poly will not be considered.**

Job Description
The Software Engineer will design, develop, code, test, and debug complex software products to be deployed in a mission critical environment. The ideal candidate is a hands-on developer with significant experience in scalable data platforms, cloud-based services, and big data analytics, and OpenSearch or Elasticsearch. They must have strong, firsthand technical expertise in a variety of data ingestion/computation technologies and the proven ability to fashion robust scalable solutions that can manage large data sets. They must be at ease working in an agile environment with a cross-functional team. This person should embody a passion for innovation and continuous improvement.

Key Responsibilities:

• Work with a team to write new cloud-based applications and tools and recommend new technologies and methodologies to improve system performance and usability.
• Design, develop, test, debug, and deploy new software tools that extend or replace existing capabilities to parse raw data for analysis.
• Collaborate cross-functionally with data scientists, analysts, project managers and other engineers and technical SMEs.
• Deploy new software into an AWS-based data ingest pipeline.
• Write software that interacts with multiple data types and stores data into S3 buckets that is queried by processes running Athena or OpenSearch.
• As an OpenSearch expert, drive the design of indexing strategies, query optimizations, and maintain overall architectural ownership of the OpenSearch data layer.
• Troubleshoot complex problems and provide support to mission areas for software systems and application issues.
• Maintain good documentation for new software written and new procedures to be followed.
• Provide recommendations for continuous improvement.
• Work alongside other engineers on the team to sustain and advance our organization’s capabilities.

Required Qualifications:

• Demonstrated hands-on experience with Python, Git, and unit testing frameworks.
• Demonstrated hands-on experience with building APIs and services using REST.
• Demonstrated hands-on experience with OpenSearch or Elasticsearch.
• Demonstrated hands-on experience with AWS CDK 1 and/or 2 or Terraform.
• Demonstrated hands-on experience applying object-oriented design principles and patterns to architect scalable, maintainable, and testable software systems in production environments. Demonstrated hands-on experience designing and developing applications using core AWS services, including EC2, S3, IAM, and VPC

Desired Qualifications:

• Demonstrated hands-on experience building event-driven or serverless architectures using AWS services such as Lambda, API Gateway, and SQS or SNS
• Demonstrated hands-on experience implementing data pipelines or analytics workflows using AWS-native services (Glue, Athena, EMR, S3)
• Demonstrated experience optimizing AWS costs using best practices such as right-sizing, storage tiering, and workload-aware architecture decisions.
• Demonstrated hands-on experience with PRESTO, Trino, or Apache Spark
• Demonstrated hands-on experience with reverse proxy solutions e.g NGINX
• Demonstrated hands on experience working with DynamoDB, RDS, or HIVE.
• Demonstrated hands-on experience with Parquet and/or ORC file formats.
• Demonstrated hands-on experience working with Hadoop, Apache Spark and their related ecosystems.
• Demonstrated hands-on experience building and managing ETL pipelines using orchestration frameworks like Dagster, Airflow, or NiFi.
• Demonstrated hands-on DevOps experience to include creation and deployment of container-based applications
• Demonstrated hands-on experience working with cloud formation for automation.
• Demonstrated hands-on experience building and deploying software within a CI/CD pipeline.
• Demonstrated hands-on experience with Linux-based systems and shell scripting.

Education and Experience:

• Bachelor's degree in Computer Science, Information Technology, or other related technical discipline, or equivalent combination of education, technical certifications, training, and work/military experience.