ETL Developer - TS/SCI with Polygraph

Orchard LLC; McLean (VA); On-site; USD 200,000 - 250,000; Full time

Job summary

Orchard LLC is seeking an experienced ETL Developer to design, build, and optimize data pipelines in a geospatial context. You will develop and maintain NiFi workflows, integrate with AWS and PostgreSQL, and ensure data quality and performance for a geospatial visualization platform. The role requires a TS/SCI clearance with polygraph, U.S.

citizenship, and onsite work in McLean, VA. Strong SQL, Python, and API experience are essential, along with familiarity with containerized environments and

Qualifications

• Bachelor's degree with 8+ years of relevant experience, OR Master's with 7+ years, OR Doctorate with 6+ years
• Active TS/SCI clearance with required polygraph
• U.S. Citizenship required
• Willingness to work onsite full-time
• Willingness to develop NiFi flows using existing best practices
• Strong understanding of ETL concepts and best practices
• Strong experience with databases for data management
• Proficiency in SQL for querying large datasets
• Experience with API integration and data retrieval
• Demonstrated experience with programmatic data manipulation
• Ability to rapidly adopt containerized development proficiency
• Ability to rapidly adopt AWS architecture proficiency
• Ability to rapidly adopt NiFi registry and Git for code management

Responsibilities

• Design, develop and manage ETL workflows using Apache NiFi
• Learn NiFi system nuances and AWS/PostgreSQL infra to monitor issues
• Understand existing NiFi flows with minimal support
• Develop new NiFi flows following best practices
• Incorporate feedback and implement changes
• Communicate status via ticketing system
• Interface with analysts to map data flow needs
• Work with containerized development and Git version control
• Gain competency in geospatial DB design and indexing

Skills

ETL development

NiFi

SQL

Python

AWS

PostgreSQL

Geospatial data

API integration

Git

Education

Bachelor's degree in CS / Systems Eng / Geography or related

8+ years experience OR 7+ with Master's OR 6+ with Doctorate

Tools

NiFi

NiFi Registry

Git

Airflow

AWS

PostgreSQL

Job description

ETL Developer - TS/SCI and polygraph Onsite - McLean, VA TS/SCI and poly required@Orchard is retained by a top geospatial technology company in their search for an ETL Developer to work in their Intel sector advancing the national security mission through cutting edge technology. For this role, you must have a passion for keeping pace with rapidly evolving technology advancements and leveraging your knowledge on a highly collaborative team to deliver state-of-the-art capabilities. We are seeking an experienced ETL Developer to provide onsite support for a geospatial visualization platform. This role focuses on developing, maintaining, and optimizing data pipelines to ensure reliable data flow into a PostgreSQL database. The ideal candidate will have strong experience in ETL processes, data integration, and working with large, complex datasets, including geospatial data.

Key Responsibilities:

• Design, develop and manage ETL workflows using Apache NiFi to support a geospatial visualization platform
• Learn the nuances of the existing NiFi system and the related AWS and PostgreSQL infrastructure in order to monitor and troubleshoot real time issues
• Obtain an understanding of existing NiFi flows with minimal support from others
• Develop new NiFi flows that adopt best practices of existing NiFi flows
• Take feedback on NiFi flows and develop requested changes
• Take direction and communicate status via a ticketing system
• Interface with analysts via email, chat, and in person meetings to comprehend future data flow needs and refine general requirements into specific actions
• Interface with a development cycle using a local development environment of containerized infrastructure and version control via Git and NiFi Registry
• Gain competency in geospatial database design and employ best practices for table creation, indexing, and unique constraints
• Take feedback from analysts on nuances to support application data layers
• Programmatically manipulate and transform data from multiple sources
• Query and analyze large datasets using SQL
• Retrieve and process data from external systems via APIs
• Support data quality, integrity, and performance optimization efforts
• Understand Python and data science frameworks while differentiating between experimental prototypes and enterprise level software requirements
• Develop Python in support of data science related efforts or ETL prototypes.

Skills & Qualifications

• Experience: Bachelor's degree with 8+ years of relevant experience, OR Master's degree with 7+ years of experience, OR Doctorate with 6+ years of experience
• Degree in Computer Science, Systems Engineering, Geography, or a related technical field
• Active TS/SCI clearance with required polygraph
• U.S. Citizenship required
• Willingness to work onsite full-time
• Willingness to develop NiFi flows using existing best practices
• Strong understanding of ETL concepts and best practices
• Strong experience with databases for data management
• Proficiency in SQL for querying large datasets
• Experience with API integration and data retrieval
• Demonstrated experience with programmatic data manipulation
• Competency to rapidly adopt containerized development proficiency
• Competency to rapidly adopt AWS architecture proficiency
• Competency to rapidly adopt NiFi registry and Git for code management

Preferred Qualifications:

• Creativity to experiment and recommend best practice coding improvements
• Drive to adopt and recommend AI into development processes
• Ability to design and develop custom NiFi processors using Java
• Experience with AWS cloud services for data ingestion and processing
• Strong experience with PostgreSQL for data management
• Hands-on experience with Apache Airflow
• Hands-on experience with Apache NiFi
• Hands-on experience with NiFi registry and Git
• Hands-on experience with Git and repository actions and pull requests
• Hands-on experience in Python for data manipulation and API interfacing
• Experience working with geospatial data and related tool
• Understanding of basic data science concepts and tools

For pay transparency, this role will fall in the $200K- $250K range, based on experience.