Dataflow Systems Engineer

Columbia Technology Partners, Inc; Annapolis (MD); On-site; USD 120,000 - 180,000; Full time

Job summary

Columbia Technology Partners, Inc is seeking an experienced System Engineer to support dataflow operations across collection systems and backend processing environments. The role emphasizes monitoring system data, optimizing data flows, and troubleshooting anomalies to ensure reliable delivery of DNI and DNR from fielded systems to analysts and partners.

The ideal candidate has extensive Systems Engineering experience and hands-on NiFi dataflow work, collaborating with mission systems,

Qualifications

• 14+ years of Systems Engineering experience required for similar scope and complexity.
• Bachelor's degree in System Engineering, Computer Science, Information Systems, Engineering Science, or Engineering Management; five additional years may substitute for a degree.
• Dataflow experience using NiFi (NiagaraFiles).

Responsibilities

• Monitor dataflow from the collection segment (CS) for accuracy and formatting.
• Develop scripts to optimize data flows to and from CS.
• Troubleshoot anomalies to support efficient system operations.
• Interface with dataflow teams to maintain backend processing operations.
• Support deployments, upgrades, and decommissioning of systems for DNI/DNR delivery.
• Support DNI and DNR data delivery to analysts and partners.
• Analyze dataflow reports to monitor health of mission system dataflows.
• Maintain knowledge of deployed mission systems to support data storage and processing.

Skills

14+ years of Systems Engineering

Education

Bachelor's degree in System Engineering, Computer Science, Information Systems, Engineering Science, Engineering Management

Tools

NiFi (NiagaraFiles)

Job description

Description

CTP is seeking an experienced System Engineer to support dataflow operations across collection systems and backend processing environments. This role focuses on monitoring system data, optimizing data flows, troubleshooting anomalies, and supporting the delivery of DNI and DNR from fielded systems to analysts, stakeholders, and partners.

The ideal candidate brings extensive Systems Engineering experience along with hands‑on dataflow experience using NiFi (NiagaraFiles). You'll work across operational mission systems, collection segments, backend processing, and capabilities teams to maintain efficient and reliable data movement throughout the environment.

Key Responsibilities

• Monitor system data received from the collection segment (CS) and review collected data for accuracy and formatting.
• Develop scripts and perform other activities to optimize data flows to and from the collection segment.
• Proactively review historical dataflow statistics and troubleshoot anomalies to support efficient system operations.
• Interface directly with corporate dataflow teams to maintain backend processing operations and support corporate requirements.
• Provide dataflow support to Capabilities teams during the deployment, upgrade, and decommissioning of operational systems.
• Support HCSO operations in delivering DNI and DNR from tasked field systems to analysts, stakeholders, and partners throughout the enterprise.
• Analyze dataflow reports and statistics to maintain awareness of the health of HCSO operational mission system collection capabilities.
• Maintain working knowledge of deployed HCSO operational mission systems to support backend processing and proper data storage.

Qualifications

• 14+ years of Systems Engineering experience supporting programs or contracts of similar scope, type, and complexity.
• Bachelor's degree in System Engineering, Computer Science, Information Systems, Engineering Science, Engineering Management, or a related discipline from an accredited college or university; Five additional years of Systems Engineering experience may be substituted for a bachelor's degree.
• Dataflow experience using NiFi (NiagaraFiles).

Desired Skills

• Experience monitoring and troubleshooting operational system dataflows.
• Experience analyzing dataflow reports, statistics, and system anomalies.
• Experience supporting DNI and DNR data delivery.
• Experience supporting backend processing and operational mission systems.
• Experience supporting system deployments, upgrades, and decommissioning activities.

Why Join CTP

At CTP, you'll have the opportunity to support mission-focused systems where reliable dataflow is critical to operational success. You'll work across collection systems, backend processing, NiFi-based dataflows, and fielded mission capabilities while collaborating with technical teams to troubleshoot issues and maintain efficient delivery of mission data.

That's why our pay is competitive, our missions are critical, and our benefits
represent what matters most to CTP: Our People.

Requirements

• U.S. Citizenship is required for all applicants. CTP is an equal opportunity employer and abides by applicable employment laws and regulations. All applicants and employees are subject to random drug testing in accordance with Executive Order 12564. Employment is contingent upon successful completion of a security background investigation and polygraph.
• Certification Requirements:
  • DOD 8570 Certification

This position requires an active Security Clearance with appropriate Polygraph.

About us

Founded in 2007, Columbia Technology Partners is a Service-Disabled Veteran Owned Small Business with a specialization in technology and management consulting committed to solving intricate and sensitive technology issues facing corporations and federal agencies. Since its inception, CTP has been instrumental in the technical design, engineering development, operational deployment, and support of key systems. With a proven track record in information security, project management, systems/network engineering, security risk management, vulnerability assessments, and mobile security implementation; our employees have the experience, expertise, and innovative thinking our customers need for results that exceed expectations. CTP staff have worked closely with both government engineers and management to gather mission requirements, develop the architecture to deliver the needed functionality and assess tools available to meet or exceed the needs of the mission.

At Columbia Technology Partners (CTP), we are united in being the best that we can be as individuals, but our core belief is that we can be better together. Together we will take on each mission with an execution process that authentically represents who we are. Our success relies on our team values, the foundation we built around them, and the Partners we become along the way.

Salary Range Transparency

At Columbia Technology Partners we are committed to transparency and fairness in our compensation practices. We believe in creating a work environment where employees feel valued, empowered, and rewarded for their contributions.

How We Determine Salary Ranges

Our salary ranges are based on the following key factors:

• Job Role and Responsibilities: The specific duties and responsibilities associated with each role form the foundation of our compensation structure.
• Market Research and Industry Benchmarks: We conduct regular analysis of market trends and salaries across our industry, using reliable compensation data to ensure we stay competitive.
• Experience and Qualifications: An individual's experience, education, certifications, and specialized skills all contribute to determining their position within a salary range.
• Location: Salary ranges may be adjusted based on geographic cost of living, in accordance with local and national standards.
• Company Performance: Our compensation practices also take into account overall company performance and financial health, ensuring that we maintain sustainability while rewarding our team.

Really good benefits, for really GREAT people

• Medical: CTP offers 3 superior plans, bringing our employees both in-network and out-of-network options.
• Vision + Dental: Both free to you + paid in full by CTP.
• Retirement: 401k - 6% company contribution
• PTO + Leave: A work life balance is extremely important to our team here at CTP, which is why our paid time off plans are so lucrative. Offering customizable leave plans to meet your needs is just one of our many perks! Jury Duty, Bereavement + Military Leave provided.
• Career Growth: Up to $10,000 provided for approved career-related learning, training, education, and/or tuition.
• Life and AD&D Insurance/Short-Term & Long-Term Disability: More peace of mind, at zero cost to you.
• Profit Sharing Bonus: End of year cash gets added to your bottom-line.
• Referral Bonus Program: Our tiered program provides an incentive with each stage of the hiring process your referral passes. Our bonuses range from $7,000-$20,000, if your referral joins the team.

Columbia Technology Partners is an Equal Opportunity Employer. We consider applicants without regard to race, color, religion, age, national origin, ancestry, ethnicity, gender, gender identity, gender expression, sexual orientation, marital status, veteran status, disability, genetic information, citizenship status, or membership in any other group protected by federal, state, or local law. Our EEO policy reflects our commitment to ensure equality and promote diversity and inclusion in the workplace. Our policy applies to all employees, job candidates, contractors, stakeholders, partners, and visitors.

CTP was voted one of the top 25 best places to work in Baltimore by Baltimore Magazine!