Dataflow Systems Engineer
Columbia Technology Partners
A complete application in a minute
Tailored resume and cover letter, ready to send.
Benefits offered by this job
Job summary
Columbia Technology Partners, Inc. is seeking an experienced System Engineer to support dataflow operations across collection systems and backend processing environments using NiFi.
You will monitor data, optimize flows, troubleshoot anomalies, and assist in delivering DNI and DNR to analysts and partners. The ideal candidate has 14+ years of Systems Engineering experience on complex programs, a related Bachelor's degree, and hands-on NiFi expertise to maintain efficient data movement across
Qualifications
- 14+ years of Systems Engineering experience on programs of similar scope and complexity.
- Bachelor's degree or higher in a related field; five additional years may substitute for a degree.
- Dataflow experience using NiFi (NiagaraFiles).
Responsibilities
- Monitor system data from the collection segment and review data for accuracy.
- Develop scripts to optimize data flows to and from the collection segment.
- Troubleshoot anomalies to support efficient system operations.
- Interface with dataflow teams to maintain backend processing operations.
- Support deployments and decommissioning of operational systems.
- Assist in delivering DNI and DNR to analysts and partners.
- Analyze dataflow reports to monitor health of mission system collection capabilities.
- Maintain knowledge of deployed systems to support data storage and processing.
Skills
Education
Tools
Job description
CTP is seeking an experienced System Engineer to support dataflow operations across collection systems and backend processing environments. This role focuses on monitoring system data, optimizing data flows, troubleshooting anomalies, and supporting the delivery of DNI and DNR from fielded systems to analysts, stakeholders, and partners.
CTP is seeking an experienced System Engineer to support dataflow operations across collection systems and backend processing environments. This role focuses on monitoring system data, optimizing data flows, troubleshooting anomalies, and supporting the delivery of DNI and DNR from fielded systems to analysts, stakeholders, and partners.
The ideal candidate brings extensive Systems Engineering experience along with hands-on dataflow experience using NiFi (NiagaraFiles). You'll work across operational mission systems, collection segments, backend processing, and capabilities teams to maintain efficient and reliable data movement throughout the environment.
- Monitor system data received from the collection segment (CS) and review collected data for accuracy and formatting.
- Develop scripts and perform other activities to optimize data flows to and from the collection segment.
- Proactively review historical dataflow statistics and troubleshoot anomalies to support efficient system operations.
- Interface directly with corporate dataflow teams to maintain backend processing operations and support corporate requirements.
- Provide dataflow support to Capabilities teams during the deployment, upgrade, and decommissioning of operational systems.
- Support HCSO operations in delivering DNI and DNR from tasked field systems to analysts, stakeholders, and partners throughout the enterprise.
- Analyze dataflow reports and statistics to maintain awareness of the health of HCSO operational mission system collection capabilities.
- Maintain working knowledge of deployed HCSO operational mission systems to support backend processing and proper data storage.
- 14+ years of Systems Engineering experience supporting programs or contracts of similar scope, type, and complexity.
- Bachelor's degree in System Engineering, Computer Science, Information Systems, Engineering Science, Engineering Management, or a related discipline from an accredited college or university; Five additional years of Systems Engineering experience may be substituted for a bachelor's degree.
- Dataflow experience using NiFi (NiagaraFiles).
- Experience monitoring and troubleshooting operational system dataflows.
- Experience analyzing dataflow reports, statistics, and system anomalies.
- Experience supporting DNI and DNR data delivery.
- Experience supporting backend processing and operational mission systems.
- Experience supporting system deployments, upgrades, and decommissioning activities.
At CTP, you'll have the opportunity to support mission-focused systems where reliable dataflow is critical to operational success. You'll work across collection systems, backend processing, NiFi-based dataflows, and fielded mission capabilities while collaborating with technical teams to troubleshoot issues and maintain efficient delivery of mission data.
- U.S. Citizenship is required for all applicants. CTP is an equal opportunity employer and abides by applicable employment laws and regulations. All applicants and employees are subject to random drug testing in accordance with Executive Order 12564. Employment is contingent upon successful completion of a security background investigation and polygraph.
- Certification Requirements:
- DOD 8570 Certification
Founded in 2007, Columbia Technology Partners is a Service-Disabled Veteran Owned Small Business with a specialization in technology and management consulting committed to solving intricate and sensitive technology issues facing corporations and federal agencies. Since its inception, CTP has been instrumental in the technical design, engineering development, operational deployment, and support of key systems. With a proven track record in information security, project management, systems/network engineering, security risk management, vulnerability assessments, and mobile security implementation; our employees have the experience, expertise, and innovative thinking our customers need for results that exceed expectations. CTP staff have worked closely with both government engineers and management to gather mission requirements, develop the architecture to deliver the needed functionality and assess tools available to meet or exceed the needs of the mission.
At Columbia Technology Partners (CTP), we are united in being the best that we can be as individuals, but our core belief is that we can be better together. Together we will take on each mission with an execution process that authentically represents who we are. Our success relies on our team values, the foundation we built around them, and the Partners we become along the way.
That's why our pay is competitive, our missions are critical, and our benefits represent what matters most to CTP: Our People.
At Columbia Technology Partners we are committed to transparency and fairness in our compensation practices. We believe in creating a work environment where employees feel valued, empowered, and rewarded for their contributions.
- Job Role and Responsibilities: The specific duties and responsibilities associated with each role form the foundation of our compensation structure.
- Market Research and Industry Benchmarks: We conduct regular analysis of market trends and salaries across our industry, using reliable compensation data to ensure we stay competitive.
- Experience and Qualifications: An individual's experience, education, certifications, and specialized skills all contribute to determining their position within a salary range.
- Location: Salary ranges may be adjusted based on geographic cost of living, in accordance with local and national standards.
- Company Performance: Our compensation practices also take into account overall company performance and financial health, ensuring that we maintain sustainability while rewarding our team.
From our CTP Family to yours, we know how important these decisions are. Your benefits are about you, not us. Tell us what you need in order to see a future at CTP; let's get where you're going, together.
CTP offers 3 superior plans, bringing our employees both in-network and out-of-network options.
Both free to you + paid in full by CTP.
401k - 6% company contribution
A work life balance is extremely important to our team here at CTP, which is why our paid time off plans are so lucrative. Offering customizable leave plans to meet your needs is just one of our many perks! Jury Duty, Bereavement + Military Leave provided.
Up to $10,000 provided for approved career-related learning, training, education, and/or tuition.
More peace of mind, at zero cost to you.
End of year cash gets added to your bottom-line.
Our tiered program provides an incentive with each stage of the hiring process your referral passes. Our bonuses range from $7,000-$20,000, if your referral joins the team.
Columbia Technology Partners is an Equal Opportunity Employer. We consider applicants without regard to race, color, religion, age, national origin, ancestry, ethnicity, gender, gender identity, gender expression, sexual orientation, marital status, veteran status, disability, genetic information, citizenship status, or membership in any other group protected by federal, state, or local law. Our EEO policy reflects our commitment to ensure equality and promote diversity and inclusion in the workplace. Our policy applies to all employees, job candidates, contractors, stakeholders, partners, and visitors.
CTP was voted one of the top 25 best places to work in Baltimore by Baltimore Magazine!
Salary: $135000.00 - $155000.00 per year
'/%3e%3cpath%20d='M101.744%2012.4726L102.894%2016.1947L99.0021%2013.2201L101.744%2012.4726ZM105.3%208.40937H100.488L99.0026%203.59473L97.5116%208.41047L92.7%208.40385L96.5965%2011.3834L95.1055%2016.1942L99.0021%2013.2196L101.408%2011.3834L105.3%208.40992V8.40937Z'%20fill='white'/%3e%3cdefs%3e%3clinearGradient%20id='paint0_linear_5593_1381'%20x1='90'%20y1='9.44471'%20x2='99'%20y2='9.44471'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%2300AD70'/%3e%3cstop%20offset='0.998594'%20stop-color='%2300B67A'/%3e%3cstop%20offset='1'%20stop-color='%23DCDCE6'/%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e){kind=small}
