NiFi Platform Engineer

Shield Consulting Solutions, Inc.; Linthicum (MD); On-site; USD 225,000 - 235,000; Full time

Benefits offered by this job

25 days PTO

100% employer-paid healthcare

8% 401(k) employer match

Job summary

Shield Consulting Solutions, Inc. in Maryland is seeking an experienced professional for automation and data integration through Apache NiFi. The role involves optimizing data pipelines and managing NiFi in cloud environments.

Candidates must have a Bachelor's degree in a technical field, active TS/SCI clearance, and at least 8 years of professional experience. Benefits include a competitive salary, 25 days of PTO, and comprehensive healthcare coverage from day one.

Qualifications

• Active TS/SCI w/Polygraph clearance required.
• 8 years of applicable professional experience.
• Proficiency in scripting languages like Python, Groovy, or Bash.

Responsibilities

• Integrate data with tools such as S3, MongoDB, Spark, and Elasticsearch.
• Design, implement, and troubleshoot dataflows using Apache NiFi.
• Deploy and manage NiFi in cloud environments like AWS and Azure.

Skills

Linux system administration

Apache NiFi

Docker

Terraform

Data integration and big data tools

Education

Bachelor's degree in a technical field

Tools

Amazon S3

MongoDB

Apache Spark

Elasticsearch

JIRA

Job description

Active TS/SCI w/Polygraph REQUIRED - Please do not apply if you do not currently possess this level of clearance.

Telework: None

Basic Requirements

• Bachelor's degree in a technical field.
• 8 years of applicable professional experience.

Job Description

As part of the Secure the Enterprise initiative, develop capabilities to shift from the current manual system security evaluation and authorization process to a new model that emphasizes automation, streamlined processes and approvals, continuous monitoring and assessment, and network data gathering across the entire life cycle of a project.

Responsibilities

• Integrate data with tools such as Amazon S3, MongoDB, Apache Spark, and Elasticsearch, ensuring seamless data movement and processing.
• Optimize NiFi cluster architecture, performance tuning, and strategize data pipelines.
• Design, implement, and troubleshoot dataflows using Apache NiFi, including working with processors, connections, and templates.
• Deploy and manage NiFi in cloud environments (e.g., AWS, Azure, GCP) and use cloud-native tools for data processing.
• Facilitate infrastructure management, continuous integration, environment configuration and deployment as well as support the project’s compliance and security posture.
• Focus on delivering the automation that enables all other teams to operate smoothly.
• Track work through JIRA workflows.

Required Experience

• Linux system administration (CentOS7, RedHat8)
• Experience with administering a NiFi cluster
• Experience with Docker
• Experience with Terraform code
• Configuring, deploying, and administrating NiFi and associated NiFi flows
• Proficiency in Apache NiFi: hands-on experience designing, implementing, and troubleshooting dataflows using Apache NiFi, including working with processors, connections, and templates.
• Expertise in NiFi Expression Language: strong understanding of leveraging NiFi Expression Language to create dynamic and efficient dataflows.
• Data Integration and Big Data Tools: experience integrating data with tools such as Amazon S3, MongoDB, Apache Spark, and Elasticsearch, ensuring seamless data movement and processing.
• Performance Optimization: knowledge of NiFi cluster architecture, performance tuning, and strategies for optimizing high-throughput data pipelines.
• Cloud Integration: expertise in deploying and managing NiFi in cloud environments (e.g., AWS, Azure, GCP) and using cloud-native tools for data processing.
• Scripting and Automation: proficiency in scripting languages like Python, Groovy, or Bash to extend NiFi capabilities and automate workflows.

Desired Experience

• Cloud hosting and automation
• Experience working in an Agile environment

Salary: $225,000 - $235,000 annually

Excellent benefits package including 25 days PTO, 11 paid holidays, 100% employer-paid healthcare for employees and dependents - available day 1, 8% 401(k) employer match - immediate vesting.

Disclaimer: The salary range provided is an estimate based on current market conditions and may be adjusted based on factors such as experience, skills, and qualifications. The final salary offer will be determined after a thorough review of the candidate's background and alignment with the role. Please note that this range is subject to change and should be considered as a guideline rather than a definitive figure.

Shield Consulting Solutions is an equal opportunity/affirmative action employer. All qualified applicants will receive consideration for employment without regard to sex, gender identity, sexual orientation, race, color, religion, national origin, disability, protected veteran status, age, or any other characteristic protected by law.

This is a full time position