ETL Developer

Leidos; United States; On-site; USD 87,100 - 157,450; Full time

Benefits offered by this job

Paid Time Off

401K with company match

Flexible schedules

Education and training support

Job summary

Leidos is hiring an ETL Developer for its Intel Security Sector to design and implement ETL solutions centered around Apache NiFi. The role involves creating data pipelines, optimizing performance, and integrating with cloud platforms.

Candidates should have strong programming skills in Java or Python, experience with cloud services, and an active TS/SCI security clearance. Leidos offers competitive benefits including Paid Time Off and 401K matching.

Qualifications

• Experience designing, developing NiFi data flow solutions.
• Proficiency in Java and/or Python, with scripting skills.
• Experience with relational and NoSQL databases.
• Ability to analyze complex data challenges effectively.
• Active TS/SCI security clearance required.

Responsibilities

• Develop and implement enterprise-level ETL NiFi data pipelines.
• Optimize NiFi data flows for performance and scalability.
• Integrate NiFi with big data and cloud technologies.
• Create comprehensive documentation for data flows.
• Collaborate with data architects and service developers.

Skills

NiFi data flow solutions

Java programming

Python scripting

Cloud platforms (AWS, Azure, OCI)

APIs (REST)

Data analysis

Education

Bachelor’s degree or equivalent experience

Tools

Apache NiFi

Kafka

Postgres

Elasticsearch

DynamoDB

Job description

Description

Leidos has an exciting opportunity for an ETL Developer in our Intel Security Sector's Analysis Solutions Business Area. Our team is at the forefront in Security Engineering, Computer Network Operations (CNO), Mission Software, Analytical Methods and Modeling, Signals Intelligence (SIGINT), and Cryptographic Key Management. Leidos offers competitive benefits including Paid Time Off, holidays, 401K with a company match and immediate vesting, Flexible Schedules, Discounted Stock Purchase Plans, Technical Upskilling, Education and Training Support, Parental Paid Leave, and more. Join us and make a difference in National Security!

Job Description

We have an IMMEDIATE NEED for an ETL Developer to play a pivotal role in shaping and implementing cutting-edge data flow solutions centered around Apache NiFi. The candidate will provide technical expertise and support in the design, development, implementation and testing of customer tools and applications in support of Extracting, Transforming and Loading (ETL) of data into an enterprise Data Lake. The candidate will follow architectural best practices and optimize performance in large-scale environments, ensuring the delivery of robust, scalable, and secure data flow solutions that drive critical customer needs. Working within a DevOps framework, the ETL Developer participates in the delivery of major projects through all aspects of the software development lifecycle.

Primary Responsibilities

• Building complex NiFi data pipeline design: Develop and implement enterprise-level ETL NiFi data pipelines for large-scale data ingestion, transformation, and processing from diverse sources.
• Performance optimization and tuning: Optimize NiFi data flows, including processor tuning, memory management, and load balancing, ensuring optimal performance for batch and real-time processing.
• Troubleshooting and problem resolution: Identify, diagnose, and resolve complex NiFi data flow issues, including performance bottlenecks, data discrepancies, and integration failures.
• Integrating with big data and cloud technologies: Seamlessly integrate NiFi with various databases, big data ecosystems, and cloud platforms (e.g., AWS, OCI, Azure), demonstrating familiarity with services such as Kafka, Elasticsearch, S3, SQS/SNS.
• Follow best practices and standards: Follow established best practices for NiFi development, deployment, security, and governance, ensuring adherence to enterprise-wide data management policies.
• Documentation and knowledge sharing: Create and maintain comprehensive documentation for NiFi data flows, mappings, architectures, and standard operating procedures, ensuring knowledge transfer and efficient team operations.
• Collaboration and communication: Collaborate effectively with data architects, data engineers, application/service developers, and other stakeholders to translate business requirements into robust technical solutions.

Basic Qualifications

• Direct experience designing, developing, and managing complex NiFi data flow solutions in large-scale enterprise environments.
• Experience in programming languages like Java and/or Python and scripting for automation.
• Experience writing and optimizing complex queries, and interacting with relational and NoSQL databases (e.g., Postgres, Elasticsearch, DynamoDB).
• Experience with real-time streaming and API integration (REST) for seamless data connectivity.
• Experience with cloud platforms like AWS, Azure, or OCI and related data services.
• Ability to analyze complex data challenges, identify root causes, and implement effective solutions.
• Ability to collaborate effectively with cross-functional teams and articulate technical concepts clearly.
• Bachelor’s degree with 4 or more years of prior relevant experience or Master’s degree with 2 or more years of relevant experience. Will consider experience in lieu of a degree.
• Active TS/SCI with polygraph security clearance is required.

Preferred Qualifications

• Experience deploying ETL solutions in an AWS environment.
• Experience developing custom NiFi processors with Java and/or Python.
• Knowledge of NiFi architecture, processors, and configurations, along with hands-on experience with NiFi Registry and clustering for high availability and scalability.

Security and Compliance

For U.S. positions: Leidos reasonably anticipates the job requisition will remain open for at least 3 days with an anticipated close date as listed above. All qualified applicants will receive consideration for employment without regard to sex, race, ethnicity, age, national origin, citizenship, religion, physical or mental disability, medical condition, genetic information, pregnancy, family structure, marital status, ancestry, domestic partner status, sexual orientation, gender identity or expression, veteran or military status, or any other basis prohibited by law. Leidos will also consider qualified applicants with criminal histories consistent with relevant laws.

Pay Range and Benefits

Pay Range: $87,100.00 - $157,450.00. The Leidos pay range for this job level is a general guideline and not a guarantee of compensation. Additional factors considered include responsibilities, education, experience, knowledge, skills and abilities, internal equity, market data, applicable bargaining agreement, or other law. Pay and benefits include competitive compensation, Health and Wellness programs, Paid Leave, and Retirement. More details are available at www.leidos.com/careers/pay-benefits.