Secret/TS Senior Data Engineer

Insight Global (United States)

Roppenheim

Presencial

EUR 109.000 - 163.000

Jornada completa

Hace 11 días

Una candidatura completa en un minuto

Currículum y carta de presentación personalizados, listos para enviar.

Supera los filtros ATS

Descripción de la vacante

Insight Global is seeking an experienced Data Engineer to lead end-to-end data pipelines using Apache NiFi, while building and optimizing ETL/ELT processes for SQL Server data stores. You will design data models, implement advanced SQL, and deploy workloads in Azure cloud, integrating with IIS and WildFly web layers.

The role requires 5–8+ years in data engineering, DoD Secret clearance, and willingness for on-site work in Alexandria, VA.

Formación

  • Active DoD Secret clearance (must be currently held and verifiable).
  • Bachelor’s degree in Computer Science, Information Systems, Engineering, or related field; or equivalent relevant experience.
  • 5–8+ years of experience in data engineering, data integration, or database development, with increasing responsibility.
  • Hands-on experience designing and supporting data flows with Apache NiFi, including processors, controller services, parameter contexts, versioned flows, and secure configurations.
  • Strong proficiency with Microsoft SQL Server, including: Advanced SQL (complex queries, stored procedures, functions, views); performance tuning and optimization (indexes, execution plans, statistics); ETL/ELT development and relational/dimensional data modeling.
  • Experience deploying and supporting workloads in Azure Cloud, such as: Azure Virtual Machines, Virtual Networks, Storage, Key Vault, and related services; understanding of Azure identity and access control (Azure AD, RBAC).
  • Working knowledge of Microsoft IIS and WildFly, and experience integrating web/application tiers with backend databases and data services.
  • Experience with scripting or programming (PowerShell, Python) for automation, integration, and operational tooling.
  • Strong analytical, troubleshooting, and communication skills, with proven ability to operate in a collaborative, mission-focused team.
  • Willingness to support occasional on-site work in Alexandria, VA.
  • Comprehensive benefits package including medical, dental, vision; 401(k) eligibility after 90 days; paid leave as required by law.

Responsabilidades

  • Lead the design, implementation, and maintenance of end-to-end data pipelines using Apache NiFi for ingestion, routing, and transformation of structured and unstructured data.
  • Develop, optimize, and support ETL/ELT processes into Microsoft SQL Server databases, data marts, and operational data stores.
  • Design and maintain logical and physical data models, including indexing and partitioning strategies to support performance, scalability, and availability in SQL Server.
  • Design and develop advanced SQL (procedures, functions, views, and tables) to support application and analytic requirements.
  • Deploy and support data solutions in Azure Cloud, integrating with Azure networking, storage, identity, and security services in accordance with customer policies and best practices.
  • Integrate data services and back-end data sources with applications hosted on Microsoft IIS and WildFly, partnering with application teams to define and implement APIs and data access patterns.
  • Implement data quality, validation, and monitoring within NiFi flows and SQL processes; troubleshoot and resolve data and pipeline issues.
  • Apply and enforce security best practices across NiFi, SQL Server, and Azure (least-privilege access, encryption in transit/at rest, key management, auditing, and logging).
  • Contribute to and mature automation and DevSecOps practices (scripting, infrastructure as code, CI/CD) to streamline deployment and configuration management.
  • Produce and maintain technical documentation, including data flow diagrams, interface specifications, and operational runbooks.
  • Provide mentoring and knowledge transfer to junior team members.
  • Provide operational support for production environments, including troubleshooting, root-cause analysis, performance tuning, and after-hours support as required.
  • Partner with leadership to refine the data modernization roadmap, proposing patterns, standards, and sequencing based on technical insight and mission needs.

Conocimientos

Data engineering
Analytical skills
Troubleshooting
Communication skills
Automation scripting

Educación

Bachelor's degree in CS/IS/Engineering or related field

Herramientas

Apache NiFi
Microsoft SQL Server
Azure Cloud
Microsoft IIS
WildFly
PowerShell
Python
Git/GitLab/Azure DevOps/GitHub
DataStage
Azure Data Factory

Descripción del empleo

Job Description

Responsibilities
  • Lead the design, implementation, and maintenance of end-to-end data pipelines using Apache NiFi for ingestion, routing, and transformation of structured and unstructured data.
  • Develop, optimize, and support ETL/ELT processes into Microsoft SQL Server databases, data marts, and operational data stores.
  • Design and maintain logical and physical data models, including indexing and partitioning strategies to support performance, scalability, and availability in SQL Server.
  • Design and develop advanced SQL (procedures, functions, views, and tables) to support application and analytic requirements.
  • Deploy and support data solutions in Azure Cloud, integrating with Azure networking, storage, identity, and security services in accordance with customer policies and best practices.
  • Integrate data services and back-end data sources with applications hosted on Microsoft IIS and WildFly, partnering with application teams to define and implement APIs and data access patterns.
  • Implement data quality, validation, and monitoring within NiFi flows and SQL processes; proactively identify, troubleshoot, and resolve data and pipeline issues.
  • Apply and enforce security best practices across NiFi, SQL Server, and Azure (least-privilege access, encryption in transit/at rest, key management, auditing, and logging).
  • Contribute to and help mature automation and DevSecOps practices (e.g., scripting, infrastructure as code, CI/CD) to streamline deployment, configuration management, and environment consistency.
  • Produce and maintain technical documentation, including data flow diagrams, interface specifications, and operational runbooks.
  • Provide mentoring and knowledge transfer to junior team members.
  • Provide operational support for production environments, including troubleshooting, root-cause analysis, performance tuning, and participation in after-hours support as required.
  • Partner with leadership to inform and refine the data modernization roadmap, proposing patterns, standards, and sequencing based on technical insight and mission needs.
Skills and Requirements

Required Qualifications

  • Active DoD Secret clearance (must be currently held and verifiable).
  • Bachelor’s degree in Computer Science, Information Systems, Engineering, or related field; or equivalent relevant experience.
  • 5–8+ years of experience in data engineering, data integration, or database development, with increasing responsibility.
  • Demonstrated hands‑on experience designing and supporting data flows with Apache NiFi, including processors, controller services, parameter contexts, versioned flows, and secure configurations.
  • Strong proficiency with Microsoft SQL Server, including:
    • Advanced SQL (complex queries, stored procedures, functions, views)
    • Performance tuning and optimization (indexes, execution plans, statistics)
    • ETL/ELT development and relational/dimensional data modeling
  • Experience deploying and supporting workloads in Azure Cloud, such as:
    • Azure Virtual Machines, Virtual Networks, Storage, Key Vault, and related services
    • Understanding of Azure identity and access control (Azure AD, RBAC)
  • Working knowledge of Microsoft IIS and WildFly, and experience integrating web/application tiers with backend databases and data services.
  • Experience with scripting or programming (e.g., PowerShell, Python) for automation, integration, and operational tooling.
  • Strong analytical, troubleshooting, and communication skills, with proven ability to operate in a collaborative, mission-focused team and interact with both technical and non-technical stakeholders.
  • Willingness and ability to support occasional on-site work in Alexandria, VA.
  • 70-100Hexact compensation may vary based on several factors, including skills, experience, and education.
  • Employees in this role will enjoy a comprehensive benefits package starting on day one ofemployment, including options for medical, dental, and vision insurance. Eligibility to enroll inthe 401(k) retirement plan begins after 90 days of employment. Additionally, employees in thisrole will have access to paid sick leave and other paid time off benefits as required under theapplicable law of the worksite location.
Preferred / Desired Qualifications
  • Experience supporting DoD or Federal customers in enterprise, mission system, or secure cloud environments.
  • Experience with additional Azure data and integration services, such as:
    • Azure SQL Database or Managed Instance
    • Azure Data Factory or Synapse Pipelines
    • Azure Monitor or Log Analytics for observability and diagnostics
  • Experience operating Apache NiFi in clustered, production environments (high availability, load balancing, site-to-site flows, certificates/SSL, secure protocols).
  • Familiarity with RESTful APIs, microservices, and integration patterns between NiFi, IIS-hosted services, and Java applications on WildFly.
  • Experience with enterprise ETL tools, especially IBM DataStage (designing, scheduling, and optimizing jobs for large-scale data integration).
  • Experience with source control and CI/CD (e.g., Git, GitLab, Azure DevOps, GitHub) for managing NiFi flows, DataStage jobs, SQL scripts, and configuration changes.
  • Knowledge of data governance and compliance practices (metadata management, lineage, retention, auditing) in government or regulated environments.
  • Exposure to reporting and BI tools (e.g., Power BI, SSRS) consuming SQL Server datasets.

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances.

Consigue la evaluación confidencial y gratuita de tu currículum.

o arrastra y suelta tu archivo aquí

Similar jobs

Puestos de trabajo similares que vale la pena comparar

Senior Data Engineer: NiFi, SQL & Azure Expert (DoD)
Senior Data Engineer: NiFi, SQL & Azure Expert (DoD)

Insight Global (United States) • Roppenheim

Presencial
EUR 109.000 - 163.000
Data Engineer (Python, NiFi) - TS/SCI Poly
Data Engineer (Python, NiFi) - TS/SCI Poly

Leading Path Consulting • Chantilly

Presencial
EUR 70.000 - 110.000
Medical/dental/vision coverage
Paid time off (PTO)
11 paid holidays
+1
Senior Data Engineer: Scalable Pipelines & APIs
Senior Data Engineer: Scalable Pipelines & APIs

Leading Path Consulting • Chantilly

Presencial
EUR 70.000 - 110.000
Medical/dental/vision coverage
Paid time off (PTO)
11 paid holidays
+1
Staff Data Engineer (Databricks specialist)
Staff Data Engineer (Databricks specialist)

Jobgether • Francia

A distancia
EUR 120.000 - 170.000
Fully remote
Work-life balance
Continuous learning
+3
Secret / TS Cyber Lead – Cloud & RMF
Secret / TS Cyber Lead – Cloud & RMF

Insight Global (United States) • Roppenheim

Presencial
EUR 87.000 - 125.000
Medical, dental, and vision insurance
401(k) plan eligibility after 90 days
Paid sick leave and PTO
Data Engineer - Manager/Specialist
Data Engineer - Manager/Specialist

Publicis Groupe • Paris

Presencial
EUR 110.000 - 170.000
Senior Data Engineer
Senior Data Engineer

Artefact • Paris

Híbrido
GBP 75.000 - 110.000
Hybrid work arrangement
Office days in the week
Sr. Specialist Solutions Architect - Platform Security and Cloud Infrastructure
Sr. Specialist Solutions Architect - Platform Security and Cloud Infrastructure

Databricks Inc. • Francia

Presencial
EUR 120.000 - 160.000
Data Engineer (Azure)
Data Engineer (Azure)

Addepto • Job

Híbrido
PLN 180.000 - 280.000
Remote work
Career development and training
Conferences sponsorship
+4
Data Engineering Manager: Lead Scalable Data Pipelines
Data Engineering Manager: Lead Scalable Data Pipelines

Publicis Groupe • Paris

Presencial
EUR 110.000 - 170.000