ETL Data Engineer (Onsite)

Socket.dev; Washington (District of Columbia); On-site; USD 110,000 - 150,000; Full time

Job summary

NFF seeks an experienced ETL Data Engineer to support the Enterprise Data team with data curation, processing, and transformation tasks. You will design and implement end-to-end data pipelines, leverage Azure Data Factory, Synapse, Databricks, and Informatica, and ensure data quality and governance across cloud and on-prem systems.

The role requires strong SQL, Python, and BI tooling experience, with a focus on scalable data solutions for government and enterprise clients.

Qualifications

• Bachelor’s degree or equivalent in IT or related field.
• 15 Years Strong knowledge of ETL processes and end-to-end pipelines.
• 15 Years Ability to document data extraction, transformation and load requirements.
• 15 Years Understanding of data warehousing, data lake, BI concepts.
• 15 Years Ability to advise on tools for complex data processing challenges.
• 15 Years Knowledge of SQL for relational databases.
• 11 Years Experience with Oracle, SQL, Postgres, DB2, CSV/XML/Parquet/AVRO formats.
• 7 Years Azure tools such as ADF, Synapse, SQL DB, Data Lake Gen2, Blob Storage.
• 5 Years Experience with Informatica PowerCenter, NiFi, Airflow and FME.
• 5 Years Visualization/Reporting tools: MicroStrategy, Tableau, Esri ArcGIS.

Responsibilities

• Analyzes, designs, develops, implements, replicates, and supports complex enterprise data projects.
• Interfaces with other agencies, consults with user departments on system requirements, advises on environment constraints and cloud solutions.
• Establishes cloud and on-prem connectivity in systems like ADLS, ADF, Synapse, Databricks.
• Hands-on experience with Azure services and Python for data processing.
• Creates end-to-end pipelines to load data from multiple sources into landing layers or SQL tables.
• Familiarity with data integration tools (Informatica, Synapse, NiFi, Airflow).
• Handles various data formats including Oracle, SQL Server, Postgres, DB2, CSV, XML, Parquet, AVRO.
• Develops, standardizes and optimizes data workflows and adheres to governance standards.
• Automates, monitors, and manages data pipelines and processes.
• Prepares reports and dashboards using BI tools.

Skills

ETL development

SQL proficiency

Azure data services

Python scripting

Data governance

Data warehousing

Data pipelines

Databricks

Education

Bachelor's degree in Information Technology or related field

Tools

Azure Data Factory

Azure Synapse

SQL Database

Azure Data Lake Storage Gen2

Blob Storage

Informatica PowerCenter

Apache NiFi

Apache Airflow

FME

Databricks

MicroStrategy

Tableau

Esri ArcGIS

Job description

About NFF

Since 1996, Networking For Future, Inc. (NFF) has been engineering the backbone of mission-critical systems for government and enterprise clients. With headquarters in Washington, DC, we provide expert technology consulting and design-build solutions that solve complex challenges and deliver measurable real-world results.

NFF is an ISO 27001:2022 and ISO 9001:2015 certified company. Our expertise includes solutions for Artificial Intelligence Enablement, Data Center & cloud, Intelligent Networks, Secure, Connected IoT Technologies, Professional and Managed Services, Workforce Solutions and Zero Trust Strategies.NFF leverages a strategic portfolio of over 200 industry-leading technology brands to deliver precisely tailored solutions that align with each client's unique requirements and mission objectives.

NFF is a Cisco Gold Integrator Partner, Splunk Partner, Arista Partner, Cohesity Partner, Apptega Partner, NetApp Gold Partner, VMware Enterprise Partner, Alloterra Labs Partner, Axis Communications Partner, Asimily Partner, Signify Partner, Rapid7 Partner, Foresite Partner, Arctic Wolf Partner, Microsoft Certified Silver Partner, and Dell Solution Provider Partner.

NFF also holds GSA Schedule 47QTCA21D0047 and many other government contract vehicles.

About this Position / Responsibilities

NFF,Inc. is seeking an expirienced ETL data engineer will support the Enterprise Data team for data curation, processing, and transformation tasks. Specifically, the ETL data engineer will be responsible for the following tasks:Responsibilities:

• Analyzes, designs, develops, implements, replicates, and supports complex enterprise data projects.
• Interfaces with other agencies, consult with and inform user departments on system requirements, advise on environment constraints and operating difficulties for the current state and advise and resolve problems using cloud solutions and develop and replicate future enhancements to District’s data systems.
• Strong knowledge of Extraction, Transformation and Loading (ETL) processes using frameworks like Azure Data Factory, Synapse, Databricks, Informatica by gathering requirements from the stake holders or analyzing the existing code and perform enhancements or new development.
• Establishing the cloud and on-premise connectivity in different systems like ADLS, ADF, Synapse, Databricks
• Hands on experience in Azure cloud services like Azure Data Factory or Azure Synapse, MSSQL Db, Azure SQL DB, Azure Data Lake Storage Gen2, Blob Storage, Python etc.
• Worked on creating end to end pipelines to load data by reading it from multiple sources or source systems and load to landing layer or SQL tables.
• Familiarity/experience with data integration and data pipeline tools (e.g., Informatica, Synapse, Apache NiFi, Apache Airflow)
• Familiarity/experience with various data formats including database specific (Oracle, SQL Server, DB2, Quickbase), text formats(CSV, XML) and Binary(Parquet, AVRO)
• Develops, standardizes and optimizes existing data workflow/pipelines adhering to best practices.
• Adhere and contribute to enterprise data governance standards by ensuring data accuracy, consistency, security, and reliability.
• Automates, monitors, alerts, and manages data pipelines and workflows.
• Analyzes and evaluates system changes to determine feasibility, provides alternative solutions, back-up, and rollback procedures.
• Works on the development of new systems, upgrades and enhancements to existing systems and ensure systems follow approved standards and consistency after the changes.
• Develops complex programs and reports in database query language.
• Familiarity/experience with data visualization tools.
• Familiarity/experience handling and securing sensitive data based on the level of the sensitivity

Qualifications

• Bachelor’s degree in Information Technology or related field or equivalent experience
• Required 15 Years Strong knowledge for development of Extract-Transform-Load (ETL) processes, including end-to-end pipelines with data loading from multiple sources
• Required 15 Years Ability to gather and document requirements for data extraction, transformation and load processes
• Required 15 Years Understanding of data warehousing, data lake, business intelligence and information management concepts and standards.
• Required 15 Years Ability to advise internal and external customers on appropriate tools and systems for complex data processing challenges.
• Required 15 Years Knowledge and use of SQL for relational databases
• Required 11 Years Experience with various data formats including database specific (Oracle, SQL, Postgres, DB2), text formats (CSV, XML) and Binary (Parquet, AVRO)
• Required 11 Years Contribute to enterprise data governance standards by ensuring accuracy, consistency, security and reliability
• Required 7 Years Strong experience with Microsoft Azure tools such as Azure Data Factory, Synapse, SQL Database, Data Lake Storage Gen2, Blob Storage Required 5 Years Experience with data integration and data pipeline tools such as Informatica PowerCenter, Apache NiFi, Apache Airflow and FME
• Required 5 Years Experience with visualization and reporting software such as MicroStrategy, Tableau, and Esri ArcGIS
• Highly desired 3 Years Strong communication skills, both oral and written
• Required 3 Years Ability to provide excellent customer service to external partners
• Required 3 Years Ability to work independently or as part of a larger team
• Highly desired 3 Years Experience performing data functions with Databricks

NFF Disclosures

NFF offers a competitive salary, comprehensive benefits and flexible paid time off options, for eligible employees:

• Medical, Dental and Vision, Health Savings Account, Flexible Spending Account
• STD, LTD, Supplemental life insurance and ADD&D
• Comprehensive 401k plan
• Paid Time Off

NFF is an Equal Opportunity Employer.