10Years ETL Data Engineer- Onsite

Gointellects Inc.; Washington (District of Columbia); On-site; USD 110,000 - 160,000; Full time

Job summary

DC Government is seeking an ETL Data Engineer to design and deliver complex data pipelines. You will work onsite in Washington, DC, interfacing with multiple agencies to gather requirements and implement cloud and on-premise data solutions using Azure Data Factory, Synapse, Databricks, and Informatica.

The role emphasizes governance, security, and reliable data flow across diverse formats. Responsibilities span ETL development, pipeline automation, and collaboration with business and technical

Qualifications

• Bachelor’s degree in Information Technology or related field or equivalent experience.
• 10 years experience with ETL and data integration preferred.
• Strong knowledge of SQL for relational databases and data warehousing concepts.
• Experience with Azure data services (ADF, Synapse) and data governance.
• Proven ability to design, implement, and optimize complex data pipelines.

Responsibilities

• Analyze, design, develop, implement, replicate, and support enterprise data projects.
• Interface with agencies, collect requirements, and advise on system constraints.
• Develop and enhance ETL pipelines using Azure Data Factory, Synapse, Databricks, Informatica.
• Establish cloud and on-prem connectivity across ADLS, ADF, Synapse, Databricks.
• Work hands-on with Azure services (ADF, Synapse, MSSQL, Azure SQL DB, Data Lake).
• Create end-to-end pipelines loading data from multiple sources to landing layers or SQL tables.
• Leverage data integration tools (Informatica, Synapse, NiFi, Airflow).
• Handle various data formats (Oracle, SQL Server, DB2, CSV, XML, Parquet, AVRO).
• Develop, standardize, and optimize data workflows following best practices.
• Contribute to data governance ensuring accuracy, consistency, security, reliability.
• Automate, monitor, alert, and manage data pipelines and workflows.
• Evaluate system changes, provide backup/rollback procedures, feasibility studies.
• Develop new systems, upgrades, and ensure standards compliance post-change.
• Develop complex programs and reports in database query language.
• Familiar with data visualization tools and security of sensitive data.

Skills

ETL design

Azure

SQL mastery

Data governance

Python

Databricks

Informatica

Airflow

Education

Bachelor's degree in IT

5+ years preferred

Tools

Azure Data Factory

Azure Synapse

SQL Server

Azure Data Lake Storage

MSSQL

Oracle/DB2

Job description

Role: ETL Data Engineer

Client: DC Government

Location: Washington, DC (Onsite)

Job Description

Responsibilities

• 1. Analyzes, designs, develops, implements, replicates, and supports complex enterprise data projects.
• 2. Interfaces with other agencies, consult with and inform user departments on system requirements, advise on environment constraints and operating difficulties for the current state and advise and resolve problems using cloud solutions and develop and replicate future enhancements to District’s data systems.
• 3. Strong knowledge of Extraction, Transformation and Loading (ETL) processes using frameworks like Azure Data Factory, Synapse, Databricks, Informatica by gathering requirements from the stake holders or analyzing the existing code and perform enhancements or new development.
• 4. Establishing the cloud and on-premise connectivity in different systems like ADLS, ADF, Synapse, Databricks
• 5. Hands on experience in Azure cloud services like Azure Data Factory or Azure Synapse, MSSQL Db, Azure SQL DB, Azure Data Lake Storage Gen2, Blob Storage, Python etc.
• 6. Worked on creating end to end pipelines to load data by reading it from multiple sources or source systems and load to landing layer or SQL tables.
• 7. Familiarity/experience with data integration and data pipeline tools (e.g., Informatica, Synapse, Apache NiFi, Apache Airflow)
• 8. Familiarity/experience with various data formats including database specific (Oracle, SQL Server, DB2, Quickbase), text formats(CSV, XML) and Binary(Parquet, AVRO)
• 9. Develops, standardizes and optimizes existing data workflow/pipelines adhering to best practices.
• 10. Adhere and contribute to enterprise data governance standards by ensuring data accuracy, consistency, security, and reliability.
• 11. Automates, monitors, alerts, and manages data pipelines and workflows.
• 12. Analyzes and evaluates system changes to determine feasibility, provides alternative solutions, back-up, and rollback procedures.
• 13. Works on the development of new systems, upgrades and enhancements to existing systems and ensure systems follow approved standards and consistency after the changes.
• 14. Develops complex programs and reports in database query language.
• 15. Familiarity/experience with data visualization tools.
• 16. Familiarity/experience handling and securing sensitive data based on the level of the sensitivity

CONTRACT JOB DESCRIPTION

Responsibilities

• 1. Demonstrates expertise in conveying technical and functional concepts for a specific technical specialty.
• 2. Identifies improvements to project standards to achieve high quality services/ products. This is a professional position which may require subject matter expertise consistent with demanding and rare technological skills.
• 3. May require coordination of programming activities being conducted by the application development team
• 4. Confers with other business and technical personnel to resolve problems of intent, inaccuracy, or feasibility of computer processing and project design.
• 5. Works with necessary personnel to determine if modifications are necessary with interested personnel to determine necessity for modifications or enhancements.
• 6. Leverages excellent written and verbal communication skills to develop new business process and programming solutions as directed by business and technical stakeholders.
• 7. May coordinate activities of application developers.11-
• 8. Able to identify best practices and standards for the use of the product.
• 9. Proven track record of hands-on technical design and code work within large complex systems.
• 10. Proven hands-on technical work with a variety of technologies.
• 11. Demonstrated technical expertise integrating a variety of diverse technical environments and cross-platform technologies.
• 12. Delivers support and design for industry specific applications that require integration with statewide systems or applications.
• 13. Interacts with executive level business users or technical experts.
• 14. Advanced experience in the required technical subject matter.
• 15. May function as a niche technical SME (Subject Matter Expert).
• 16. Has proven experience across large and complex implementations and systems.

Minimum Education/Certification Requirements

Bachelor’s degree in Information Technology or related field or equivalent experience

Job Type: Full-time

Experience

• Bachelor’s degree (Masters or higher preferred): 5 years (Preferred)
• Oracle, SQL, Postgres, DB2), text formats & Binary: 10 years (Preferred)
• enterprise data governance : 7 years (Preferred)
• Microsoft Azure tools such as Azure Data Factory, Synapse: 5 years (Preferred)
• data integration and data pipeline tools : 5 years (Preferred)
• Visualization & reporting S/W such as MicroStrategy, Tableau: 3 years (Preferred)
• performing data functions with Databricks: 3 years (Preferred)
• Strong knowledge for development of (ETL): 10 years (Preferred)
• 15yr gather & document requirements for data extraction: 10 years (Preferred)
• 15yrUnderstanding of data warehousing, data lake, BI: 10 years (Preferred)
• 15yr to advise internal and external customers : 10 years (Preferred)
• 11yr Knowledge and use of SQL for relational databases: 10 years (Preferred)