Senior ETL/Data Engineer

Morph Enterprise; Washington (District of Columbia); On-site; USD 120,000 - 150,000; Full time

Job summary

Morph Enterprise is seeking an ETL Data Engineer to support data operations for its Cloud Data Exchange. You will leverage Azure tools to perform ETL, data loading and transformation tasks, and support governance standards.

Work will involve building end-to-end pipelines, interfacing with stakeholders, and ensuring data quality across environments using Azure Data Factory, Synapse, and related platforms.

Qualifications

• 15+ years of experience in ETL/data integration or related fields.
• Gather and document requirements for ETL/ELT processes.
• Understand data warehousing, lakes, BI concepts and standards.
• Advise customers on tools and systems for complex data processing.
• SQL proficiency across relational databases.
• Experience with multiple data formats (CSV/XML/Parquet/AVRO).
• Contribute to data governance standards for accuracy and security.
• Strong communication and customer service skills.
• Ability to work independently or in a team.

Responsibilities

• Analyze, design, and implement complex enterprise data projects.
• Interface with agencies and user departments on requirements.
• Develop ETL pipelines using Azure tools and other platforms.
• Establish cloud and on-prem connectivity across systems.
• Load data from multiple sources to landing layers or SQL tables.
• Automate, monitor, and alert data pipelines and workflows.

Skills

ETL development

SQL proficiency

Azure data tooling

Data warehousing

Data governance

Data integration

Communication skills

Independent working

Education

Bachelor's degree in Information Technology or related field

Tools

Azure Data Factory

Azure Synapse

SQL Database

Azure Data Lake Storage Gen2

Blob Storage

Python

Databricks

Informatica

Apache NiFi

Apache Airflow

MicroStrategy/Tableau/Esri ArcGIS

Job description

Job Summary

• 100 % Onsite
• Webcam Interview
• We are looking for an ETL data engineer to support data operations for its Cloud Data Exchange. The resource will utilize native Azure tools to perform ETL, data loading and data transformation tasks.
• The ETL data engineer will support the Enterprise Data team for data curation, processing, and transformation tasks. Specifically, the ETL data engineer will be responsible for the following tasks;

Responsibilities

• Analyzes, designs, develops, implements, replicates, and supports complex enterprise data projects.
• Interfaces with other agencies, consult with and inform user departments on system requirements, advise on environment constraints and operating difficulties for the current state and advise and resolve problems using cloud solutions and develop and replicate future enhancements to data systems.
• Strong knowledge of Extraction, Transformation and Loading (ETL) processes using frameworks like Azure Data Factory, Synapse, Databricks, Informatica by gathering requirements from the stake holders or analyzing the existing code and perform enhancements or new development.
• Establishing the cloud and on-premise connectivity in different systems like ADLS, ADF, Synapse, Databricks
• Hands on experience in Azure cloud services like Azure Data Factory or Azure Synapse, MSSQL Db, Azure SQL DB, Azure Data Lake Storage Gen2, Blob Storage, Python etc.
• Worked on creating end to end pipelines to load data by reading it from multiple sources or source systems and load to landing layer or SQL tables.
• Familiarity/experience with data integration and data pipeline tools (e.g., Informatica, Synapse, Apache NiFi, Apache Airflow)
• Familiarity/experience with various data formats including database specific (Oracle, SQL Server, DB2, Quickbase), text formats(CSV, XML) and Binary(Parquet, AVRO)
• Develops, standardizes and optimizes existing data workflow/pipelines adhering to best practices.
• Adhere and contribute to enterprise data governance standards by ensuring data accuracy, consistency, security, and reliability.
• Automates, monitors, alerts, and manages data pipelines and workflows.
• Analyzes and evaluates system changes to determine feasibility, provides alternative solutions, back-up, and rollback procedures.
• Works on the development of new systems, upgrades and enhancements to existing systems and ensure systems follow approved standards and consistency after the changes.
• Develops complex programs and reports in database query language.
• Familiarity/experience with data visualization tools.
• Familiarity/experience handling and securing sensitive data based on the level of the sensitivity.

Education & Certification

Minimum Education/Certification Requirements : Bachelor's degree in Information Technology or related field or equivalent experience

Required Skills

• Strong knowledge for development of Extract-Transform-Load (ETL) processes, including end-to-end pipelines with data loading from multiple sources – Required 15 Years
• Ability to gather and document requirements for data extraction, transformation and load processes – Required 15 Years
• Understanding of data warehousing, data lake, business intelligence and information management concepts and standards. – Required 15 Years
• Ability to advise internal and external customers on appropriate tools and systems for complex data processing challenges. – Required 15 Years
• Knowledge and use of SQL for relational databases – Required 11 Years
• Experience with various data formats including database specific (Oracle, SQL, Postgres, DB2), text formats (CSV, XML) and Binary (Parquet, AVRO) – Required 11 Years
• Contribute to enterprise data governance standards by ensuring accuracy, consistency, security and reliability – Required 7 Years
• Strong experience with Microsoft Azure tools such as Azure Data Factory, Synapse, SQL Database, Data Lake Storage Gen2, Blob Storage – Required 5 Years
• Experience with data integration and data pipeline tools such as Informatica PowerCenter, Apache NiFi, Apache Airflow and FME – Required 5 Years
• Experience with visualization and reporting software such as MicroStrategy, Tableau, and Esri ArcGIS – Highly desired 3 Years
• Strong communication skills, both oral and written – Required 3 Years
• Ability to provide excellent customer service to external partners – Required 3 Years
• Ability to work independently or as part of a larger team – Required 3 Years
• Experience performing data functions with Databricks – Highly desired 3 Years