Data Engineer

vTech Solution; Washington; On-site; USD 170,000 - 210,000; Full time

Job summary

vTech Solution is seeking an experienced ETL Data Engineer to support the Data team by driving data curation, processing, and transformation for the Cloud Data Exchange. You will design, build, and support complex enterprise data pipelines using native Azure tools and advise stakeholders on cloud-based data solutions.

Responsibilities include end-to-end data projects, ETL pipelines with Azure Data Factory, Synapse, and Databricks, and ensuring data governance and reliability.

Qualifications

• Bachelor's degree in IT or related field or equivalent experience.
• 15+ years of ETL process development, requirements gathering, data warehousing concepts, and advising on data tooling.
• 11+ years of SQL experience across Oracle, SQL Server, Postgres, DB2, and diverse formats (CSV, XML, Parquet, AVRO).
• 7+ years contributing to enterprise data governance standards.
• 5+ years experience with Azure tools (Data Factory, Synapse, SQL DB, Data Lake Storage Gen2, Blob Storage).
• 5+ years experience with data integration/pipelines tools (Informatica PowerCenter, NiFi, Airflow, FME).
• 3+ years of strong communication skills and ability to work independently or in a team.

Responsibilities

• Analyze, design, develop, and support complex enterprise data projects end-to-end.
• Build ETL pipelines using Azure Data Factory, Synapse, Databricks, and related frameworks.
• Establish cloud and on-premises connectivity across ADLS, ADF, Synapse, and Databricks.
• Load data from multiple sources into landing layers or SQL tables.
• Develop, standardize, and optimize data workflows adhering to best practices.
• Ensure enterprise data governance focusing on accuracy, consistency, security, and reliability.
• Automate, monitor, and manage data pipelines and workflows.
• Evaluate system changes, feasibility, alternatives, and rollback procedures.
• Develop complex database queries and reports and support system upgrades.
• Advise stakeholders on tools and systems for complex data processing challenges.
• Interact with technical and executive-level stakeholders as a subject matter expert.

Skills

ETL development

Azure Data Factory

Azure Synapse

Databricks

SQL

Data governance

Data warehousing

Communication

Independent work

Education

Bachelor's degree in IT or related field

Tools

Informatica PowerCenter

Apache NiFi

Airflow

FME

Oracle

PostgreSQL

DB2

Parquet

AVRO

Job description

Job Summary:

Seeking an experienced ETL Data Engineer to support the Data team by driving data curation, processing, and transformation for the Cloud Data Exchange. This role involves designing, building, and supporting complex enterprise data pipelines using native Azure tools while advising stakeholders on cloud-based data solutions.

Responsibilities:

• Analyze, design, develop, and support complex enterprise data projects end-to-end.
• Build ETL pipelines using Azure Data Factory, Synapse, Databricks, and related frameworks.
• Establish cloud and on-premises connectivity across ADLS, ADF, Synapse, and Databricks.
• Load data from multiple sources into landing layers or SQL tables.
• Develop, standardize, and optimize data workflows adhering to best practices.
• Ensure enterprise data governance focusing on accuracy, consistency, security, and reliability.
• Automate, monitor, and manage data pipelines and workflows.
• Evaluate system changes, feasibility, alternatives, and rollback procedures.
• Develop complex database queries and reports and support system upgrades.
• Advise stakeholders on tools and systems for complex data processing challenges.
• Interact with technical and executive-level stakeholders as a subject matter expert.

Required Skills & Certifications:

• Bachelor's degree in IT or related field, or equivalent experience.
• 15 years of experience in ETL process development, requirements gathering, data warehousing/lake/BI concepts, and advising on data tooling.
• 11 years of SQL experience for relational databases and working with diverse data formats including Oracle, SQL, Postgres, DB2, CSV, XML, Parquet, and AVRO.
• 7 years contributing to enterprise data governance standards.
• 5 years experience with Azure tools such as Data Factory, Synapse, SQL DB, Data Lake Storage Gen2, and Blob Storage.
• 5 years experience with data integration and pipeline tools including Informatica PowerCenter, Apache NiFi, Airflow, and FME.
• 3 years of strong communication skills, customer service, and ability to work independently or in a team.

Preferred Skills & Certifications:

• 3 years experience with visualization and reporting tools such as MicroStrategy, Tableau, and Esri ArcGIS.
• 3 years experience with Databricks.

Special Considerations:

• Onsite work required.

Scheduling:

• Duration of 2 months.
• Interview conducted via webcam only.