Data Engineer with Azure, Databricks, Snowflake Engineer, AWS, DBT

PwC; United States; Hybrid; USD 150,000 - 190,000; Full time

Job summary

PwC in the United States is seeking a data engineering professional with 4–8 years of hands-on experience in modern big data platforms. The role emphasizes Azure ADLS, Hadoop, Spark, and Snowflake knowledge, plus data extraction from diverse sources and robust documentation of architecture and migration strategies.

The candidate should demonstrate strong analytical and communication skills, familiarity with ETL/ELT processes, and experience with Git-based DevOps pipelines.

Qualifications

• 4+ years of experience with Azure ADLS, Data Bricks, Data Flows, HDInsight, Azure Analysis Services.
• Knowledge of Data Management concepts and Data Modelling.
• Experience with Hadoop and Spark.
• Experience extracting data from flat files, XML, JSON, Parquet, RDBMS and Big data appliances.

Skills

Azure ADLS

Data Bricks

Data Flows

HDInsight

Azure Analysis Services

Big Data frameworks

Hadoop

Spark

Unix Shell Scripting

Cloud data migration

DevOps practices

Tools

Git

CI/CD

Jenkins

Gitlab

CodePipeline

CodeBuild

CodeCommit

Job description

Role & responsibilities

Years of Experience: Candidates with 4-8 years of hands on experience

Position Requirements:

Must Have:

Mandatory:(Azure, Snowflake Engineering Manager, AWS, DBT)

• 4+ years of experience working in Azure ADLS, Data Bricks, Data Flows, HDInsight, Azure Analysis services
• Should be aware of Data Management concepts and Data Modelling
• Good knowledge of Big Data frameworks and related technologies - Experience in Hadoop and Spark is mandatory
• Should have expertise in extracting data from different source systems like flat files, XML sources, JSON, Parquet files, Big data appliances, RDBMS, etc.
• Good knowledge of Big Data frameworks and related technologies - Experience in Hadoop and Spark is mandatory
• Should have clear understanding of DW lifecycle and contributed in preparing
• Detail Level Design document
• Unit Test plans
• Code review reports
• Must have strong knowledge in Snowflake and sql, understand joins, groups, functions & Stored procedures
• Must have experience in Unit and Integration Test creation and verification
• Proficient in creating documentation related to Project Architecture, Project end User Manual and Operations Hand off guide
• Should have good understanding of Data Migration processes, methods and project lifecycle
• Good in Unix Shell Scripting skills
• Strong analytical skills and troubleshooting skills
• Should be well versed with quality processes and implementation
• Excellent communication skills
• Strong understanding of Cloud data migration processes, methods and project lifecycle
• Good knowledge of Application DevOps tools (Git, CI/CD Frameworks) - Experience in Jenkins or Gitlab with rich experience in source code management like Code Pipeline, Code Build and Code Commit

Preferred candidate profile: