Data Engineer

Talentify; Concord (CA); On-site; USD 120,000 - 170,000; Full time

Benefits offered by this job

Medical insurance

Dental insurance

Vision insurance

Job summary

Perfict Global is seeking a data engineering professional to design and automate audit pipelines in a HIPAA-compliant environment. You will translate business requirements into SQL, build robust data workflows, and implement monitoring and alerting to reduce manual reviews.

Strong Python and Databricks experience are essential, with Azure proficiency. Collaborative integration with analytics teams and documentation training for users are expected, leveraging modern data tools to balance

Qualifications

• Bachelor's degree required.
• 3–5+ years of related experience in data engineering or analytics.
• Azure cloud expertise.
• Advanced SQL skills.
• Experience with Databricks.
• Python proficiency.
• Knowledge of HIPAA rules and audit frameworks.
• DevOps tools and processes experience.

Responsibilities

• Develop scripts to automate the Audit and Monitoring process.
• Translate business requirements into SQL queries.
• Create alert reporting when audit conditions are met.
• Automate to reduce manual review of audit scenarios.
• Document products and train business users to manage queries and reports.
• Build robust data pipelines to process, validate, transport, and distribute data.
• Develop workflows enabling analysts to efficiently use data.

Skills

3–5+ years experience

Azure

Advanced SQL

Databricks

Python

HIPAA knowledge

DevOps practices

Education

Bachelor's degree

Tools

Databricks

Power BI

MapReduce

HDFS

Job description

About Us:

Perfict Global is a leading IT consulting services provider focused on providing innovative and successful business workforce solutions to Fortune 500 companies. Our trained and experienced professionals constantly strive to bring together the best technologies available to manage client's complex business and technology, participate in implementation activities and collaborate in new ways to meet client needs.

We provide excellent benefits such as Medical, Dental, Vision ++ a fun company to work!!!

Job Description:

Responsibilities

• Developing scripts to automate the Audit and Monitoring process
• Take business requirements and build queries to spec
• create alert reporting when audit condition are met
• create automation to reduce the amount of manual review of audit scenarios
• complete documentation of products and training business users to manage and maintain queries and reports

Data Pipeline: Build robust data pipelines: develop jobs to process, validate, transport, collate, aggregate, and distribute data Build workflows that empower analysts to efficiently use data Develop data virtualizations and actual data movement and transformation processes, using the appropriate technologies, tools and techniques to balance performance and cost objectives. Define and establish processes to maintain the integrity of data within our data pipeline and warehouse Develop tests to validate, and monitor data transfer integrity and efficiency. Work collaboratively across the organization to address and predict data performance issues Develop documentation for the tools and data products deployed

Required Skills

• Bachelor's degree
• 3 – 5+ years of related experience
• Cloud Service – Azure
• Advanced level SQL
• Databricks
• Python
• Knowledge of HIPAA rules and audit frameworks
• DevOps tools and processes

Preferred Skills

• Power BI
• MapReduce, HDFS