Azure Data Engineer: HIPAA-Compliant Data Pipelines

Ventois Inc.; Shrewsbury (MA); On-site; USD 70,000 - 90,000; Full time

Job summary

Ventois Inc. in Shrewsbury, Massachusetts is seeking a data analyst to manage and analyze large healthcare datasets. The ideal candidate should have expertise in Python (PySpark) and SQL, with experience in Azure Data Factory and Databricks. Responsibilities include developing data models, ensuring data quality, and collaborating with stakeholders to drive data-driven decisions. This role requires a strong analytical mindset and the ability to communicate findings effectively. The company encourages continuous learning of new technologies and methodologies.

Qualifications

• Extensive experience in Python (PySpark) for data manipulation and analysis.
• Strong knowledge of SQL for querying and managing large datasets.
• Ability to apply data mining and statistical techniques in analytical projects.

Responsibilities

• Analyze large structured and semi-structured datasets using Python and SQL.
• Develop data models and analytical datasets for reporting and business intelligence.
• Implement data quality frameworks and ETL/ELT processes.

Skills

Python (PySpark)

SQL

Data mining

Statistical analysis

Azure Data Factory

Azure Databricks

Data governance

ETL/ELT processes

Data quality frameworks

Azure DevOps

Tools

Azure Data Lake Storage

Spark SQL

Azure monitoring tools

APIs

Job description

Ventois Inc. in Shrewsbury, Massachusetts is seeking a data analyst to manage and analyze large healthcare datasets. The ideal candidate should have expertise in Python (PySpark) and SQL, with experience in Azure Data Factory and Databricks. Responsibilities include developing data models, ensuring data quality, and collaborating with stakeholders to drive data-driven decisions. This role requires a strong analytical mindset and the ability to communicate findings effectively. The company encourages continuous learning of new technologies and methodologies.