BI / Data Engineer

Estuate, Inc.; Milpitas (CA); On-site; USD 100,000 - 140,000; Full time

Job summary

Estuate, Inc. is seeking a data engineer/BI developer to gather data from diverse sources, clean and preprocess it, and build insightful dashboards within Incorta. You will perform EDA, develop reports, and apply AI to automate tasks, ensuring data quality and scalable schemas.

The role involves cloud data platforms like Snowflake/Redshift, and working with PySpark, SQL, and Oracle. 2 years of relevant experience is expected.

Qualifications

• Master of Science in Computer Science/Engineering, Information Systems/Technology, or related field.
• 2 years experience in Software Engineer/Developer, Database Engineer/Admin, or related field.
• Experience with BI tools and data modeling.

Responsibilities

• Gather data from multiple sources including databases, spreadsheets, and external sources.
• Clean and preprocess data to ensure accuracy, completeness, and consistency. Maintain and update data systems and databases to ensure data integrity.
• Conduct exploratory data analysis (EDA) to identify trends, patterns, and insights.
• Develop and generate detailed reports, dashboards, and visualizations to communicate findings to stakeholders.
• Perform advanced statistical analyses to support business decisions and strategies.
• Implement AI techniques to automate repetitive tasks and improve data processing efficiency.
• Develop and implement data validation and verification processes in Incorta.
• Ensure accuracy and reliability of data by identifying and addressing data quality issues.
• Develop and maintain physical schemas, business schemas, and bridge schemas to organize and simplify data structures in Incorta.
• Work with Incorta Formula Builder and manage complex query management.
• Monitor Incorta nodes in CMC and Loader in Incorta.
• Develop impactful insights and dashboards that illustrate key patterns, findings and predictions from raw data within Incorta.
• Work in Cloud data solutions such as Snowflake and Redshift.
• Work with Pyspark, Oracle, SAP, and SQL. Use experience in Pyspark and SQL for data transformation.
• Use experience in materialized views, Incorta modeling, data visualization, and business intelligence reporting.
• Use knowledge in best practices for migration and performance tuning in Incorta.
• Create dashboards that are visually appealing and deliver key insights to the users.
• Use experience in end-to-end implementation of the BI solutioning, requirement mapping, finalization of specifications, development, testing and implementation in Incorta.

Skills

Data analysis

BI reporting

ETL processes

SQL

PySpark

Snowflake

Data visualization

Education

M.S. in CS/Engineering/IS or related field

Tools

Incorta

Snowflake

Redshift

SQL

Pyspark

Job description

Job Description

• Gather data from multiple sources including databases, spreadsheets, and external sources.


• Clean and preprocess data to ensure accuracy, completeness, and consistency. Maintain and update data systems and databases to ensure data integrity.


• Conduct exploratory data analysis (EDA) to identify trends, patterns, and insights.


• Develop and generate detailed reports, dashboards, and visualizations to communicate findings to stakeholders.


• Perform advanced statistical analyses to support business decisions and strategies.


• Implement AI techniques to automate repetitive tasks and improve data processing efficiency.


• Develop and implement data validation and verification processes in Incorta.


• Ensure accuracy and reliability of data by identifying and addressing data quality issues.


• Develop and maintain physical schemas, business schemas, and bridge schemas to organize and simplify data structures in Incorta.


• Work with Incorta Formula Builder and manage complex query management.


• Monitor Incorta nodes in CMC and Loader in Incorta.


• Develop impactful insights and dashboards that illustrate key patterns, findings and predictions from raw data within Incorta.


• Work in Cloud data solutions such as Snowflake and Redshift.


• Work with Pyspark, Oracle, SAP, and SQL. Use experience in Pyspark and SQL for data transformation.


• Use experience in materialized views, Incorta modeling, data visualization, and business intelligence reporting.


• Use knowledge in best practices for migration and performance tuning in Incorta.


• Create dashboards that are visually appealing and deliver key insights to the users.


• Use experience in end-to-end implementation of the BI solutioning, requirement mapping, finalization of specifications, development, testing and implementation in Incorta.

Skills & Requirements

Require Master of Science in Computer Science/Engineering, Information Systems/Technology, or related field and 2 years experience in the job offered, Software Engineer/Developer, Database Engineer/Admin, or related field.