Data Engineer

TheCorporate LLC; Michigan; Hybrid; USD 120,000 - 160,000; Full time

Job summary

TheCorporate LLC in Oakland, CA, is seeking an experienced Data Engineer, Expert contractor. The role focuses on building data-driven applications with Python, Streamlit, and Snowflake to enable operational insights for Substation Systems & Tools and related business functions.

The ideal candidate will design and maintain data pipelines, integrate with SharePoint, SAP, and APIs, and collaborate with stakeholders in an Agile environment.

Qualifications

• 3–5 years of Python development experience.
• 2 years with Streamlit.
• Experience developing solutions on Snowflake.
• SQL and database design concepts.
• ETL/ELT processes and data pipelines.
• REST APIs and external data sources.

Responsibilities

• Design, develop, and maintain Streamlit applications hosted on Snowflake.
• Develop Python-based solutions for data ingestion, transformation, validation, and reporting.
• Create scalable data pipelines and workflows to support business processes and analytics.
• Build interactive dashboards, forms, workflows, and self-service applications for business users.
• Develop and maintain integrations between Snowflake and enterprise systems including SharePoint, SAP, APIs, and other internal platforms.
• Collaborate with business stakeholders to gather requirements and translate them into technical solutions.
• Support data modeling, data quality, and governance activities.
• Troubleshoot production issues and implement performance improvements.
• Participate in Agile development activities, including sprint planning, backlog grooming, testing, and deployment.
• Create technical documentation, deployment guides, and support materials.

Skills

Python development

Streamlit development

Data modeling

Analytical thinking

Communication skills

Tools

Snowflake

SQL

Git

CI/CD

REST APIs

Airflow

Power BI

Job description

Job Title: Data Engineer, Expert

Location: Oakland, CANotes:

• Local candidates only. The role is hybrid in OGO or San Ramon.
• TOP THINGS: Refer to the first 2 paragraphs below from the hiring manager’s job description:

Job Description:

We are seeking a highly motivated contractor with 3-5 years of experience in Python application development, Streamlit, Snowflake, and data engineering. The contractor will support the design, development, and deployment of data-driven applications that streamline business processes, improve asset management capabilities, and enable operational insights for Substation Systems & Tools and related business functions.

The ideal candidate will have experience building data applications using Python and Streamlit, working with Snowflake data platforms, and developing data pipelines that integrate information from multiple enterprise systems. Experience supporting asset management, utility operations, SAP, SharePoint, or engineering workflows is highly desirable.

Responsibilities

• Design, develop, and maintain Streamlit applications hosted on Snowflake.
• Develop Python-based solutions for data ingestion, transformation, validation, and reporting.
• Create scalable data pipelines and workflows to support business processes and analytics.
• Build interactive dashboards, forms, workflows, and self-service applications for business users.
• Develop and maintain integrations between Snowflake and enterprise systems including SharePoint, SAP, APIs, and other internal platforms.
• Collaborate with business stakeholders to gather requirements and translate them into technical solutions.
• Support data modeling, data quality, and governance activities.
• Troubleshoot production issues and implement performance improvements.
• Participate in Agile development activities, including sprint planning, backlog grooming, testing, and deployment.
• Create technical documentation, deployment guides, and support materials.

Required Qualifications

• 3-5 years of experience in Python development.
• 2 years of experience building applications using Streamlit.
• Experience developing solutions on Snowflake.
• Experience with SQL and database design concepts.
• Experience developing ETL/ELT processes and data pipelines.
• Knowledge of data engineering best practices, data quality controls, and data integration patterns.
• Experience working with REST APIs and external data sources.
• Experience using Git, version control, and CI/CD practices.
• Strong analytical, problem-solving, and communication skills.

Preferred Qualifications

• Experience with Snowpark for Python.
• Experience with Airflow, orchestration tools, or automated deployment pipelines.
• Experience working with cloud platforms (AWS, Azure, or GCP).
• Experience integrating with SAP, SharePoint, or enterprise asset management applications.
• Experience working with Asset Management, Utility Operations, Engineering, or Energy industry business processes.
• Familiarity with Power BI, Plotly, Pandas, and data visualization technologies.
• Understanding of data governance, master data management, and application security concepts.