Data Engineer - Python

Spectraforce Technologies; Oakland (CA); Hybrid; USD 120,000 - 150,000; Full time

Job summary

Spectraforce Technologies is seeking a Data Engineer - Python for a hybrid role in Oakland, CA. The contractor will design, develop, and deploy data-driven applications using Python, Streamlit, and Snowflake to support asset management and operational analytics.

The ideal candidate has 3-5 years of Python experience, 2+ years with Streamlit, and a track record in building scalable data pipelines. Collaboration with business stakeholders and Agile practices are expected.

Qualifications

• 3-5 years of Python development experience.
• 2+ years building applications with Streamlit.
• Experience developing solutions on Snowflake.
• Experience with SQL and database design concepts.
• Experience developing ETL/ELT processes and data pipelines.
• Knowledge of data engineering best practices, data quality controls, and data integration patterns.
• Experience working with REST APIs and external data sources.
• Experience using Git, version control, and CI/CD practices.
• Strong analytical, problem-solving, and communication skills.

Responsibilities

• Design, develop, and maintain Streamlit applications hosted on Snowflake.
• Develop Python-based solutions for data ingestion, transformation, validation, and reporting.
• Create scalable data pipelines and workflows to support business processes and analytics.
• Build interactive dashboards, forms, workflows, and self-service applications for business users.
• Develop and maintain integrations between Snowflake and enterprise systems including SharePoint, SAP, APIs, and other internal platforms.
• Collaborate with business stakeholders to gather requirements and translate them into technical solutions.
• Support data modeling, data quality, and governance activities.
• Troubleshoot production issues and implement performance improvements.
• Participate in Agile development activities, including sprint planning, backlog grooming, testing, and deployment.
• Create technical documentation, deployment guides, and support materials.

Skills

Python

Streamlit

SQL

REST APIs

Git

CI/CD

Data modeling

Data quality

Analytics

Communication

Tools

Snowflake

Snowpark for Python

Airflow

AWS

Azure

GCP

SharePoint

SAP

Power BI

Plotly

Pandas

Job description

Data Engineer - Python

Oakland, CA/San Ramon (Hybrid)

12 Months

*Local candidates only*

Equipment: Client laptop will be provided. However, in the event of delay, a personal or vendor-provided device must be ready (Citrix/VDI ready)

Role

• Team is seeking a highly motivated contractor with 3-5 years of experience in Python application development, Streamlit, Snowflake, and data engineering. The contractor will support the design, development, and deployment of data-driven applications that streamline business processes, improve asset management capabilities, and enable operational insights for Substation Systems & Tools and related business functions.
• The ideal candidate will have experience building data applications using Python and Streamlit, working with Snowflake data platforms, and developing data pipelines that integrate information from multiple enterprise systems. Experience supporting asset management, utility operations, SAP, SharePoint, or engineering workflows is highly desirable.

Responsibilities

• Design, develop, and maintain Streamlit applications hosted on Snowflake.
• Develop Python-based solutions for data ingestion, transformation, validation, and reporting.
• Create scalable data pipelines and workflows to support business processes and analytics.
• Build interactive dashboards, forms, workflows, and self-service applications for business users.
• Develop and maintain integrations between Snowflake and enterprise systems including SharePoint, SAP, APIs, and other internal platforms.
• Collaborate with business stakeholders to gather requirements and translate them into technical solutions.
• Support data modeling, data quality, and governance activities.
• Troubleshoot production issues and implement performance improvements.
• Participate in Agile development activities, including sprint planning, backlog grooming, testing, and deployment.
• Create technical documentation, deployment guides, and support materials.

Required Qualifications

• 3-5 years of experience in Python development.
• 2+ years of experience building applications using Streamlit.
• Experience developing solutions on Snowflake.
• Experience with SQL and database design concepts.
• Experience developing ETL/ELT processes and data pipelines.
• Knowledge of data engineering best practices, data quality controls, and data integration patterns.
• Experience working with REST APIs and external data sources.
• Experience using Git, version control, and CI/CD practices.
• Strong analytical, problem-solving, and communication skills.

Preferred Qualifications

• Experience with Snowpark for Python.
• Experience with Airflow, orchestration tools, or automated deployment pipelines.
• Experience working with cloud platforms (AWS, Azure, or GCP).
• Experience integrating with SAP, SharePoint, or enterprise asset management applications.
• Experience working with Asset Management, Utility Operations, Engineering, or Energy industry business processes.
• Familiarity with Power BI, Plotly, Pandas, and data visualization technologies.
• Understanding of data governance, master data management, and application security concepts.