Senior Data Engineer & BI Developer

Spectraforce Technologies; San Mateo (CA); Hybrid; USD 140,000 - 190,000; Full time

Job summary

Spectraforce Technologies, Inc. is seeking a Senior Data Engineer & BI Developer in Foster City, CA for a 14-month hybrid engagement. The role focuses on designing data products, building scalable ETL pipelines, and delivering dashboards with Tableau and Amazon QuickSight.

8+ years of experience in data engineering, BI, and data warehousing are required. The candidate will work with Databricks, Starburst, PostgreSQL, Oracle, and AWS RDS to create enterprise data platforms, data models, and

Qualifications

• Bachelor's degree in Computer Science, Information Technology, Engineering, or related field.
• 8+ years of experience in Data Engineering, Data Warehousing, Analytics, and BI Development.
• Strong expertise in: Databricks and Data Lake architectures, Starburst, PostgreSQL, Oracle Database, AWS RDS, Python, SQL, Tableau, Amazon QuickSight, ETL development and data integration.

Responsibilities

• Design, develop, and maintain enterprise data products, data pipelines, data lakes, and analytical solutions.
• Build and support scalable data platforms using Databricks, Starburst, PostgreSQL, Oracle, and AWS RDS.
• Develop and optimize ETL processes, data integration workflows, and data transformation pipelines using Python and SQL.
• Design and maintain data models, curated datasets, and semantic layers that support business reporting and self-service analytics.
• Develop, enhance, and support dashboards, scorecards, and KPI reporting solutions using Amazon QuickSight and Tableau.
• Collaborate with business stakeholders, analysts, and application teams to translate business requirements into data products and reporting solutions.
• Monitor and improve data quality, performance, reliability, security, and governance across enterprise data platforms.
• Provide production support, troubleshooting, root cause analysis, maintenance, and continuous improvements for data engineering and BI solutions.
• Create and maintain technical documentation, data lineage, operational procedures, and best practices.
• Participate in architecture reviews, data governance initiatives, and platform modernization efforts.

Skills

Databricks

Data Lake

Starburst

PostgreSQL

Oracle DB

AWS RDS

Python

SQL

Tableau

Amazon QuickSight

ETL

Data integration

Education

Bachelor's degree in CS/IT/Engineering

Tools

Databricks

Starburst

PostgreSQL

Oracle DB

AWS RDS

Job description

Senior Data Engineer & BI Developer

Duration: 14 Months

Location: Foster City, California, 94404

Hybrid Position - 3 days/week in Foster City. Local Candidates Only.

We are seeking an experienced Senior Data Engineer & BI Developer with 8+ years of industry experience to design, develop, support, and maintain data products, analytical dashboard solutions. The ideal candidate will have strong expertise in data engineering, cloud data platforms, business intelligence, database technologies, and dashboard development, with a focus on delivering scalable, business-ready data products and insights.

Responsibilities

• Design, develop, and maintain enterprise data products, data pipelines, data lakes, and analytical solutions.
• Build and support scalable data platforms using Databricks, Starburst, PostgreSQL, Oracle, and AWS RDS.
• Develop and optimize ETL processes, data integration workflows, and data transformation pipelines using Python and SQL.
• Design and maintain data models, curated datasets, and semantic layers that support business reporting and self-service analytics.
• Develop, enhance, and support dashboards, scorecards, and KPI reporting solutions using Amazon QuickSight and Tableau.
• Collaborate with business stakeholders, analysts, and application teams to translate business requirements into data products and reporting solutions.
• Monitor and improve data quality, performance, reliability, security, and governance across enterprise data platforms.
• Provide production support, troubleshooting, root cause analysis, maintenance, and continuous improvements for data engineering and BI solutions.
• Create and maintain technical documentation, data lineage, operational procedures, and best practices.
• Participate in architecture reviews, data governance initiatives, and platform modernization efforts.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, Engineering, or related field.
• 8+ years of experience in Data Engineering, Data Warehousing, Analytics, and BI Development.
• Strong expertise in: Databricks and Data Lake architectures, Starburst, PostgreSQL, Oracle Database, AWS RDS, Python, SQL, Tableau, Amazon QuickSight, ETL development and data integration
• Experience designing and delivering enterprise-scale data products and analytics solutions.
• Strong knowledge of data modeling, performance tuning, data governance, and best practices.
• Experience supporting production environments and mission-critical reporting platforms.
• Excellent analytical, troubleshooting, communication, and stakeholder management skills.
• Strong communication and teamwork abilities.
• Ability to work independently and handle multiple projects simultaneously.
• Knowledge on AI and machine learning concepts is a plus.

Required Years of Experience

Min. 8+

Required Degree or Certification

Bachelor's degree in computer science, engineering, or a related field.

Top 3 Required Skill Sets

Databricks and Data Lake architectures, Starburst, PostgreSQL, Oracle Database, AWS RDS, Python, SQL, Tableau, Amazon QuickSight

Top 3 Nice to Have Skill Sets

Power BI, AI Agents development, Power Automate

Unique Selling Point of this role

Hands on exp on Databricks, Amazon Quick Suite