Lead Data Engineer — AWS, Python & Snowflake

Spectraforce Technologies; Plano (TX); Hybrid; USD 130,000 - 170,000; Full time

Job summary

Spectraforce Technologies is seeking a Lead Data Engineer to lead data engineering efforts on a critical project in Plano, TX. You will design and build scalable data pipelines, mentor teammates, and collaborate with agile teams across the organization.

Focus areas include Python and SQL development, cloud data warehousing with Snowflake/Databricks, and real-time data processing. Onsite three days per week with a hybrid work model.

Qualifications

• 5+ years of experience in Python and SQL development.
• 5+ years of public cloud experience (AWS, GCP, Azure).
• 5+ years with distributed data/compute tools (MapReduce, Hadoop, EMR, Kafka, Spark).
• 5+ years with data warehouses/services (Snowflake, Databricks, Redshift).
• 5+ years experience with data modeling for data warehousing.

Responsibilities

• Collaborate with Agile teams to design, develop, test, and support data solutions using data movement tools and technologies.
• Lead a team of developers experienced in data movement, distributed computing, and full-stack systems.
• Utilize Python, SQL, and Open Source RDBMS/NoSQL databases and cloud data warehousing services like Snowflake and Databricks.
• Optimize information systems for end-users and downstream consumers with solid data design practices.
• Mentor engineers and stay current with emerging tech through communities and experimentation.

Skills

Python

SQL

Data modeling

Data warehousing

Open source databases

Tools

AWS

GCP

Azure

MapReduce

Hadoop

EMR

Kafka

Spark

Snowflake

Databricks

Redshift

Job description

Spectraforce Technologies is seeking a Lead Data Engineer to lead data engineering efforts on a critical project in Plano, TX. You will design and build scalable data pipelines, mentor teammates, and collaborate with agile teams across the organization.

Focus areas include Python and SQL development, cloud data warehousing with Snowflake/Databricks, and real-time data processing. Onsite three days per week with a hybrid work model.