Data Engineer II

Spearheadtech; Plano (TX); Hybrid; USD 80,000 - 120,000; Full time

Job summary

Join a forward-thinking company as a Data Engineer II, where you will develop and optimize data pipelines, ensuring data reliability and scalability. This role involves mentoring junior engineers and collaborating with diverse teams to drive data-driven solutions. Experience a supportive environment that prioritizes work-life balance and professional growth. With a commitment to innovation and quality, you will play a crucial role in shaping the future of technology. Embrace the opportunity to enhance your career while contributing to impactful projects in a dynamic setting.

Benefits

Healthy work-life balance

Competitive compensation

5-day workweek

Employee-centric environment

Flexible work arrangements

Career development plans

Learning & Development program

Qualifications

• 3-5 years experience in data engineering or software development.
• Proficiency in Python, Java, Scala, or SQL with clean coding skills.

Responsibilities

• Design and optimize scalable data pipelines for large datasets.
• Mentor junior engineers and collaborate with cross-functional teams.

Skills

Python

Java

Scala

SQL

Data Modeling

Problem-Solving

Communication

Education

Bachelor’s degree in Computer Science

Master’s degree in Data Engineering

Tools

Apache Spark

Airflow

Kafka

Snowflake

Databricks

AWS

Azure

Google Cloud

Git

Job description

Plano, United States | Posted on 03/13/2025

• Work Experience Associate Level 2-5 years
• Job Opening ID JPC -621
• Date Opened 03/13/2025
• State/Province Texas
• City Plano
• Country United States

Job Description

About the job: Data Engineer II

Career Level: Associate Level

Location: Onsite/Hybrid - Plano, Texas

Who We Are:

This is Spearhead Technology — where every challenge is an opportunity, and every solution is a masterpiece in the making. As a full-lifecycle IT company, we transcend mere delivery; we engineer success.

From inception to implementation, our seasoned expertise shepherds every phase of the journey. Be it planning, analysis, design, development, testing, or the seamless transition to production, we stand as steadfast partners in our clients’ progress.

At Spearhead Technology, quality isn't a mere aspiration—it's our ethos. Rooted in Tech Advisory, our methodology is guided by insights that spark transformative outcomes. We recognize the paramount importance of talent retention. Through a steadfast commitment to work-life balance, competitive remuneration packages, and an optimized operational model, we ensure our team remains as exceptional as our services.

Step into Spearhead Technology, where innovation meets precision, and together, let's sculpt the future of technology with finesse and distinction.

Requirements

We are seeking a highly skilled Data Engineer II to join our growing data team. In this role, you will work with limited supervision to develop, optimize, and maintain data pipelines, ensuring the reliability and scalability of data infrastructure. You will take on complex development tasks, mentor junior engineers, and collaborate with cross-functional teams to drive data-driven solutions.

Key Responsibilities

• Design, develop, and optimize scalable data pipelines to efficiently collect, process, and store large datasets.
• Independently write high-quality, maintainable code in at least one programming language (e.g., Python, Java, Scala, SQL).
• Enhance and improve the data architecture by implementing best practices for modular, reusable, and scalable design patterns (e.g., microservices, event-driven architecture).
• Perform intermediate troubleshooting and debugging, analyzing multiple interrelated factors to identify and resolve performance bottlenecks and failures.
• Implement ETL/ELT workflows using modern data processing frameworks (e.g., Apache Spark, Airflow, Kafka, Snowflake, Databricks).
• Ensure data integrity, security, and governance across multiple storage and processing environments (e.g., relational databases, data lakes, cloud platforms).
• Make informed technical decisions that impact daily operations while balancing system performance, scalability, and maintainability.
• Understand customer needs and requirements, adjusting data solutions as necessary to align with business objectives.
• Mentor and provide technical guidance to entry-level engineers and Software Development Engineers in Test (SDET).
• Collaborate effectively with cross-functional teams, including data scientists, analysts, software engineers, and business stakeholders, to support data-driven decision-making.
• Exhibit strong self-leadership and ownership over responsibilities, proactively seeking challenging projects and continuous learning opportunities.

Required Qualifications

• Bachelor’s or Master’s degree in Computer Science, Data Engineering, Information Systems, or a related field.
• 3-5 years of hands-on experience in data engineering, software development, or a similar technical role.
• Proficiency in at least one programming language (Python, Java, Scala, or SQL) with the ability to write clean, maintainable, and efficient code.
• Strong understanding of data modeling, database design, and data warehousing principles.
• Experience with cloud data platforms (AWS, Azure, Google Cloud) and related tools (e.g., S3, Redshift, BigQuery, Snowflake).
• Familiarity with software engineering best practices, including version control (Git), CI/CD pipelines, and automated testing.
• Working knowledge of software architecture patterns (e.g., microservices, MVC) and ability to design scalable and modular systems.
• Ability to troubleshoot and resolve complex data processing issues.
• Strong problem-solving and decision-making skills, balancing trade-offs between efficiency, scalability, and cost.
• Effective communication and collaboration skills, with experience working in cross-functional teams.

Preferred Skills

• Experience with real-time data streaming technologies (e.g., Apache Kafka, Kinesis, Flink).
• Exposure to containerization and orchestration (Docker, Kubernetes).
• Knowledge of big data frameworks (Hadoop, Spark, Presto).
• Understanding of ML Ops and feature engineering for machine learning applications.

What’s in it for you:

At Spearhead Technology, we prioritize your well-being and professional growth. Here's what you can expect:

• Achieve a healthy work-life balance.
• Competitive compensation and abundant growth opportunities.
• Enjoy a standard 5-day workweek with 2 fixed weekly offs.
• Experience an employee-centric environment with supportive policies.
• Benefit from family-friendly and flexible work arrangements.
• Access our Performance Advancement and Career Enhancement (PACE) initiative and discover opportunities for both personal and professional growth. From tailored career development plans to expert counseling services, PACE empowers you to chart your course to success with confidence and clarity. Elevate your career trajectory with our Learning & Development (L&D) program. Join our team and embark on a transformative journey of upskilling and self-discovery. With continuous learning as your compass, you'll not only enhance your expertise but also open doors to new opportunities, paving the way for career growth and fulfillment.

Please note: At Spearhead Technology, we value the importance of collaboration, learning, and fostering connections with clients, peers, leaders, and communities. While some in-person engagement may be required for certain roles, we are committed to providing flexibility to accommodate your individual work-life balance needs.

As an equal opportunities’ employer, Spearhead Technology welcomes and encourages applications from all members of society. We are dedicated to creating an inclusive environment where diversity is celebrated, and individuals are valued for their unique perspectives and contributions. We do not discriminate on the basis of race, religion or belief, ethnicity, disability, age, citizenship, marital or civil partnership status, sexual orientation, or gender identity.