Senior Data Engineer

BCforward; Houston (TX); On-site; USD 140,000 - 190,000; Full time

Job summary

BCforward is seeking a Senior Software Engineer, Data Modernization, to lead modernization efforts in a Houston-based onsite role. You will work on legacy-to-cloud data migrations, data modeling, and performance tuning within a hands-on engineering team.

Core stack includes SQL, Databricks, Java and Spark. You will analyze large data sets, build reports, and contribute to architecture while ensuring secure coding standards and collaboration with enterprise AI tooling.

Qualifications

• 10-12 years of software engineering experience with formal training.
• Java or Python; strong relational DB and T-SQL skills; Kafka and Spark.
• Working knowledge of Databricks and AWS.
• Experience with AI development tools and responsible AI.
• Strong Oracle PL/SQL: read and reason about legacy packages, views and procedures.
• Strong SQL and Databricks SQL, Delta Lake, and Unity Catalog.

Responsibilities

• Design, build and troubleshoot secure, high-quality production code.
• Produce architecture and design artifacts, ensuring code meets design constraints.
• Analyze large data sets, build reports and visualizations, and use findings to improve code and architecture.
• Use enterprise-approved AI coding tools to speed up delivery, with validation through review and tests.
• Contribute to engineering communities of practice.

Skills

Java

Python

SQL

Spark

Kafka

Databricks

Spring Boot

Kubernetes

Docker

S3

Tools

Delta Lake

Unity Catalog

dbt

AWS

Job description

**Presently we are unable to sponsor and request applicants to apply who are authorized to work without sponsorship**

Senior Software Engineer, Data Modernization

Location: Houston, TX - Onsite

Core stack: SQL, Databricks, Java, Spark

Role summary

Modernize and upgrade the technology stack, including legacy-to-cloud data migration, through hands‑on engineering, data modelling and performance tuning.

Responsibilities

• Design, build and troubleshoot secure, high-quality production code.
• Produce architecture and design artifacts, and ensure the code meets design constraints.
• Analyze large data sets, build reports and visualizations, and use the findings to improve code and architecture.
• Use enterprise-approved AI coding tools to speed up delivery, validating output through review, testing and secure coding standards.
• Contribute to engineering communities of practice.

Required

• 10-12 years of experience (the posting also says 8+), with formal software engineering training.
• Java or Python; strong relational database and T-SQL skills; Kafka and Apache Spark.
• Working knowledge of Databricks and AWS.
• Experience with enterprise-approved AI dev tools, and an understanding of responsible AI use.
• Strong Oracle PL/SQL: able to read and reason about complex legacy packages, views and procedures.
• Strong SQL and Databricks SQL, Delta Lake (MERGE, time travel, partitioning) and Unity Catalog.
• Hands‑on dbt: models, snapshots, macros, Jinja, hooks and unit tests.
• Java, Scala/Spark, Spring Boot, Kafka, Kubernetes, Docker, S3 and Dremio.
• Data modelling: dimensional design, SCD2 history and point‑in‑time queries.
• Spark/Databricks performance tuning.
• Legacy‑to‑cloud migrations with formal parity and reconciliation.
• Strong written communication, including turning code into business‑rule documentation.