Senior Data Engineer

Kforce Inc; Charlotte (NC); On-site; USD 120,000 - 180,000; Full time

Job summary

Kforce is seeking a Senior Data Engineer in Charlotte, NC. The role focuses on building scalable data pipelines, data models and warehousing solutions using Python/PySpark on AWS.

Ideal candidates have 8+ years in data engineering, strong SQL, REST APIs, and DevOps experience with CI/CD tools in an Agile setting.

Qualifications

• Minimum 8 years of hands-on data engineering experience in Python/PySpark.
• Experience with AWS services like Glue, Lambda, MSK, S3, Step Functions, RDS, EKS.
• Experience with relational databases (Postgres, SQL Server, Oracle, Sybase).
• Strong SQL skills including tuning, stored procedures and triggers.
• Data modeling, data warehousing and analytics experience.
• Experience with REST APIs, and CI/CD DevOps tools.

Responsibilities

• Design and implement scalable data pipelines and data models.
• Develop in Python/PySpark to build data integration solutions.
• Collaborate with architecture and DevOps teams to deploy on AWS.
• Tune queries, optimize ETL processes and maintain data quality.
• Work in an Agile/SCRUM environment and support operations.

Skills

Python

PySpark

AWS

SQL

REST APIs

CI/CD

UNIX scripting

Data Modeling

Data Warehousing

ETL Tools

Tools

DataStage

Informatica

Pentaho

GitHub

Bitbucket

Jenkins

Control-M

Autosys

Job description

Responsibilities

Kforce has a client that is seeking a Senior Data Engineer in Charlotte, NC.

Responsibilities

Kforce has a client that is seeking a Senior Data Engineer in Charlotte, NC.

Requirements

• Minimum 8 years of hands-on data engineering experience in development using Python and Pyspark
• Experience in AWS cloud services like Glue, Lambda, MSK (Kafka), S3, Step functions, RDS, EKS
• Experience in Databases like Postgres, SQL Server, Oracle, Sybase
• Experience with SQL, performance tuning, queries, stored procedures, views, functions, and triggers
• Developer experience specifically focusing on Data Engineering
• Strong technical experience in Design (Mapping specifications, HLD, LLD), Development (Coding, Unit testing)
• Strong experience with Agile/SCRUM methodology
• Experience with other ETL tools (DataStage, Informatica, Pentaho, etc.)
• Experience with data models, data mining, data analysis and data profiling
• Experience in working with REST API's
• Experience in workload automation tools like Control-M, Autosys, etc.
• Good knowledge in CI/CD DevOps process and tools like Bitbucket, GitHub, Jenkins
• Knowledge in developing UNIX scripts, Oracle SQL/PL-SQL
• Knowledge in MDM, Data warehouse and Data Analytics
• Knowledge of Data modeling, Warehousing concepts and Agile/SCRUM methodology
• Understanding of Data pipelines, ETL processes, CI/CD DevOps process and tools like GitHub, Jenkins
• Strong problem-solving and analytical skills
• Ability to learn and use AI tools effectively

The pay range is the lowest to highest compensation we reasonably in good faith believe we would pay at posting for this role. We may ultimately pay more or less than this range. Employee pay is based on factors like relevant education, qualifications, certifications, experience, skills, seniority, location, performance, union contract and business needs. This range may be modified in the future.

We offer comprehensive benefits including medical/dental/vision insurance, HSA, FSA, 401(k), and life, disability & ADD insurance to eligible employees. Salaried personnel receive paid time off. Hourly employees are not eligible for paid time off unless required by law. Hourly employees on a Service Contract Act project are eligible for paid sick leave.

Note: Pay is not considered compensation until it is earned, vested and determinable. The amount and availability of any compensation remains in Kforce's sole discretion unless and until paid and may be modified in its discretion consistent with the law.

This job is not eligible for bonuses, incentives or commissions.

Kforce is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.