Data Engineer

Lancesoft; Charlotte (NC); On-site; USD 62,000 - 76,000; Full time

Benefits offered by this job

Four options of medical Insurance

Dental and Vision Insurance

401k Contributions

Critical Illness Insurance

Voluntary Permanent Life Insurance

Accident Insurance

Other Employee Perks

Job summary

LanceSoft is seeking a Data Engineer in Charlotte, NC to design and implement data integration solutions that deliver business value. The role emphasizes Python/PySpark ETL development and experience with AWS services to build scalable data pipelines in large domains.

The ideal candidate will work on data modeling, data mining, and data analytics, collaborating with a data team in an onsite setting. This position offers competitive hourly compensation and a comprehensive benefits package.

Qualifications

• Experience designing data integration solutions.
• Hands-on Python and PySpark ETL development.
• Experience with AWS services such as Glue, Lambda, MSK, S3, Step Functions, RDS, EKS.
• Strong SQL knowledge and relational DB tuning.
• Design and development experience including HLd/LLD and unit testing.
• Unix scripting proficiency.
• Experience with REST APIs and data modeling.
• Familiarity with CI/CD tools like Bitbucket, GitHub, Jenkins.
• Agile/SCRUM experience.
• Exposure to other ETL tools (DataStage, Informatica, Pentaho).

Skills

Data Engineering

Python & PySpark

AWS Cloud

SQL & RDBMS

ETL Development

UNIX scripting

REST APIs

CI/CD DevOps

Agile/SCRUM

Data Modeling

Tools

AWS Glue

GitHub

Job description

Job Title

Data Engineer

Job Description

The primary role of the Data Engineer is to function as a critical member of a data team by designing data integration solutions that deliver business value in line with the company’s objectives. They are responsible for the design and development of data/batch processing, data manipulation, data mining, and data extraction/transformation/loading into large data domains using Python/Pyspark and AWS tools.

Skills and Knowledge

• Developer experience specifically focusing on Data Engineering.
• Hands-on experience in Development using Python and Pyspark as an ETL tool.
• Experience in AWS services like Glue, Lambda, MSK (Kafka), S3, Step functions, RDS, EKS etc.
• Experience in Databases like Postgres, SQL Server, Oracle, Sybase etc.
• Experience with SQL database programming, SQL performance tuning, relational model analysis, queries, stored procedures, views, functions, and triggers.
• Strong technical experience in Design (Mapping specifications, HLD, LLD), Development (Coding, Unit testing).
• Knowledge in developing UNIX scripts, Oracle SQL/PL-SQL.
• Experience with data models, data mining, data analysis and data profiling.
• Experience in working with REST API's.
• Experience with workload automation tools like Control-M, Autosys etc.
• Good knowledge in CI/CD DevOps process and tools like Bitbucket, GitHub, Jenkins.
• Strong experience with Agile/SCRUM methodology.
• Experience with other ETL tools (DataStage, Informatica, Pentaho, etc.).
• Knowledge in MDM, Data warehouse and Data Analytics.

Location

Charlotte, NC 28203 (Onsite)

Compensation

$45.00 - $55.00 per hour on W2

Benefits

• Four options of medical Insurance
• Dental and Vision Insurance
• 401k Contributions
• Critical Illness Insurance
• Voluntary Permanent Life Insurance
• Accident Insurance
• Other Employee Perks

About LanceSoft

LanceSoft is rated as one of the largest staffing firms in the US by SIA. Our mission is to establish global cross-culture human connections that further the careers of our employees and strengthen the businesses of our clients. We are driven to use the power of our global network to connect businesses with the right people, and people with the right businesses without bias. We provide Global Workforce Solutions with a human touch

Equal Opportunity Statement

LanceSoft is a certified Minority Business Enterprise (MBE) and an equal opportunity employer. We prohibit discrimination and harassment of any kind based on race, color, sex, religion, sexual orientation, national origin, disability, genetic information, pregnancy, or any other protected characteristic as outlined by federal, state, or local laws. This policy applies to all employment practices within our organization, including hiring, recruiting, promotion, termination, layoff, recall, leave of absence, compensation, benefits, training, and apprenticeship. LanceSoft makes hiring decisions based solely on qualifications, merit, and business needs at the time.