Information & Technology - Engineer - Software

Lancesoft

Charlotte (NC)

On-site

USD 90,000 - 140,000

Full time

9 days ago

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Lancesoft in Charlotte, NC is seeking a Data Engineer to design data integration solutions and develop data/batch processing, data manipulation, data mining, and ETL into large data domains using Python/PySpark and AWS.

The role emphasizes REST APIs, SQL, CI/CD, and DevOps practices, with a focus on data warehousing and analytics. You''ll work on Agile/SCRUM teams and collaborate with data science and analytics stakeholders.

Qualifications

  • Developer experience specifically focusing on Data Engineering.
  • Hands-on experience in Development using Python and Pyspark as an ETL tool.
  • Experience in AWS services like Glue, Lambda, MSK (Kafka), S3, Step functions, RDS, EKS etc.
  • Experience in Databases like Postgres, SQL Server, Oracle, Sybase etc.
  • Experience with SQL database programming, SQL performance tuning, relational model analysis, queries, stored procedures, views, functions, and triggers.
  • Strong technical experience in Design (Mapping specifications, HLD, LLD), Development (Coding, Unit testing).
  • Knowledge in developing UNIX scripts, Oracle SQL/PL-SQL.
  • Experience with data models, data mining, data analysis and data profiling.
  • Experience in working with REST API's.
  • Experience in workload automation tools like Control-M, Autosys etc.
  • Good knowledge in CI/CD DevOps process and tools like Bitbucket, GitHub, Jenkins.
  • Strong experience with Agile/SCRUM methodology.
  • Experience with other ETL tools (DataStage, Informatica, Pentaho, etc.).
  • Knowledge in MDM, Data warehouse and Data Analytics.

Skills

Python
PySpark
AWS
SQL
Unix scripting
CI/CD
REST APIs
ETL tools
Data modeling
Data warehousing
Agile/SCRUM
Batch processing

Tools

Glue
Lambda
MSK
S3
Step Functions
RDS
EKS
Control-M
Autosys
Bitbucket
GitHub
Jenkins
DataStage
Informatica
Pentaho

Job description

Job Title: Data Engineer Location: Charlotte, NC

Job Description:

The primary role of the Data Engineer is to function as a critical member of a data team by designing data integration solutions that deliver business value in line with the company’s objectives. They are responsible for the design and development of data/batch processing, data manipulation, data mining, and data extraction/transformation/loading into large data domains using Python/Pyspark and AWS tools.

Skills and Knowledge:
  • Developer experience specifically focusing on Data Engineering.
  • Hands-on experience in Development using Python and Pyspark as an ETL tool.
  • Experience in AWS services like Glue, Lambda, MSK (Kafka), S3, Step functions, RDS, EKS etc.
  • Experience in Databases like Postgres, SQL Server, Oracle, Sybase etc.
  • Experience with SQL database programming, SQL performance tuning, relational model analysis, queries, stored procedures, views, functions, and triggers.
  • Strong technical experience in Design (Mapping specifications, HLD, LLD), Development (Coding, Unit testing).
  • Knowledge in developing UNIX scripts, Oracle SQL/PL-SQL.
  • Experience with data models, data mining, data analysis and data profiling.
  • Experience in working with REST API's.
  • Experience in workload automation tools like Control-M, Autosys etc.
  • Good knowledge in CI/CD DevOps process and tools like Bitbucket, GitHub, Jenkins.
  • Strong experience with Agile/SCRUM methodology.
  • Experience with other ETL tools (DataStage, Informatica, Pentaho, etc.).
  • Knowledge in MDM, Data warehouse and Data Analytics.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer
Data Engineer

Quantum Technologies LLC • Jersey City (NJ)

On-site
USD 120,000 - 160,000
Data Engineer
Data Engineer

Valiant Technologies LLC • Jersey City (NJ)

On-site
USD 110,000 - 150,000
Data Engineer
Data Engineer

Vein Standard Metals • United States

Remote
USD 110,000 - 160,000
Data Engineer
Data Engineer

TechDigital Group • Burbank (CA)

On-site
USD 120,000 - 150,000
DATA ENGINEER
DATA ENGINEER

Black Financial Consulting Group • Snowflake (AZ)

On-site
USD 120,000 - 160,000
Data Engineer
Data Engineer

TechDigital Group • Santa Clara (CA)

On-site
USD 90,000 - 150,000
Data Engineer
Data Engineer

Ethereum Technologies LLC • Jersey City (NJ)

On-site
USD 120,000 - 160,000
Lead Data Engineer
Lead Data Engineer

Good co India • United States

Remote
USD 120,000 - 180,000
Data Engineer
Data Engineer

Compunnel Inc. • Orlando (FL)

On-site
USD 85,000 - 110,000
Data Engineer (PySpark & Python)
Data Engineer (PySpark & Python)

Highbrow Technology Inc • Dallas (TX)

On-site
USD 140,000 - 200,000