Data Engineer

Ampcus, Inc; Reston (VA); On-site; USD 100,000 - 120,000; Full time

Job summary

Ampcus, Inc is seeking a Data Engineer in Reston, VA. The successful candidate will work on orchestrating and maintaining data solutions, focusing on cloud or on-premise infrastructure targeting big data.

Critical responsibilities include designing data pipelines using Ab Initio and working with various data models. Ideal candidates should have significant expertise in ETL processes and a strong IT background, particularly with Hadoop and cloud database technologies.

Ampcus promotes an inclusive workplace, valuing diversity in applicants.

Qualifications

• 10 years of IT experience in Data Integration/Data Warehouse.
• 5 years of ETL design and development experience using Ab Initio.
• 1-2 years of experience on Hadoop platform projects.

Responsibilities

• Gather data requirements with Business Analysts and Product team.
• Design and build Abinitio data graphs and pipelines.
• Transform data for various application uses.

Skills

ETL Design and Development

Ab Initio

Hadoop

SQL

Unix/Linux shell scripting

Agile Development

Education

Bachelor's Degree in Computer Science, IT, or Engineering

Tools

HDFS

Hive

Impala

AWS S3

AWS Redshift

Job description

Ampcus Inc. is a certified global provider of a broad range of Technology and Business consulting services. We are in search of a highly motivated candidate to join our talented Team.

Job Title: Data Engineer

Location: Reston, VA.

Job Description

The Senior Data Engineer is responsible for orchestrating, deploying, maintaining and scaling cloud or on-premise infrastructure targeting big data and platform data management (Relational and NoSQL, distributed and converged) with emphasis on reliability, automation and performance. This role will focus on developing solutions and helping transform the company's platforms to deliver data-driven, meaningful insights and value to the company.

Essential Functions

• Work with Business Analysts and Product team to gather data requirements.
• Design and Build Abinitio data graphs and data pipelines to extract the data from various databases/flat files/message queues.
• Transform the data to create a consumable data layer for various application uses.
• Support Data pipeline with bug fixes, and additional enhancements.
• Document Technical design, Operational Runbook etc.

Qualifications

To perform this job successfully, an individual must be able to perform each essential duty satisfactorily. The requirements listed below are representative of the knowledge, skill, and/or ability required.

• Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.

Education Level

• Bachelor's Degree.

Education Details

• Computer Science, Information Technology or Engineering or related field.

Experience

• Total of 10 Years of IT Experience predominantly in Data Integration/Data Warehouse area.
• Must have at least 5 years of ETL Design and Development experience using Ab Initio.
• 1-2 years of Data Integration project experience on Hadoop Platform, preferably Cloudera.
• Abinitio CDC (Change Data Capture) experience in a Data Integration/ETL project setting is great to have.
• Working knowledge of HDFS, Hive, Impala and other related Hadoop technologies.
• Abinitio integration with AWS S3 and Redshift and/or other AWS database services.
• Sound understanding of SQL and ability to write well-performing SQL queries.
• Good knowledge of OLTP and OLAP data models and other data warehouse fundamentals.
• Rigor in high code quality, automated testing, and other engineering best practices, ability to write reusable code components.
• Ability to unit test the code thoroughly and to troubleshoot issues in production environments.
• Must have some working experience with Unix/Linux shell scripting.
• Must be able to work independently and support other junior developers as needed.
• Some Java development experience is nice to have.
• Knowledge of Agile Development practices is required.

Ampcus is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, protected veterans or individuals with disabilities.