Data Engineer

Dollar General Corporation; Goodlettsville (TN); On-site; USD 90,000 - 120,000; Full time

Job summary

Dollar General Corporation in Goodlettsville, TN is seeking a Data Engineer to enhance data infrastructure and processes. Candidates should have strong SQL skills and familiarity with programming languages like Java and Python. A degree in Computer Science or a related field is necessary.

Responsibilities include building data pipelines and analytics tools while improving existing processes. Ideal candidates will have experience with both relational SQL and NoSQL databases as well as cloud platforms like Snowflake or Azure.

Qualifications

• Degree in information technology or computer science with additional vendor-specific certification.
• 4+ years of experience in Python or Java development.
• 4+ years of SQL experience.
• Experience with schema design and dimensional data modeling.

Responsibilities

• Assemble large, complex data sets that meet functional/non-functional business requirements.
• Identify, design, and implement internal process improvements.
• Build analytics tools that utilize data pipelines for actionable insights.

Skills

Intermediate SQL skills

Programming languages: Java and Python

Data analysis and numerical skills

Experience with big data tools: Hadoop, Spark

Experience with relational SQL and NoSQL databases

Education

BS or MS degree in Computer Science

Data engineering certification

Tools

Snowflake/Azure cloud services

Data pipeline tools: Airflow, Azkaban

Job description

Duties & Responsibilities

• Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
• Assemble large, complex data sets that meet functional / non-functional business requirements.
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and cloud technologies.
• Build analytics tools that utilize the data pipelines to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
• Work with stakeholders including the Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.

Knowledge, Skills and Abilities (KSAs)

• Knowledge of programming languages (e.g. Java and Python)
• Hands-on experience with SQL database design
• Great numerical and analytical skills
• Degree in Computer Science, IT, or similar field; a Master’s is a plus
• Data engineering certification (e.g IBM Certified Data Engineer) is a plus
• Experience with big data tools: Hadoop, Spark, Kafka, etc.
• Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.
• Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
• Experience with Snowflake/Azure cloud services: EC2, EMR, RDS, Redshift
• Experience with stream-processing systems: Storm, Spark-Streaming, etc.
• Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc

Qualifications

• Degree in information technology or computer science with additional vendor-specific certification.
• BS or MS degree in Computer Science or a related technical field
• 4+ years of Python or Java development experience
• 4+ years of SQL experience (No-SQL experience is a plus)
• 4+ years of experience with schema design and dimensional data modeling
• Ability in managing and communicating data warehouse plans to internal clients
• Experience designing, building, and maintaining data processing systems
• Experience working with a cloud platform such as Snowflake / Azure or Databricks