Lead Data Engineer in Chicago, IL at APEX Systems

Date Posted: 11/7/2019

Job Snapshot

Job Description

Job #:  1015803
 
Lead Data Engineer
Downtown Chicago
6+ Month Contract
 
What you’ll do
As a data engineer, we develop strategies and solutions to ingest, store and distribute our big data. Our engineers use Big Data tools such as, but not limited to, Scala, Hadoop, Spark, Pyspark, Hive, JSON, and SQL in 10 week long scrum teams to developer the products, tools and features.
 
Responsibilities
Take ownership of features and drive them to completion through all phases of the entire 84.51° SDLC.  This includes external facing and internal applications as well as process improvement activities such as:
  • Lead design of Hadoop and SQL based solutions
  • Perform development of Hadoop and SQL based solutions
  • Perform unit and integration testing
  • Collaborate with senior resources to ensure consistent development practices
  • Provide mentoring to junior resources
  • Participate in retrospective reviews
  • Participate in the estimation process for new work and releases
  • Bring new perspectives to problems
  • Be driven to improve yourself and the way things are done

 
Requirements
  • Bachelor’s degree (typically in Computer Science, Management Information Systems, Mathematics, Business Analytics or another technically strong program) plus 5 years of experience or Master’s degree (typically in Computer Science, Management Information Systems, Mathematics, Business Analytics or another technically strong program) and 3 years experience.
  • Solid experience with Big Data tools to include but not limited to, Scala, Hadoop, Spark, Pyspark, and Hive
  • Strong understanding of Agile Principles (Scrum)
  • Proficient with relational data modeling
  • Proven ability of developing with SQL (Oracle, SQLServer)
  • Proven ability of developing with Hadoop/HDFS
  • Full understanding of ETL concepts
  • Full understanding of data warehousing concepts
  • Exposure to VCS (Git, SVN)
  • Solid experience developing with either Java, Scala or Python

 
Preferred Skills – Experience in the following
  • Exposure to NoSQL (Mongo, Cassandra)
  • SOA
  • Junit
  • CI/CD