This site uses cookies. To find out more, see our Cookies Policy

Hadoop Engineer - Senior in Pasadena, CA at APEX Systems

Date Posted: 1/12/2019

Job Snapshot

Job Description

Job #:  920811

 

 

Title: Sr. Hadoop Engineer

Client:Large Healthcare Company

Duration: 4 months C2H - (**this position will convert to FTE so candidate must be able to work on a W2)

Location: Los Angeles, CA 

Education: High School Degree
 

Experience: 5+ years of experience

 

Job Description:

Provide thought leadership around Hadoop ecosystem and data warehouse including end-to-end solution architecture. Evaluate & recommend tools related to on-premises & cloud implementations of Big Data platform with Cloudera/Hortonworks. Provide guidance on the creation and best practices around Data Governance, Data Stewardship and overall Data Quality initiatives and processes as part of the overall data effort. Responsible for setting standards, perform code review of code developed using MapReduce, Hive, Sqoop, Oozie, Spark, InformaticaBDM, and Kafka etc. Work side by side with developers in troubleshooting and fixing code including writing code from time-to-time. Recommend data model that is optimum for Big Data technologies from performance perspective and expertise on data quality software, such as ERWin, Trifecta or Informatica BDQ.

 

Day-to-Day:

  • Provide thought leadership around Hadoop ecosystem and data warehouse design by leveraging past experience and current Hadoop ecosystem, data warehouse and healthcare industry trends
  • Provide guidance on the creation and best practices around Data Governance, Data Stewardship and overall Data Quality initiatives and processes as part of the overall data effort
  • Create architecture and design documents, and provide guidance on creating other technical and process related documents
  • Work with Solution Consults, development team, business and VP to communicate architecture and future roadmap
  • Provide technical guidance to development team on performance improvements, best practices, help in resolving issues etc.  

 

Requirements:

  • 5 or more years of hands-on experience with Hadoop technologies like MapReduce, Hive, Sqoop, Oozie, Spark, InformaticaBDM, and Kafka etc
  • 4-5+ years of experience architecting solutions in on-premises & cloud implementations of Big Data platform with Cloudera/Hortonworks
  • 5+ years of hands-on experience in data warehousing, data transformation, metadata and reference data management and business intelligence tools in Linux/Unix experience
  • 3 or more years of experience with end-to-end solution architecture for data including data modeling (logical and physical data models), architecture, processes and controls, and reporting support including tools such as ERWin, Trifecta or Informatica BDQ.
  • 5+ years of experience with ELT/ETL development, patterns and tooling.

 

Preferred Requirements:

  • Understanding of best practices for building Data Lake and analytical architectures on Hadoop.
  • 2+ years of experience in real time and batch data ingestion
  • Very good working knowledge of HBASE/Kudu/Splice Machine
  • Working knowledge with advanced analytic tools such as Python/Scala, R and SAS/Tableau, and machine learning (desirable)
  • Experience implementing Hadoop technology in Healthcare preferred (desirable)

Soft Skills:

  • Communication with executives
  • Guiding technical team without making them feel bad about their work

 

 

 

 

 

 

 

 

EEO Employer

Apex is an Equal Employment Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, age, sexual orientation, gender identity, national origin, disability, protected veteran status, or any other characteristic protected by law. Apex will consider qualified applicants with criminal histories in a manner consistent with the requirements of applicable law. If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation in using our website for a search or application, please contact our Employee Services Department at 844-463-6178