Big Data Engineer -6711 in McLean, VA at APEX Systems

Date Posted: 11/8/2018

Job Snapshot

Job Description

Job #:  856254

ALL CANDIDATES MUST BE EITHER A US CITIZEN OR HOLD A PERMANENT RESIDENT CARD AS WELL AS BE A DIRECT W-2 EMPLOYEE TO OUR VENDORS.

Data Engineer (Nifi)

Job Description

* Responsible for delivery in the areas of: big data engineering mainly data acquisition technology implementations (Nifi & Kafka)

* Develop scalable and reliable data solutions to move data across systems from multiple sources in real time as well as batch modes ( Nifi/Kafka/ Storm)

* Construct data staging layers and fast real-time systems

* Utilize expertise in models that leverage the newest data sources, technologies, and tools, such as machine learning, Python, Hadoop, Spark, AWS, as well as other cutting-edge tools and applications for Big Data

* Investigate the impact of new technologies, applications, and data sources on the future secondary mortgage business

* Demonstrated ability to quickly learn new tools and paradigms to deploy cutting edge solutions.

* Develop both deployment architecture and scripts for automated system deployment in AWS

* Create large scale deployments using newly researched methodologies. * Work in Agile environment

* Experience mentoring junior engineers

 

Basic Qualifications

* Bachelors degree in Mathematics, Statistics, Computer Science

* 4+ years of experience with Nifi & Kafka

* 4+ years of experience with Hadoop including Hive and Spark

* At least 3 years experience in Python & PySpark

* At least 10+ years of overall experience in Java

 

Preferred Qualifications

* Masters Degree in Computer Science * 3+ years of experience working with AWS

* 2+ years of experience working with financial data

* 2+ years of experience with NoSQL databases

* Strong communication skills, with the ability to work both independently and in project teams 

 

 

 

 

 

 

 

 

EEO Employer

Apex is an Equal Employment Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, age, sexual orientation, gender identity, national origin, disability, protected veteran status, or any other characteristic protected by law. Apex will consider qualified applicants with criminal histories in a manner consistent with the requirements of applicable law. If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation in using our website for a search or application, please contact our Employee Services Department at 844-463-6178