DATA ENGINEER/BIG DATA DEVELOPER in Hi-Tech company at Tel-Aviv

• Create and maintain optimal data pipeline architecture
• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using ‘big data’ technologies.
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
• Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.

Qualifications

•2+ years of experience building and optimizing Big Data pipelines
oAdvanced knowledge of Cloudera / Spark / Hadoop / Sqoop / Flume
• 2+ years of experience working with Python/Scala
• Working with NoSQL databases
* Full time job