Data Engineer

  • Full time
  • Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia View on Map
  • My Seekers posted 1 week ago
  • Posted: May 21, 2020 -Accepting applications
  • View(s) 30

Job Description

Brief Job Description :-

  • Design and develop ETL platforms on Hadoop for various business use cases which are fault-tolerant, highly distributed, and robust.
  • Taking care of the complete ETL(Extract, Transform & Load) process.
  • Work on structured, semi-structured data to put this data to business use. This will involve organizing the
  • Data (collecting, storing, processing).
  • Analyze huge sets of structured and semi-structured data for business analytics solution using cutting-edge tools and techniques.
  • Creating data models to reduce system complexity and hence increase efficiency.

Special skill / knowledge requirement :-

  1. Solid Knowledge of Operating Systems: Linux
  2. In-Depth Database Knowledge – SQL and NoSQL
  3. In-Depth Knowledge in Data Warehousing & ETL Tool– Hadoop, Map Reduce, HIVE, PIG, Apache Spark, Kafka
  4. Basic Language Requirement: Python
  5. Basic Machine Learning Familiarity

Exp: 3-5 years

 

Required skills