Apache Mahout: Machine Learning on Distributed Data ow Systems

Anil R., Capan G., Drost-Fromm I., Dunning T., Friedman E., Grant T., ...More

Journal of Machine Learning Research, vol.21, 2020 (SCI-Expanded) identifier

  • Publication Type: Article / Article
  • Volume: 21
  • Publication Date: 2020
  • Journal Name: Journal of Machine Learning Research
  • Journal Indexes: Science Citation Index Expanded (SCI-EXPANDED), Scopus, Academic Search Premier, Applied Science & Technology Source, Business Source Elite, Business Source Premier, Compendex, Computer & Applied Sciences, MathSciNet, zbMATH
  • Anadolu University Affiliated: Yes

Abstract

© 2020 Microtome Publishing. All rights reserved.Apache Mahout is a library for scalable machine learning (ML) on distributed dataow systems, offering various implementations of classification, clustering, dimensionality reduction and recommendation algorithms. Mahout was a pioneer in large-scale machine learning in 2008, when it started and targeted MapReduce, which was the predominant abstraction for scalable computing in industry at that time. Mahout has been widely used by leading web companies and is part of several commercial cloud offerings. In recent years, Mahout migrated to a general framework enabling a mix of dataow programming and linear algebraic computations on backends such as Apache Spark and Apache Flink. This design allows users to execute data preprocessing and model training in a single, unified dataow system, instead of requiring a complex integration of several specialized systems. Mahout is maintained as a community-driven open source project at the Apache Software Foundation, and is available under https://mahout.apache.org.