The Linux Foundation | 27 August 2018
Contributed by Baidu and Tencent, new projects accelerate machine learning, artificial intelligence and deep learning innovation and opportunity
SAN FRANCISCO and RIO DE JANEIRO (VLDB 2018) – August 27, 2018 – The LF Deep Learning Foundation, a community umbrella project of The Linux Foundation that supports and sustains open source innovation in artificial intelligence, machine learning, and deep learning, announces that two additional projects have been accepted into the foundation: the Angel Project and the EDL Project. The LF Deep Learning Foundation is focused on building an ecosystem of AI, deep learning and machine learning projects, and today’s announcement represents a significant milestone toward achieving this vision.
The new LF Deep Learning Foundation includes the Acumos AI platform and open source framework that makes it easy to build, share and deploy AI apps. With these two new projects, the Foundation adds technology finely tuned for big data and deep learning via clusters with Baidu’s PaddlePaddle and Kubernetes container orchestration.
Angel Project Background
The Angel Project is a high-performance distributed machine learning platform based on Parameter Server, running on YARN and Apache Spark. It is tuned for performance with big data and provides advantages in handling higher dimension models. It supports big and complex models with billions of parameters, partitions parameters of complex models into multiple parameter-server nodes and implements a variety of machine learning algorithms using efficient model-updating interfaces and functions, as well as flexible consistency models for synchronization.
Contributed to the LF Deep Learning Foundation by member Tencent, the project currently has more than 1,000 commits and is licensed under Apache-2.0.
“Angel shares a common goal with the LF Deep Learning Foundation: to make deep learning easier to use. By becoming a part of the LF Deep Learning Foundation, we believe Angel will be more active in the open source community, accumulate more use cases, expand usage scenarios and actively cooperate with other partners,” said Xiaolong Zhu, Tencent senior AI researcher and TAC member of the LF Deep Learning Foundation. “As a new project under the Foundation, Angel will continue working on a consistent and continuous user experience to make deep learning technology easier to apply and develop.”
The system is designed for efficient iteration computation, so that machine learning algorithms can benefit from it. Algorithms in Angel are out-of-the-box so analysts and data scientists can submit jobs without writing a single line code.
EDL Project Background
EDL is an Elastic Deep Learning framework designed to help deep learning cloud service providers to build cluster cloud services using deep learning frameworks such as PaddlePaddle and TensorFlow.
EDL includes a Kubernetes controller, PaddlePaddle auto-scaler, which changes the number of processes of distributed jobs to the idle hardware resource in the cluster, and a new fault-tolerable architecture.
Contributed by member Baidu, the project currently has nearly 1,000 commits and uses the Apache-2.0 license.
“We are excited to see that EDL has been accepted to LF Deep Learning Foundation,” said Yanjun Ma, Head of Deep Learning Technology Department, Baidu. “As an elastic deep learning framework for PaddlePaddle, we believe that EDL will substantially benefit the deployment of large-scale deep learning services, and the broader deep learning open source community.”
Organizations interested in contributing projects and learning more about LF Deep Learning Foundation, can go to www.deeplearningfoundation.org.
About LF Deep Learning
The LF Deep Learning Foundation, a Linux Foundation project, accelerates and sustains the growth of artificial intelligence, machine learning and deep learning open source projects. The initiative’s Acumos AI Project is a platform and open source framework that makes it easy to build, share and deploy AI models. Backed by many of the world’s largest technology leaders, LF Deep Learning is a neutral space for harmonization and ecosystem engagement to advance AI, DL and ML innovation. To get involved with the LF Deep Learning Foundation, please visit https://www.deeplearningfoundation.org.
About The Linux Foundation
The Linux Foundation is the organization of choice for the world’s top developers and companies to build ecosystems that accelerate open technology development and industry adoption. Together with the worldwide open source community, it is solving the hardest technology problems by creating the largest shared technology investment in history. Founded in 2000, The Linux Foundation today provides tools, training and events to scale any open source project, which together deliver an economic impact not achievable by any one company. More information can be found at www.linuxfoundation.org.
# # #
The Linux Foundation has registered trademarks and uses trademarks. For a list of trademarks of The Linux Foundation, please see our trademark usage page: https://www.linuxfoundation.org/trademark-usage. Linux is a registered trademark of Linus Torvalds.