Awesome

Tensor4ML

Tensor Decomposition for Machine Learning (Tensor4ML). This article summarizes the development of tensor decomposition models and algorithms in the literature, offering comprehensive reviews and tutorials on topics ranging from matrix and tensor computations to tensor decomposition techniques across a wide range of scientific areas and applications. Since the decomposition of tensors is often formulated as an optimization problem, this article also provides a preliminary introduction to some classical methods for solving convex and nonconvex optimization problems. This work aims to offer valuable insights to both the machine learning and data science communities by drawing strong connections with the key concepts related to tensor decomposition. To ensure reproducibility and sustainability, we provide resources such as datasets and Python implementations, primarily utilizing Python’s numpy library. The content includes:

In a hurry? Please check out our contents as follows.

• Introduction
  • Tensor decomposition in the past 10-100 years
  • Tensor decomposition in the past decade
• What Are Tensors?
  • Tensors in algebra & machine learning
  • Tensors in data science
• Foundation of Tensor Computations
  • Norms
  • Matrix trace
  • Kronecker product
  • Khatri-Rao product
  • Modal product
  • Outer product
  • Derivatives
• Foundation of Optimization
  • Gradient descent methods
  • Alternating minimization
  • Alternating direction method of multipliers
  • Greedy methods for <img style="display: inline;" src="https://latex.codecogs.com/svg.latex?&space;\ell_0"/>-norm minimization
  • Bayesian optimization
  • Power iteration
  • Procrustes problems

• If you want to run the code, please
  • download (or clone) this repository,
  • open the .ipynb file using Jupyter notebook,
  • and run the code.

This repository is from the following paper.

This work is released under the MIT license. If you find these codes useful, please star (★) this repository.