Home

Awesome

Reproducibility Repository for ORBITS <img img align="center" width="50" height="50" src="orbits_logo.png">

<!-- <sup>*</sup>disabled by default as it takes a couple of days to run. The online scenarios are described [here](https://github.com/eXascaleInfolab/orbits/blob/master/TestingFramework/bin/Debug/results/plotfiles/streaming_end.txt) while the batch scenarios are described [here](https://github.com/eXascaleInfolab/orbits/blob/master/TestingFramework/bin/Debug/results/plotfiles/batch_mid.txt). -->

Prerequisites | Build | Execution | Citation

Prerequisites

Build

    $ sh install_linux.sh
<!-- - Download the full Soccer data for Fig 12 ```bash wget --load-cookies /tmp/cookies.txt "https://docs.google.com/uc?export=download&confirm=$(wget --quiet --save-cookies /tmp/cookies.txt --keep-session-cookies --no-check-certificate 'https://docs.google.com/uc?export=download&id=1MlX_3OF3zKLKocFKVWYK5yBOfXHTaDBW' -O- | sed -rn 's/.*confirm=([0-9A-Za-z_]+).*/\1\n/p')&id=1MlX_3OF3zKLKocFKVWYK5yBOfXHTaDBW" -O soccer_full_normal.txt && rm -rf /tmp/cookies.txt ``` 1. Download the following zip file from https://drive.switch.ch/index.php/s/sJ7d5uunzIq3fKY 2. Extract `soccer_full_normal.txt` into `TestingFramework/bin/Debug/data/soccer_full/`. - Results of Figure 13 in the Soccer dataset (takes ~XXX days) ```bash $ cd TestingFramework/bin/Debug/ $ sh repro_extra_ssv.sh ``` -->

Execution

  1. The results and plots of all techniques, except MRNN, can be obtained by running the following script (takes ~3 days):
    $ cd TestingFramework/bin/Debug/
    $ sh repro.sh

  1. The results of MRNN can be obtained by running the following script (takes 2-7 days, depending on the machine):

     $ cd TestingFramework/bin/Debug/
     $ sh repro_extra_mrnn.sh
  1. The runtime results of ssv (Fig 13a and 13b: Soccer dataset) take a considerable amount of time and are, thus, not reported. These results can be obtained by running the following script (takes ~3 days):
     $ cd TestingFramework/bin/Debug/
     $ sh repro_extra_ssv.sh

Results

Figure 5

Figure 6

Manual aggregation over mutiple results. The reproducibility of this figure is very hard to automate.

Figure 7

Figure 8

Figure 9

We compute the AVG for each technique over three runs. The absolute correlation values might be slightly different as, in each run, we randomly pick a different time series to recover.

Figure 10

Figure 11

Figure 12

Figure 13

Note: In case you run the MRNN script, the results will be added to the folder ResultsMRNN/ under the same subfolders as decribed above.

Citation

@inproceedings{orbits2021vldb,
 author    = {Mourad Khayati and Ines Arous and Zakhar Tymchenko and Philippe Cudr{\'{e}}{-}Mauroux},
 title     = {ORBITS: Online Recovery of Missing Values in Multiple Time Series Streams},
 booktitle = {Proceedings of the VLDB Endowment},
 volume    = {14},
 number    = {3},
 year      = {2021}
}