cwpearson/suitesparse-downloader
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

readme

Browse Source
This commit is contained in:
Carl Pearson
2021-11-29 07:52:27 -08:00
parent 685b39a7c1
commit 84bdee85ce
1 changed files with 13 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files

16
README.md
View File

@@ -14,10 +14,20 @@ poetry run python list.py
poetry run python download.py <dataset name>
```
## Notes
To download all datasets
```
poetry run python download.py all
```
ssgetpy does not discriminate "real" datatype from "integer".
Therefore, we have to do some filtering on the returned results.
## What it does
Downloads subsets of the suitesparse collection to different directories.
For a given subset, the matrices are first downloaded to the `$SCRATCH/suitesparse` folder. If a required matrix already exists there, it is not redownloaded.
Then, a relative symlink is created from the `$SCRATCH/<subset>/<matrix>.mtx` file to the corresponding `.mtx` file in `$SCRATCH/suitesparse`.
This makes use of a [fork of the `ssgetpy`](github.com/cwpearson/ssgetpy) package with a faster download limit.
ssgetpy does not discriminate "real" datatype from "integer" datatype, as shown on the suitesparse collection website.
Therefore, `lists.py` maintains a manually-curated list of `integer` datatype matrices to facilitate discrimination.
## how this was done