Data::ExampleDatasets Raku package
Raku package for (obtaining) example datasets.
Currently, this repository contains only datasets metadata.
The datasets are downloaded from the repository
Rdatasets,
[VAB1].
Usage examples
Setup
Here we load the Raku modules
Data::Generators,
Data::Summarizers,
and this module,
Data::ExampleDatasets:
use Data::Reshapers;
use Data::Summarizers;
use Data::ExampleDatasets;
# (Any)
Get a dataset by using an identifier
Here we get a dataset by using an identifier and display part of the obtained dataset:
my @tbl = example-dataset('Baumann', :headers);
say to-pretty-table(@tbl[^6]);
# +-----------+-----------+-------------+-------+-------------+-------------+
# | pretest.1 | pretest.2 | post.test.2 | group | post.test.3 | post.test.1 |
# +-----------+-----------+-------------+-------+-------------+-------------+
# | 4 | 3 | 4 | Basal | 41 | 5 |
# | 6 | 5 | 5 | Basal | 41 | 9 |
# | 9 | 4 | 3 | Basal | 43 | 5 |
# | 12 | 6 | 5 | Basal | 46 | 8 |
# | 16 | 5 | 9 | Basal | 46 | 10 |
# | 15 | 13 | 8 | Basal | 45 | 9 |
# +-----------+-----------+-------------+-------+-------------+-------------+
Here we summarize the dataset obtained above:
records-summary(@tbl)
# +--------------------+---------------------+-------------+--------------------+--------------------+--------------------+
# | pretest.1 | post.test.3 | group | post.test.1 | post.test.2 | pretest.2 |
# +--------------------+---------------------+-------------+--------------------+--------------------+--------------------+
# | Min => 4 | Min => 30 | Strat => 22 | Min => 1 | Min => 0 | Min => 1 |
# | 1st-Qu => 8 | 1st-Qu => 40 | DRTA => 22 | 1st-Qu => 5 | 1st-Qu => 5 | 1st-Qu => 3 |
# | Mean => 9.787879 | Mean => 44.015152 | Basal => 22 | Mean => 8.075758 | Mean => 6.712121 | Mean => 5.106061 |
# | Median => 9 | Median => 45 | | Median => 8 | Median => 6 | Median => 5 |
# | 3rd-Qu => 12 | 3rd-Qu => 49 | | 3rd-Qu => 11 | 3rd-Qu => 8 | 3rd-Qu => 6 |
# | Max => 16 | Max => 57 | | Max => 15 | Max => 13 | Max => 13 |
# +--------------------+---------------------+-------------+--------------------+--------------------+--------------------+
Remark: The values for the first argument of example-dataset correspond to the values
of the columns "Item" and "Package", respectively, in theA
metadata dataset
from the GitHub repository "Rdatasets", [VAB1].
See the datasets metadata sub-section below.
The first argument of example-dataset can take as values:
Get a dataset by using an URL
Here we get a dataset by using an URL and display a summary of the obtained dataset:
my $url = 'https://raw.githubusercontent.com/antononcube/Raku-Data-Reshapers/main/resources/dfTitanic.csv';
my @tbl2 = example-dataset($url, :headers);
records-summary(@tbl2);
# +-------------------+-----------------+----------------+---------------------+---------------+
# | passengerSurvival | id | passengerClass | passengerAge | passengerSex |
# +-------------------+-----------------+----------------+---------------------+---------------+
# | died => 809 | Min => 1 | 3rd => 709 | Min => -1 | male => 843 |
# | survived => 500 | 1st-Qu => 327.5 | 1st => 323 | 1st-Qu => 10 | female => 466 |
# | | Mean => 655 | 2nd => 277 | Mean => 23.550038 | |
# | | Median => 655 | | Median => 20 | |
# | | 3rd-Qu => 982.5 | | 3rd-Qu => 40 | |
# | | Max => 1309 | | Max => 80 | |
# +-------------------+-----------------+----------------+---------------------+---------------+
Here we:
- Get the dataset of the datasets metadata
- Filter it to have only datasets with 13 rows
- Keep only the columns "Item", "Title", "Rows", and "Cols"
- Display it in "pretty table" format
my @tblMeta = get-datasets-metadata();
@tblMeta = @tblMeta.grep({ $_<Rows> == 13}).map({ $_.grep({ $_.key (elem) <Item Title Rows Cols>}).Hash });
say to-pretty-table(@tblMeta)
# +------------+--------------------------------------------------------------------+------+------+
# | Item | Title | Rows | Cols |
# +------------+--------------------------------------------------------------------+------+------+
# | Snow.pumps | John Snow's Map and Data on the 1854 London Cholera Outbreak | 13 | 4 |
# | BCG | BCG Vaccine Data | 13 | 7 |
# | cement | Heat Evolved by Setting Cements | 13 | 5 |
# | kootenay | Waterflow Measurements of Kootenay River in Libby and Newgate | 13 | 2 |
# | Newhouse77 | Medical-Care Expenditure: A Cross-National Survey (Newhouse, 1977) | 13 | 5 |
# | Saxony | Families in Saxony | 13 | 2 |
# +------------+--------------------------------------------------------------------+------+------+
Keeping downloaded data
By default the data is obtained over the web from
Rdatasets,
but example-dataset has an option to keep the data "locally."
(The data is saved in XDG_DATA_HOME, see
[JS1].)
This can be demonstrated with the following timings of a dataset with ~1300 rows:
my $startTime = now;
my $data = example-dataset( / 'COUNT::titanic' $ / ):keep;
my $endTime = now;
say "Geting the data first time took { $endTime - $startTime } seconds";
# Geting the data first time took 1.183144061 seconds
$startTime = now;
$data = example-dataset( / 'COUNT::titanic' $/ ):keep;
$endTime = now;
say "Geting the data second time took { $endTime - $startTime } seconds";
# Geting the data second time took 0.798274359 seconds
References
Functions, packages, repositories
[AAf1] Anton Antonov,
ExampleDataset,
(2020),
Wolfram Function Repository.
[VAB1] Vincent Arel-Bundock,
Rdatasets,
(2020),
GitHub/vincentarelbundock.
[JS1] Jonathan Stowe,
XDG::BaseDirectory,
(last updated on 2021-03-31),
Raku Modules.
Interactive interfaces
[AAi1] Anton Antonov,
Example datasets recommender interface,
(2021),
Shinyapps.io.