matter_vec-class: Out-of-Memory Vectors

In matter: A framework for rapid prototyping with file-based data structures

Description

The matter_vec class implements out-of-memory vectors.

Usage

## Instance creation
matter_vec(data, datamode = "double", paths = NULL,
            filemode = ifelse(all(file.exists(paths)), "r", "rw"),
            offset = 0, extent = length, length = 0L, names = NULL,
            chunksize = getOption("matter.default.chunksize"), ...)

## Additional methods documented below

Arguments

data	An optional data vector which will be initially written to the data in virtual memory if provided.
datamode	A 'character' vector giving the storage mode of the data in virtual memory. Allowable values are the C types ('char', 'uchar', short', 'ushort', 'int', 'uint', 'long', 'ulong', 'float') and their R equivalents ('raw', 'logical', 'integer', 'numeric'). See ?datatypes for details.
paths	A 'character' vector of the paths to the files where the data are stored. If 'NULL', then a temporary file is created using tempfile.
filemode	The read/write mode of the files where the data are stored. This should be 'r' for read-only access, or 'rw' for read/write access.
offset	A vector giving the offsets in number of bytes from the beginning of each file in 'paths', specifying the start of the data to be accessed for each file.
extent	A vector giving the length of the data for each file in 'paths', specifying the number of elements of size 'datamode' to be accessed from each file.
length	An optional number giving the total length of the data across all files, equal to the sum of 'extent'. This is ignored and calculated automatically if 'extent' is specified.
names	The names of the data elements.
chunksize	The (suggested) maximum number of elements which should be accessed at once by summary functions and linear algebra. Ignored when explicitly subsetting the dataset.
...	Additional arguments to be passed to constructor.

Value

An object of class matter_vec.

Slots

data:

This slot stores the information about locations of the data in virtual memory and within the files.

datamode:

The storage mode of the accessed data when read into R. This is a 'character' vector of with possible values 'raw', 'logical', 'integer', 'numeric', or 'virtual'.

paths:

A 'character' vector of the paths to the files where the data are stored.

filemode:

The read/write mode of the files where the data are stored. This should be 'r' for read-only access, or 'rw' for read/write access.

chunksize:

The maximum number of elements which should be loaded into memory at once. Used by methods implementing summary statistics and linear algebra. Ignored when explicitly subsetting the dataset.

length:

The length of the data.

dim:

Either 'NULL' for vectors, or an integer vector of length one of more giving the maximal indices in each dimension for matrices and arrays.

names:

The names of the data elements for vectors.

dimnames:

Either 'NULL' or the names for the dimensions. If not 'NULL', then this should be a list of character vectors of the length given by 'dim' for each dimension. This is always 'NULL' for vectors.

ops:

Delayed operations to be applied on atoms.

Extends

matter

Creating Objects

matter_vec instances can be created through matter_vec() or matter().

Methods

Standard generic methods:

x[i], x[i] <- value:

Get or set the elements of the vector.

c(x, ...):

Combine vectors.

t(x):

Transpose a vector (to a row matrix). This is a quick operation which only changes metadata and does not touch the out-of-memory data.

Author(s)

Kylie A. Bemis

See Also

matter

Examples

x <- matter_vec(1:100)
x

matter documentation built on Nov. 8, 2020, 6:15 p.m.