parkour.io.dval documentation
->DVal
(->DVal value form)
Positional factory function for class parkour.io.dval.DVal.
copy-dval
(copy-dval readv sources)
(copy-dval readv params sources)
Like `load-dval`, but first copy `sources` to transient locations.
dcpath
(dcpath path)
Distributed-cache–able instance of `path`. When serialized into a job
configuration, adds `path` to the distributed cache. When deserialized from a
job configuration, reconstitutes as the cache path when available and as the
original remote path when not (i.e. under local- or mixed-mode job execution).
dseq
(dseq nper dval)
Distributed sequence over a sequence dval. The dval will be deserialized in
each map task and a range of the sequence records used as the task input. Each
task will receive `nper` values, the final task receiving fewer if the length of
the number of values is not evenly divisible by `nper`.
dval
(dval readv & args)
Return a dval which acts as a delay over applying var `readv` to `args`.
edn-dval
(edn-dval value)
EDN-serialize `value` to a transient location and yield a wrapping dval.
eval
(eval dval)
Evaluate `dval` form, recomputing value each time.
jser-dval
(jser-dval value)
Java-serialize `value` to a transient location and yield a wrapping dval.
load-dval
(load-dval readv sources)
(load-dval readv params sources)
Return a delay-like dval which will realize by applying var `readv` to the
concatenation of `params` and `sources` locally and distributed copies of
`sources` remotely.
parkour.io.dval.proxy$org.apache.hadoop.fs.Path$IObj$82d48561
transient-dval
(transient-dval writef readv value)
Serialize `value` to a transient location by calling `writef` with the path
and `value`. Return a dval which locally holds `value` and remotely will
deserialize by calling var `readv` with a distributed copy of the transient
serialization path.
value-dval
(value-dval value readv & args)
Return a dval which locally holds `value` and remotely will deserialize as a
delay over applying var `readv` to `args`.