parkour.io.dseq documentation

->DSeq
(->DSeq meta step)
Positional factory function for class parkour.io.dseq.DSeq.

Source
-dseq
(-dseq this)
Return distributed sequence for `this`.

Source
DSeqable
Protocol for producing distributed sequence.

Source
dseq
(dseq obj)
Return the distributed sequence represented by dseq-able object or
job configuration step `obj`.  Result is a config step and reducible.
Source
dseq?
(dseq? x)
True iff `x` is a distributed sequence.

Source
input-format
(input-format job)
Input format class for `job`, or `nil` if unspecified.

Source
input-path-setter
(input-path-setter & paths)
Configuration step setting the input paths to `paths`

Source
input-paths
(input-paths step)
Vector of input-paths produced by job or configuration step `step`.

Source
input-paths*
(input-paths* job)
Internal implementation multimethod for `input-paths`.

Source
move!
(move! src-dseq dst-path)(move! conf src-dseq dst-path)
Move content for file-backed `src-dseq` -- which must have a single,
concrete file input path -- to `dst-path`; return new dseq.
Source
set-default-shape!
(set-default-shape! conf shape)
Set default source shape for `conf` to `shape`.

Source
source-for
(source-for dseq & {:keys [raw? shape], :or {raw? false, shape :default}})
Local source for reading tuples from `dseq`.  Must `.close` to release
resources, as via `with-open`.  If the `raw?` keyword argument is true, then the
tuple source will not automatically unwrap values.
Source