parkour.io.dsink documentation

->DSink

(->DSink meta dseq step)
Positional factory function for class parkour.io.dsink.DSink.

dsink

(dsink step)(dsink dseq step)
Return distributed sink represented by job configuration step `step` and
producing the distributed sequence `dseq` once generated.  Result is a config
step which returns `dseq` when called as a zero-argument function.  When `dseq`
is not provided, and `step` is not already a distributed sink, the resulting
sink produces the `nil` dseq.

dsink-dseq

(dsink-dseq step)
Force `step` to a dsink, then return its corresponding dseq.

dsink?

(dsink? x)
True iff `x` is a distributed sink.

output-paths

(output-paths step)
Vector of output-paths produced by job or configuration step `step`.

output-paths*

(output-paths* job)
Internal implementation multimethod for `output-paths`.

set-default-shape!

(set-default-shape! conf shape)
Set default sink shape for `conf` to `shape`.

sink-for

(sink-for dsink)
Local sink for writing tuples as written via `dsink`.  Must `.close` to
flush, as via `with-open`.

with-dseq

macro

(with-dseq dsink & body)
Evaluate `body` forms, write tuples from resulting collection to the local
sink produced from `dsink`, and return `dsink`'s associated dseq.

with-dseq*

(with-dseq* dsink f)
Function form of `with-dseq`.