PyF core modules | PyF, flow-based python programming PyF core modules

PyF core modules

The core PyF modules are organised in seven packages.

pyf.dataflow Dataflow Core

This is the core package for flow-based programming, it contains the building blocks for pyf.manager, pyf.componentized and pyf.services.

pyf.manager Data Manager

It contains managers to handle flow networks or paths.

Basically, you can write data networks using pure code with it, getting a lot of helpers.

pyf.splitter Low-Level Data Splitter

This is a low-level utility library used to split input flows and store them in buckets on the filesystem.

pyf.station Data-flow ip transport

PyF.Station is a protocol with client and server to transfer python generators accross tcp networks.