Mingwei state & lattices impl roadmap

[MingweiSamuel]

Planning to keep around two impls of join, one fast dataflow-ey version, and one slow one for use with persist(). At the end they will be reunifed via optimization.

Not yet sure if the lattice types in join() will be baked-in or in user code.

flowchart TD
    persist["<tt>persist()/deltae()</tt> naïve impl"]
    opdata["parser refactor: op inst. metadata #402"]
    optimize["auto-optimize (rewrite) <tt>persist()/deltae()</tt> #347"]
    joe["joe graphwalking prop algo."]
    rewrite_api["figure out a flexible API for rewriting h.flow graphs"]
    joinstate["split up <tt>join()</tt> state into <tt>persist()</tt>, etc."]
    joinlattice["lattice types in <tt>join()</tt>"]
    joinopt["auto-optimize <tt>join()</tt> state"]

    opdata --> rewrite_api
    joe --> rewrite_api --> optimize
    persist --> optimize --> joinopt
    persist --> joinstate --> joinlattice --> joinopt

    %% david["David dedalus optimizations?"]
    %% rewrite_api --> david
    %% optimize --> david

Loading

Moved to #440

[MingweiSamuel]

#440