Epic: Lazy & Iterative Execution

[joseph-isaacs]

The idea of this work is to move vortex towards a deferred-iterative execution model.

Deferred

We build arrays as physical query plans with late buffer binding and then execute these towards a decompressed form.

Iterative

Go from a recursive execute using the call stack to a explicit cps-like execution model.

Goals

• Efficient deferred execution
• A simple model for deferred execution
• Efficient iterative execution
• A simple model for iterative execute

Details

TODO

Progress

Deferred

• Deferred execution system
• Remove the last usage of buffers from many arrays/encodings
• Expose a ExecutionCtx to all methods that access buffers

Iterative

• Iterative execution system
• ExecuteStep
• AppendToBuilder
  • ExecutionStep::AppendToBuilder[+] https://github.com/vortex-data/vortex/pull/7600[/+]
  • Append to builder iterative execution kernels

Optimize

• Remove usage of type_id and downcast
• Use Array id where possible.

[connortsui20]

Whoops codex decided to edit this issue directly, so I just cleaned it up myself. @joseph-isaacs lmk if anything needs to be fixed above

[joseph-isaacs]

Reverted