Skip to content

Columnar serialization#733

Merged
frankmcsherry merged 10 commits intoTimelyDataflow:master-nextfrom
frankmcsherry:columnar_serialization
Apr 30, 2026
Merged

Columnar serialization#733
frankmcsherry merged 10 commits intoTimelyDataflow:master-nextfrom
frankmcsherry:columnar_serialization

Conversation

@frankmcsherry
Copy link
Copy Markdown
Member

Support for columnar::Stash backed serialization for the Updates type in the columnar module.

The commits tell the story, but it's about swapping Stash<Lists> in place for Lists, which is an enum that allows the typed Lists or [u8] backing that can be zero-copy decoded and used as a Lists::Borrowed<'_>. The work first introduces a bit of discipline around typed data vs views (borrowed data) vs stash-backed data. The final commit introduces the serialization itself.

@frankmcsherry frankmcsherry merged commit 778e1d0 into TimelyDataflow:master-next Apr 30, 2026
6 checks passed
@frankmcsherry frankmcsherry deleted the columnar_serialization branch April 30, 2026 01:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant