Skip to content

example raster compression using Vortex#7708

Draft
a10y wants to merge 1 commit intodevelopfrom
aduffy/raster-example
Draft

example raster compression using Vortex#7708
a10y wants to merge 1 commit intodevelopfrom
aduffy/raster-example

Conversation

@a10y
Copy link
Copy Markdown
Contributor

@a10y a10y commented Apr 28, 2026

Just an experiment for now. Idea being, why not store raster data in Vortex.

I've run some local benchmarks extracting crops out of a local GeoTIFF.

Vortex wins by a wide margin, but it's kind of cheating because

  • The raster data doesn't get compressed at all (even with Compact compressor)
  • TIFF access is dominated by the DEFLATE overhead
Screenshot 2026-04-28 at 15 10 01

Next steps

  • Find compressor scheme that works for raster tiles, which are List<u8>
  • Benchmark E2E inference pipeline VS rasterio + torch

Signed-off-by: Andrew Duffy <andrew@a10y.dev>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant