Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add zstd compression support to Barman Cloud #898

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

Jellyfrog
Copy link

@Jellyfrog Jellyfrog commented Feb 8, 2024

This implements zstandard support to Barman cloud

Quick benchmark (from my laptop over internet to S3) shows it's the fastest and second smallest size:

Type Size Time
bz2 187.7 MB 81,26s
gz 250.5 MB 137,36s
snappy 398.1 MB 8,41s
tar 945.9 MB 9,05s
zstd 242.2 MB 8,24s

Fixes #850

@Jellyfrog
Copy link
Author

Jellyfrog commented Feb 8, 2024

I'll leave this in draft until I tested it more

Tested backup and restore with basebackup and Wal files.

@Jellyfrog Jellyfrog marked this pull request as ready for review February 9, 2024 18:15
@Jellyfrog
Copy link
Author

Ping @martinmarques

@martinmarques
Copy link
Contributor

Ping @martinmarques

A little patience, we have some deadlines with products, but this is on our radar and we do want to fully analyse this with the CNPG team.

More later.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[feature] add Zstd support to cloud cli tools
2 participants