micropelago/garage
3
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
1,303 Commits 25 Branches 62 Tags 26 MiB
e645bbd3ce
Commit Graph

1303 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Alex Auvolat
e645bbd3ce smoke test: add multipart upload test with part re-upload 2023-06-09 16:23:37 +02:00
Alex Auvolat
58563ed700 Add multipart upload using aws s3api 2023-06-09 16:23:37 +02:00
Alex Auvolat
a6cc563bdd UploadPart: automatic cleanup of version (and reference blocked) when interrupted 2023-06-09 16:23:37 +02:00
Alex Auvolat
c14d3735e5 Add test for multipart uploads and fix part renumbering 2023-06-09 16:23:37 +02:00
Alex Auvolat
53bf2f070c undo sort_key() returning Cow 2023-06-09 16:23:37 +02:00
Alex Auvolat
412ab77b08 comments and clippy lint fixes 2023-06-09 16:23:37 +02:00
Alex Auvolat
511e07ecd4 fix mpu counter (add missing workers) and report info at appropriate places 2023-06-09 16:23:37 +02:00
Alex Auvolat
4ea53dc759 Add multipart upload repair 2023-06-09 16:23:37 +02:00
Alex Auvolat
058518c22b refactor repair workers with a trait 2023-06-09 16:23:37 +02:00
Alex Auvolat
8644376ac2 fix test; simplify code 2023-06-09 16:23:37 +02:00
Alex Auvolat
7ad7dae5d4 fix s3 list test 2023-06-09 16:23:37 +02:00
Alex Auvolat
75a0e01372 fix online repair 2023-06-09 16:23:37 +02:00
Alex Auvolat
bb176ebcb8 cargo fmt 2023-06-09 16:23:37 +02:00
Alex Auvolat
c1e1764f17 move git-version dependency to main crate to reduce rebuilds 2023-06-09 16:23:37 +02:00
Alex Auvolat
87be8eeb93 updaet block admin for new multipartupload models 2023-06-09 16:23:37 +02:00
Alex Auvolat
82e75c0e29 Adapt S3 API code to use new multipart upload models 
- Create and PutPart
- completemultipartupload
- upload part copy
- list_parts
 2023-06-09 16:23:37 +02:00
Alex Auvolat
38d6ac4295 New multipart upload table layout 2023-06-09 16:23:37 +02:00
Alex Auvolat
6005491cd8 Use Cow<[u8]> for sort keys 2023-06-09 16:23:37 +02:00
Alex Auvolat
ea3bfd2ab1 Minio tests for multipart upload behaviour: 
- upload part renumbering test
- part skipping test
 2023-06-09 16:23:37 +02:00
Alex Auvolat
e7e164a280 Make fsync an option for meta and data 2023-06-09 16:23:21 +02:00
Alex Auvolat
1e466b11eb Revert integration tests to using Sled as LMDB causes failures 2023-06-09 13:23:08 +02:00
Alex Auvolat
865f0c7d0c Add LMDB to debug builds 2023-06-09 12:04:28 +02:00
Alex Auvolat
906fe78b24 Integration tests: print logs when fails 2023-06-09 12:03:44 +02:00
Alex Auvolat
8a74e1c2bd Split garage/admin.rs into smaller files 2023-06-06 15:39:15 +02:00
Alex Auvolat
19639705e6 Mark sled as deprecated, make lmdb default, and improve sqlite and lmdb defaults 2023-05-17 14:30:53 +02:00
Alex Auvolat
351d734e6c Merge branch 'main' into next 2023-05-09 12:40:08 +02:00
Alex
b925f53dc3 Merge pull request 'move git-version dependency to main crate to reduce rebuilds' (#568) from move-git-version into main 
Reviewed-on: https://git.deuxfleurs.fr/Deuxfleurs/garage/pulls/568
 2023-05-09 09:53:33 +00:00
Alex
2f495575d8 Merge pull request 'block/manager.rs: Prioritize raw blocks when no compression configured' (#566) from jpds/garage:skip-compressed-blocks-scrub-no-compression into main 
Reviewed-on: https://git.deuxfleurs.fr/Deuxfleurs/garage/pulls/566
 2023-05-09 09:39:48 +00:00
Alex Auvolat
9e0a9c1c15 move git-version dependency to main crate to reduce rebuilds 2023-05-09 11:35:32 +02:00
Jonathan Davies
9c788059e2 block/manager.rs: In is_block_compressed - check which compression_level 
is configured on a node and check for raw block first if compression is
disabled (to help reduce syscalls during a scrub).
 2023-05-09 10:28:19 +01:00
Alex
5684e1990c Merge pull request 'Really allow to disable sled feature' (#563) from jirutka/garage:workspace-deps into main 
Reviewed-on: https://git.deuxfleurs.fr/Deuxfleurs/garage/pulls/563
 2023-05-09 09:08:35 +00:00
Alex
14c50f2f84 Merge pull request 'Fix undefined macro warn! on 32-bit' (#562) from jirutka/garage:fix-undefined-warn into main 
Reviewed-on: https://git.deuxfleurs.fr/Deuxfleurs/garage/pulls/562
 2023-05-09 08:52:11 +00:00
Alex
0fab9c3b8c Merge pull request 'Helm: Include newer config parameters as values' (#565) from jonatan/garage:main into main 
Reviewed-on: https://git.deuxfleurs.fr/Deuxfleurs/garage/pulls/565
 2023-05-09 08:49:00 +00:00
Jakub Jirutka
75759a163c Allow to really disable sled feature 2023-05-09 08:46:15 +00:00
Jakub Jirutka
d2deee0b8b Declare garage crates using workspace.dependencies 
This will allow to really disable "sled" feature without declaring
`default-features = false` in every Cargo.toml where garage_db and
garage_model is used.

See https://doc.rust-lang.org/cargo/reference/workspaces.html#the-dependencies-table
 2023-05-09 08:46:15 +00:00
Alex
8499cd5c21 Merge pull request 'Remove unnecessary/unused "timeago" features' (#559) from jirutka/garage:timeago-features into main 
Reviewed-on: https://git.deuxfleurs.fr/Deuxfleurs/garage/pulls/559
 2023-05-09 08:44:22 +00:00
Jonatan Steuernagel
4ea7983093
Helm: Increment patch version 2023-05-08 08:03:21 +02:00
Jonatan Steuernagel
d5e39d11eb
Helm: Include newer config parameters as values 
Add all missing parameters from the reference manual.
Primarily to enable the use of the new lmdb engine
 2023-05-08 07:47:31 +02:00
Jakub Jirutka
6d3ace1ea9 Fix undefined macro warn! on 32-bit 
Compiling garage_db v0.8.2 (garage-0.8.2/src/db)
    error: cannot find macro `warn` in this scope
       --> src/db/lmdb_adapter.rs:352:2
        |
    352 |     warn!("LMDB is not recommended on 32-bit systems, database size will be limited");
        |     ^^^^
        |
        = help: consider importing this macro:
                tracing::warn
        = note: `warn` is in scope, but it is an attribute: `#[warn]`
    error: could not compile `garage_db` due to previous error
 2023-05-07 17:01:44 +02:00
Jakub Jirutka
833cf082da Remove unnecessary/unused "timeago" features 
To decrease dependency bloat and binary size.
 2023-05-07 01:03:54 +02:00
Alex Auvolat
a1fcf1b175 Merge branch 'main' into next 2023-04-25 16:58:57 +02:00
Alex
1ecd88c01f Merge pull request 'Update rust toolchain to 1.68 and simplify Nix stuff' (#554) from nix-update-simplify into main 
Reviewed-on: https://git.deuxfleurs.fr/Deuxfleurs/garage/pulls/554
 2023-04-25 14:56:49 +00:00
Alex Auvolat
5efcdc0de3 Update rust toolchain to 1.68 and simplify Nix stuff 2023-04-25 14:46:47 +02:00
Alex Auvolat
fa78d806e3 Merge branch 'main' into next 2023-04-25 12:34:26 +02:00
Alex
a16eb7e4b8 Merge pull request 'api/Cargo.toml: Bumped quick-xml to version 0.26.' (#552) from jpds/garage:quick-xml-0.26 into main 
Reviewed-on: https://git.deuxfleurs.fr/Deuxfleurs/garage/pulls/552
 2023-04-24 09:00:00 +00:00
Alex
6742070517 Merge pull request 'block/repair.rs: Added log entries for scrub start/finish.' (#551) from jpds/garage:scrub-log into main 
Reviewed-on: https://git.deuxfleurs.fr/Deuxfleurs/garage/pulls/551
 2023-04-24 08:29:36 +00:00
Alex Auvolat
6894878146 update cargo.nix 2023-04-24 10:26:14 +02:00
Alex
02b0ba5f44 Merge pull request 'cookbook/real-world: fix typo' (#549) from yuka/garage:main into main 
Reviewed-on: https://git.deuxfleurs.fr/Deuxfleurs/garage/pulls/549
 2023-04-24 08:24:55 +00:00
Jonathan Davies
fb3bd11dce block/repair.rs: Added log entries for scrub start/finish. 2023-04-23 22:22:26 +01:00
Jonathan Davies
c168383113 api/Cargo.toml: Bumped quick-xml to version 0.26. 2023-04-23 20:14:28 +01:00