Jonathan Davies
0f0795103d
block/Cargo.toml: Bump tokio-util to 0.7.
2023-05-09 14:33:21 +01:00
Alex
2f495575d8
Merge pull request 'block/manager.rs: Prioritize raw blocks when no compression configured' ( #566 ) from jpds/garage:skip-compressed-blocks-scrub-no-compression into main
...
Reviewed-on: https://git.deuxfleurs.fr/Deuxfleurs/garage/pulls/566
2023-05-09 09:39:48 +00:00
Jonathan Davies
9c788059e2
block/manager.rs: In is_block_compressed - check which compression_level
...
is configured on a node and check for raw block first if compression is
disabled (to help reduce syscalls during a scrub).
2023-05-09 10:28:19 +01:00
Jakub Jirutka
d2deee0b8b
Declare garage crates using workspace.dependencies
...
This will allow to really disable "sled" feature without declaring
`default-features = false` in every Cargo.toml where garage_db and
garage_model is used.
See https://doc.rust-lang.org/cargo/reference/workspaces.html#the-dependencies-table
2023-05-09 08:46:15 +00:00
Jonathan Davies
fb3bd11dce
block/repair.rs: Added log entries for scrub start/finish.
2023-04-23 22:22:26 +01:00
Alex Auvolat
0a1ddcf630
Prepare for v0.8.2
2023-03-13 18:46:31 +01:00
Jonathan Davies
d218f475cb
block/manager.rs: Set defaults for scrub_persister.
2023-03-09 17:08:47 +00:00
Jonathan Davies
7b65dd24e2
block/repair.rs: Added a timestamp argument to
...
randomize_next_scrub_run_time().
2023-03-09 16:38:41 +00:00
Jonathan Davies
b70cc0a940
block/repair.rs: Added migration for ScrubWorkerPersisted's time_next_run_scrub.
...
Fixes : #520 .
2023-03-09 16:38:36 +00:00
Jonathan Davies
148b66b843
block/manager.rs: Display scrub-next-run.
2023-03-06 13:43:09 +00:00
Jonathan Davies
53d09eb00f
block/repair.rs: Added function and time_next_run_scrub with a random element of
...
10 days to SCRUB_INTERVAL to help balance scrub load across cluster.
2023-03-06 13:43:04 +00:00
Alex Auvolat
8e93d69974
More clippy fixes
2023-01-26 17:26:32 +01:00
Jonathan Davies
20c1cdf662
Cargo.toml: Loosen tracing dependency to just 0.1.
2023-01-26 11:13:11 +00:00
Jonathan Davies
5c3075fe01
Cargo.toml: Updated zstd from 0.9 to 0.12.
2023-01-23 18:08:14 +00:00
Jonathan Davies
4cfb469d2b
block/metrics.rs: Added compression_level metric.
2023-01-10 10:40:03 +00:00
Alex
02e8eb167e
Merge pull request 'PutObject: better cleanup when request is interrupted in the middle' ( #462 ) from interrupted-cleanup into main
...
Reviewed-on: https://git.deuxfleurs.fr/Deuxfleurs/garage/pulls/462
2023-01-04 14:43:45 +00:00
Alex Auvolat
f3f27293df
Uniform framework for bg variable management
2023-01-04 13:07:13 +01:00
Alex Auvolat
936b6cb563
When saving block, delete .tmp file if we could not complete
2023-01-03 17:34:26 +01:00
Alex Auvolat
8d5505514f
Make it explicit when using nonversioned encoding
2023-01-03 15:27:36 +01:00
Alex Auvolat
cdb2a591e9
Refactor how things are migrated
2023-01-03 14:44:47 +01:00
Alex Auvolat
939a6d67e8
Merge branch 'main' into internals-rework
2023-01-02 15:07:44 +01:00
Alex Auvolat
6775569525
Bump everything to v0.8.1
2023-01-02 14:15:33 +01:00
Alex Auvolat
dfc131850a
Simplified and more aggressive worker exit logic
2022-12-14 15:25:29 +01:00
Alex Auvolat
d56c472712
Refactor background runner and get rid of job worker
2022-12-14 12:51:42 +01:00
Alex Auvolat
2183518edc
Spawn all background workers in a separate step
2022-12-14 12:28:07 +01:00
Alex Auvolat
041b60ed1d
Add block.rc_size, table.size and table.merkle_tree_size metrics
2022-12-13 15:54:03 +01:00
Alex Auvolat
d6040e32a6
cli: prettier table in garage stats
2022-12-13 15:43:22 +01:00
Alex Auvolat
d7f90cabb0
Implement block retry-now and block purge
2022-12-13 15:02:42 +01:00
Alex Auvolat
687660b27f
Implement block list-errors and block info
2022-12-13 14:23:45 +01:00
Alex Auvolat
9d82196945
cli: new worker info command
2022-12-13 12:24:30 +01:00
Alex Auvolat
de9d6cddf7
Prettier worker list table; remove useless CLI log messages
2022-12-12 17:17:05 +01:00
Alex Auvolat
56592e1853
RPC performance changes
...
- configurable ping timeout
- single, much higher, configurable RPC timeout
- no more concurrency semaphore
2022-09-19 20:31:00 +02:00
Alex Auvolat
b823151a0b
improvements in block manager
2022-09-12 16:57:38 +02:00
Alex Auvolat
7f54706b95
Merge branch 'lx-perf-improvements' into netapp-stream-body
2022-09-08 15:50:56 +02:00
Alex Auvolat
d9d199a6c9
Merge branch 'main' into lx-perf-improvements
2022-09-08 15:49:17 +02:00
Alex Auvolat
8adc654713
Merge branch 'main' into improve-deps
2022-09-07 18:13:27 +02:00
Alex Auvolat
6b958979bd
Merge branch 'lx-perf-improvements' into netapp-stream-body
2022-09-06 22:13:01 +02:00
Alex Auvolat
c2cc08852b
Reenable node ordering
2022-09-06 19:31:42 +02:00
Alex Auvolat
48ffaaadfc
Bump versions to 0.8.0 (compatibility is broken already)
2022-09-06 16:47:56 +02:00
Alex Auvolat
07e6bcde85
Merge branch 'main' into lx-perf-improvements
2022-09-05 12:40:17 +02:00
Jakub Jirutka
a6e40b75ea
Add feature "system-libs" to enable linking against system libraries
...
If this feature is enabled, libsodium-sys and zstd-sys will link
dynamically against system-provided libraries instead of building
and linking statically the bundled (possibly outdated and vulnerable)
copies of them. This feature is intended mainly for linux package
maintainers.
2022-09-03 18:44:34 +02:00
Alex Auvolat
e1751c8a9c
fix clippy
2022-09-02 17:24:26 +02:00
Alex Auvolat
5d4b937a00
Ability to have up to 4 concurrently working resync workers
2022-09-02 17:18:13 +02:00
Alex Auvolat
5e8baa433d
Make BlockManagerLocked fully private again
2022-09-02 16:52:22 +02:00
Alex Auvolat
47be652a1f
block manager: refactor: split resync into separate file
2022-09-02 16:47:15 +02:00
Alex Auvolat
943d76c583
Ability to dynamically set resync tranquility
2022-09-02 15:34:21 +02:00
Alex Auvolat
99b532b85b
Apply PRIO_SECONDARY to block data transfers
2022-09-01 16:35:43 +02:00
Alex Auvolat
df094bd807
Less strict timeouts
2022-09-01 16:30:44 +02:00
Alex Auvolat
bc977f9a7a
Update to Netapp with OrderTag support and exploit OrderTags
2022-09-01 12:58:20 +02:00
Alex Auvolat
70231d68b2
Fix bytes_read counter
2022-08-31 19:44:27 +02:00
