Alex Auvolat
|
0af314b295
|
Add comment for fsync
|
2022-03-14 11:54:00 +01:00 |
|
Alex Auvolat
|
d78bf379fb
|
Fix resync queue to not drop items
|
2022-03-14 11:51:37 +01:00 |
|
Alex Auvolat
|
f7e6f4616f
|
Spawn a single resync worker
|
2022-03-14 11:51:37 +01:00 |
|
Alex Auvolat
|
dc5ec4ecf9
|
Add appropriate fsync() calls in write_block
to ensure that data is persisted properly
|
2022-03-14 11:51:32 +01:00 |
|
Alex Auvolat
|
fe62d01b7e
|
Implement exponential backoff for resync retries
|
2022-03-14 11:41:20 +01:00 |
|
Alex Auvolat
|
2377a92f6b
|
Add wrapper over sled tree to count items (used for big queues)
|
2022-03-14 10:54:25 +01:00 |
|
Alex Auvolat
|
2a5609b292
|
Add metrics to API endpoint
|
2022-03-14 10:53:36 +01:00 |
|
Alex Auvolat
|
818daa5c78
|
Refactor how durations are measured
|
2022-03-14 10:53:35 +01:00 |
|
Alex Auvolat
|
bb04d94fa9
|
Update to Netapp 0.4 which supports distributed tracing
|
2022-03-14 10:52:30 +01:00 |
|
Alex Auvolat
|
8c2fb0c066
|
Add tracing integration with opentelemetry
|
2022-03-14 10:52:13 +01:00 |
|
Alex Auvolat
|
2cab84b1fe
|
Add many metrics in table/ and rpc/
|
2022-03-14 10:51:50 +01:00 |
|
Alex Auvolat
|
beeef4758e
|
Some movement of helper code and refactoring of error handling
|
2022-01-04 12:52:46 +01:00 |
|
trinity-1686a
|
1eb972b1ac
|
Add compression using zstd (#173)
fix #27
Co-authored-by: Trinity Pointard <trinity.pointard@gmail.com>
Reviewed-on: https://git.deuxfleurs.fr/Deuxfleurs/garage/pulls/173
Co-authored-by: trinity-1686a <trinity.pointard@gmail.com>
Co-committed-by: trinity-1686a <trinity.pointard@gmail.com>
|
2021-12-15 11:26:43 +01:00 |
|
Alex Auvolat
|
ad7ab31411
|
Implement GC delay for table data
|
2021-11-08 15:47:47 +01:00 |
|
Alex Auvolat
|
74a7a550eb
|
Safety: never voluntarily delete block in 10min interval after RC reaches zero
|
2021-11-08 15:47:47 +01:00 |
|
Alex Auvolat
|
2090a6187f
|
Add tranquilizer mechanism to improve on token bucket mechanism
|
2021-11-04 13:26:59 +01:00 |
|
Alex Auvolat
|
69b89fb46d
|
Fix race in block resync
|
2021-10-27 12:01:12 +02:00 |
|
Alex Auvolat
|
6b47c294f5
|
Refactoring on repair commands
|
2021-10-27 11:14:55 +02:00 |
|
Trinity Pointard
|
28c015d9ff
|
add cli parameter to verify local bloc integrity
reuse code for listing local blocks
add disk i/o speed limit on integrity check
|
2021-10-27 10:31:03 +02:00 |
|
Alex Auvolat
|
ada7899b24
|
Fix clippy lints (fix #121)
|
2021-10-26 10:20:05 +02:00 |
|
Alex Auvolat
|
df8a4068d9
|
Refactor block manager code, and hopefully fix deadlock
|
2021-10-25 14:21:51 +02:00 |
|
Alex Auvolat
|
de4276202a
|
Improve CLI, adapt tests, update documentation
|
2021-10-25 14:21:48 +02:00 |
|
Alex Auvolat
|
1b450c4b49
|
Improvements to CLI and various fixes for netapp version
Discovery via consul, persist peer list to file
|
2021-10-22 16:55:24 +02:00 |
|
Alex Auvolat
|
4067797d01
|
First port of Garage to Netapp
|
2021-10-22 15:55:18 +02:00 |
|
Trinity Pointard
|
e4b9e4e24d
|
rename types to CamelCase
|
2021-05-03 22:15:09 +02:00 |
|
Trinity Pointard
|
4a1e079e8f
|
fix clippy warnings on model
|
2021-05-03 22:11:41 +02:00 |
|
Trinity Pointard
|
2812a027ea
|
change some more comments and revert changes on TableSchema
|
2021-04-27 16:49:07 +02:00 |
|
Trinity Pointard
|
74373aebcf
|
make most requested changes
|
2021-04-27 16:47:08 +02:00 |
|
Trinity Pointard
|
67585a4ffa
|
attempt at documenting model crate
|
2021-04-27 16:37:10 +02:00 |
|
Trinity Pointard
|
b437610812
|
attempt at documenting table crate
|
2021-04-27 16:37:10 +02:00 |
|
Alex Auvolat
|
08bcd51956
|
GC object table in a specific case
|
2021-03-16 16:51:15 +01:00 |
|
Alex Auvolat
|
1d9961e411
|
Simplify replication logic
|
2021-03-16 11:14:27 +01:00 |
|
Alex Auvolat
|
6a8439fd13
|
Some improvements in background worker but we terminate late
|
2021-03-15 23:14:12 +01:00 |
|
Alex Auvolat
|
0cd5b2ae19
|
WIP migrate to tokio 1
|
2021-03-15 22:36:41 +01:00 |
|
Alex Auvolat
|
4d4117f2b4
|
Refactor block resync loop; make workers infaillible
|
2021-03-15 20:09:44 +01:00 |
|
Alex Auvolat
|
667e4e72a8
|
Small fixes
|
2021-03-15 19:51:16 +01:00 |
|
Alex Auvolat
|
0290afe1f8
|
Make block rc code more understandable
|
2021-03-15 18:27:26 +01:00 |
|
Alex Auvolat
|
3bf2df622a
|
Time and metadata improvements
|
2021-03-15 16:21:41 +01:00 |
|
Alex Auvolat
|
097c339d98
|
Fix race condition
|
2021-03-15 15:26:29 +01:00 |
|
Alex Auvolat
|
bdcbdd1cd8
|
Fix list API bug
|
2021-03-15 14:46:37 +01:00 |
|
Alex Auvolat
|
831eb35763
|
cargo fmt
|
2021-03-12 21:52:19 +01:00 |
|
Alex Auvolat
|
c475471e7a
|
Implement table gc, currently for block_ref and version only
|
2021-03-12 19:57:37 +01:00 |
|
Alex Auvolat
|
3f7a496355
|
More security: don't delete stuff too easily
|
2021-03-11 19:06:27 +01:00 |
|
Alex Auvolat
|
94f3d28774
|
WIP big refactoring
|
2021-03-11 16:54:15 +01:00 |
|
Alex Auvolat
|
8d63738cb0
|
Checkpoint: add merkle tree in data table
|
2021-03-11 13:47:21 +01:00 |
|
Alex Auvolat
|
0fd7df8fa0
|
Switch to blake2 sum for identifying blocks by their data
|
2021-03-10 16:33:31 +01:00 |
|
Alex Auvolat
|
f319a7d374
|
Refactor model stuff, including cleaner CRDTs
|
2021-03-10 16:21:56 +01:00 |
|
Alex Auvolat
|
3882d5ba36
|
Remove epidemic propagation for fully replicated stuff: write directly to all nodes
|
2021-03-05 15:09:18 +01:00 |
|
Alex Auvolat
|
49c25a1509
|
Simulate stuff moving around
|
2021-02-25 10:53:33 +01:00 |
|
Alex Auvolat
|
5fe95ebae7
|
fix tracing
|
2021-02-24 12:18:01 +01:00 |
|