micropelago/garage
3
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
471 Commits 25 Branches 62 Tags 26 MiB
b490ebc7f6
Commit Graph

40 Commits

Author SHA1 Message Date
Alex Auvolat
b490ebc7f6
Many improvements on ring/replication and its configuration: 
- Explicit "replication_mode" configuration parameters that takes
  either "none", "2" or "3" as values, instead of letting user configure
  replication factor themselves. These are presets whose corresponding
  replication/quorum values can be found in replication/mode.rs

- Explicit support for single-node and two-node deployments
  (number of nodes must be at least "replication_mode", with "none"
  we can have only one node)

- Ring is now stored much more compactly with 256*8 + n*32 bytes,
  instead of 256*32 bytes

- Support for gateway-only nodes that do not store data
  (these nodes still need a metadata_directory to store the list
  of bucket and keys since those are stored on all nodes; it also
  technically needs a data_directory to start but it will stay
  empty unless we have bugs)
 2021-05-28 14:07:36 +02:00
Quentin Dufour
c8aa1eb481
Add preliminary support for Duck 2021-05-15 10:24:20 +02:00
Trinity Pointard
88925ebe22
add clippy to the CI 2021-05-03 22:11:37 +02:00
Quentin Dufour
631c36b3ff S3 API: support ListBuckets 2021-05-03 21:55:30 +02:00
Quentin Dufour
ef4d6e782a
Add minio & rclone to our functional tests 
It is now possible to configure which clients
you do not want to test with the env variable SKIP_XXX=1,
XXX being the client name. eg. SKIP_S3CMD=1 ./script/test-smoke.sh
 2021-05-02 14:59:58 +02:00
Quentin Dufour
e01f74e763
Introduce test case that demonstrates #59 (the & problem) 2021-04-27 23:09:26 +02:00
Alex Auvolat
640e3921d8
Use pre-prepared Docker image in CI to speed things up 2021-04-27 16:37:11 +02:00
Alex Auvolat
5ab33fddac Refactor CLI and prettify CLI outpu 2021-03-12 18:12:31 +01:00
Alex Auvolat
6a3dcf3974 Rename n_tokens into capacity 2021-03-10 14:52:03 +01:00
Alex Auvolat
5e33c3cfc9 Use smaller capacities for nodes 2021-03-05 16:58:34 +01:00
Alex Auvolat
d7e005251d Not fully tested: new multi-dc MagLev 2021-03-05 16:22:29 +01:00
Alex Auvolat
49c25a1509 Simulate stuff moving around 2021-02-25 10:53:33 +01:00
Alex Auvolat
1abbca37c4 Add adapted version of maglev for multi-dc 2021-02-21 19:14:28 +01:00
Alex Auvolat
24f924afdb Maglev simulation 2021-02-21 18:32:13 +01:00
Alex Auvolat
e59322041a Evaluate hash functions 2021-02-21 15:11:15 +01:00
Alex Auvolat
217b0dfd68 Add script to simulate different kinds of rings 2021-02-21 14:30:26 +01:00
Alex Auvolat
3b023c0c3b try to fix smoke test 
dev cluster: don't ipv6 (fixes smoke test in container?)
 2021-02-17 22:13:11 +01:00
Alex Auvolat
36814be447 Fix S3 ListObjects result and replace println!s by debug!s 2021-01-16 16:05:54 +01:00
Quentin Dufour
086e5be290 Update testing script 2020-12-17 21:04:59 +01:00
Quentin
1119d466e7 Fix S3 command 2020-12-10 20:19:22 +01:00
Quentin
e8c12072ce Merge branch 'master' into feature/website 2020-12-10 20:12:56 +01:00
Quentin
e13fd09543 Reduce garage.1.rnd size to store it inline 2020-12-06 13:33:08 +01:00
Quentin
a92868504f Indentation & comments 2020-12-06 10:23:14 +01:00
Quentin
d2d1fc676d Test awscli/s3cmd interactions 2020-12-06 10:19:01 +01:00
Quentin
a12930075d Test garage list & delete commands 2020-12-06 10:04:17 +01:00
Quentin
28055b708f Improve README, add more tests 2020-12-06 09:13:47 +01:00
Quentin
132c54b807 wip smoke test 2020-12-05 19:26:10 +01:00
Quentin
8df0b322ab Fix merge error 2020-11-29 17:40:36 +01:00
Quentin
a512db342e Merge branch 'master' into feature/website 2020-11-29 17:40:03 +01:00
Alex Auvolat
2f11191f60 Use ipv6 localhost for dev cluster and different port numbers 2020-11-29 17:31:58 +01:00
Quentin
54c3a023f0 Use aws cli version 2 2020-11-29 17:27:49 +01:00
Quentin
15f409d404 Merge branch 'master' into feature/website 2020-11-29 17:19:55 +01:00
Quentin
cee6c3a821 A fix for s3cmd 2020-11-29 17:15:49 +01:00
Quentin
13d1b66ba4 Rollback logging on dev-cluster 2020-11-29 17:07:29 +01:00
Quentin
3f18aa6f1d Add a smoke test script 2020-11-29 17:03:19 +01:00
Quentin
07e87595f8 S3 does not support accentuated buckets + add a script to clean tmp 2020-11-29 17:03:19 +01:00
Quentin
92ab3eedfc Use awscli instead of s3cmd 2020-11-21 15:44:09 +01:00
Quentin
2f6eca4ef3 Merge remote-tracking branch 'origin/master' into feature/website 2020-11-21 10:52:27 +01:00
Alex Auvolat
98e20a5898 Fix dev-env.sh for source; print which garage in dev-cluster.sh 2020-11-20 23:50:23 +01:00
Quentin
993f9d73b1 Quicker dev with more scripts 2020-11-20 20:50:43 +01:00