Commit Graph

23 Commits

Author SHA1 Message Date
Alex Auvolat
37f880bc09 RequestStrategy with possible interruption or not 2020-04-23 13:37:10 +00:00
Alex Auvolat
73574ab43e Fix in rpc_client (see comment in code) 2020-04-22 20:42:23 +00:00
Alex Auvolat
8971f34c81 Well they still have to exit when we're exiting though 2020-04-22 17:04:33 +00:00
Alex Auvolat
e8214cb180 Better concurrency:
Use Notify instead of stupid sleep in background worker
Use Semaphore to limit concurrent requests in rpc_client
Make more background tasks cancellable
2020-04-22 16:51:52 +00:00
Alex Auvolat
ec59e896c6 Make UUID & Hash Copy and remove some .clone() noise 2020-04-21 17:08:42 +00:00
Alex Auvolat
cc4f2f1cfb Pretty logging 2020-04-21 12:54:55 +00:00
Alex Auvolat
e325c7f47a Add hostname to node info 2020-04-19 19:08:48 +02:00
Alex Auvolat
a6129d8626 Begin implement bucket management & admin commands 2020-04-19 17:15:48 +02:00
Alex Auvolat
4ba54ccfca Reorder imports.
Trying to separate:
1. Stuff for handling the swarm of nodes and generic table data replication
2. Stuff for the object store core application: metadata tables and block management
3. Stuff for the S3 API
2020-04-18 19:39:57 +02:00
Alex Auvolat
f41583e1b7 Massive RPC refactoring 2020-04-18 19:21:34 +02:00
Alex Auvolat
e41ce4d815 Implement getting missing blocks when RC increases
Issue: RC increases also when the block ref entry is first put by the actual client.
At that point the client is probably already sending us the block content,
so we don't need to do a get...
We should add a delay before the task is added or find something to do.
2020-04-17 15:40:13 +02:00
Alex Auvolat
6ce14e2c9e Make all requests continue in the background even after we got enough responses. 2020-04-16 23:13:15 +02:00
Alex Auvolat
2f3b1a072f WIP 2020-04-16 19:28:02 +02:00
Alex Auvolat
f01c1e71b5 Begin work on sync... 2020-04-16 14:50:49 +02:00
Alex Auvolat
c788fc9f9e Cleanup 2020-04-12 19:18:31 +02:00
Alex Auvolat
d2814b5c33 TLS works \o/
So, the issues were:
- webpki does not support IP addresses as DNS names in URLs,
  so I hacked the HttpsConnector to always provide a fixed string
  as the DNS name for server certificate validation
- the certificate requied a SAN section which was complicated to build
  but eventually the solution is there in genkeys.sh
2020-04-12 19:00:30 +02:00
Alex Auvolat
d1e8f78b2c Trying to do TLS 2020-04-12 15:51:19 +02:00
Alex Auvolat
9c931f5eda Keep network status & ring in a tokio::sync::watch
advantages
- reads don't prevent preparing writes
- can be followed from other parts of the system by cloning the receiver
2020-04-11 23:53:32 +02:00
Alex Auvolat
3477864142 Fix the Sync issue. Details:
So the HTTP client future of Hyper is not Sync, thus the stream
that read blocks wasn't either. However Hyper's default Body type
requires a stream to be Sync for wrap_stream. Solution: reimplement
a custom HTTP body type.
2020-04-10 22:01:48 +02:00
Alex Auvolat
d66c0d6833 Why is it not Sync?? 2020-04-09 23:45:07 +02:00
Alex Auvolat
1d786c2c66 Something works 2020-04-09 18:43:53 +02:00
Alex Auvolat
d50edcdb4f Basic workflow for client PUT, next is do actual storage 2020-04-08 00:39:07 +02:00
Alex Auvolat
061e676136 Refactor; ability to update network config 2020-04-07 16:26:22 +02:00