ad hoc 06bb81bbb1 libsql wal s3 backend (#1554) ...

* introduce checkpointer

* fmt

* impl IoBuf(Mut) for BytesMut

* add tokio_util dep

* implement FileStreamBody

wrapper stream arounf File, to send as payload to s3

* introduce SegmentKey

* add copy stream to FileExt compat method

* add warning comment

* fix imports

* add read_at and read_at_async methods

* update Backend trait to return segmetn index

* introduce S3Backend

* add s3 keys formatters

* implement Backend for S3Backend

* fix imports

* remove old implementation

* add basic s3 test

* remove unused implementation of FileExt for Vec<u8>

* add net abstraction

* feature gate s3 backend

* s3 backend with custom connector

* fmt

* expose WalRegistry::get_async

* expose seal_current method

* implement get_durable_frame_no

* expose convenient constructor for AsyncStorage

* implement Clone for LibsqlWalManager

* pass config to Storage methods

* add unhandled storage variant

* cargo bucket already exist error

* return optional segment

* remove net abstraction

the connector can be passed to the SdkConfig

* add basic shell to interact with libsql-wal

* fmt

* do not publish libsql wal

2024-07-17 08:17:21 +00:00

2.1 KiB

Raw Permalink Blame History

View Raw