Filesystem Backend

[danielBCN]

Initial implementation to use dataplug directly atop the file system. Bucket is a base directory, and all keys are relative to that directory.

Just

from dataplug.fileobject import CloudObject

instead of

from dataplug import CloudObject

And use

co = CloudObject.from_bucket_key(format, bucket, key)

[aitorarjona]

My idea here was to diferentiate object storage and file system depending on the path prefix. This way we can keep all the logic of CloudObject. For instance, s3://mybucket/myobject for S3 and fs://mybucket/myobject for file system. Then in the class setup we can choose the correct backend. To solve the root path for the FS backend, we can use the storage_config parameter, for example:

co = CloudObject("fs://mybucket/myfile", VCF, storage_config={"fs_root": "/tmp"})

would read myfile from /tmp/mybucket/myfile from the file system mounted on /tmp or /...