Skip to content

Commit 4f6b838

Browse files
authored
Add object storage to allas instructions for rclone (#1710)
* add object storage to allas instructions for rclone * Add note on Allas config
1 parent e12c937 commit 4f6b838

File tree

1 file changed

+35
-0
lines changed

1 file changed

+35
-0
lines changed

docs/data/Allas/accessing_allas.md

Lines changed: 35 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -80,6 +80,41 @@ For example following tools can be used:
8080

8181
The list above is not complete or exclusive. Any tool that supports Swift or S3 protocols can in principle use Allas.
8282

83+
## Copying files directly between object storages
84+
85+
Rclone can also be used to directly copy files from another object storage (e.g. [Amazon S3](https://docs.aws.amazon.com/AmazonS3/latest/userguide/Welcome.html), [Google cloud](https://cloud.google.com/learn/what-is-object-storage), [CREODIAS](https://creodias.eu/cloud/cloudferro-cloud/storage-2/object-storage/),...) to Allas. For this both credentials need to be stored in a Rclone configuration file in the users home directory (`.config/rclone/rclone.conf`). An example is shown below:
86+
87+
```
88+
[s3allas]
89+
type = s3
90+
provider = Other
91+
env_auth = false
92+
access_key_id = xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx
93+
secret_access_key = xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx
94+
endpoint = a3s.fi
95+
acl = private
96+
97+
[otherobjectstorage]
98+
type = s3
99+
provider = Other
100+
env_auth = false
101+
access_key_id = yyyyyyyyyyyyyyyyyyyyyyyyyyyyyyy
102+
secret_access_key = yyyyyyyyyyyyyyyyyyyyyyyyyyyyyy
103+
endpoint = yourotherendpoint.com
104+
acl = private
105+
```
106+
The configuration for Allas is added automatically when configuring Allas in s3 mode
107+
108+
`source allas_conf --mode s3cmd` .
109+
110+
After creating/updating this file, Rclone can be used to copy files
111+
112+
`rclone copy otherobjectstorage:bucket-x/object-y s3allas:bucket-z/object-a`
113+
114+
or list files from either Allas or the other object storage by using the respective name
115+
116+
`rclone lsf otherobjectstorage: `.
117+
83118
## Other ways of accessing Allas
84119

85120
* [Python](using_allas/python_library.md) Programmatic access to Allas.

0 commit comments

Comments
 (0)