How to upload a bag?

[paulerikf]

RBB seems like an incredible tool. Unfortunately, I don't seem to understand how to actually upload our own bags. I've been able to extract data from bags using the rbb_tools extraction stuff, but where do I go from here? Any chance you could explain that process?

[hfchendrikx]

This should have been documented a bit better. I don't think this is written anywhere. The reason for that mainly is that the RBB is not meant to handle the uploading itself. It is designed as a tool that indexes some external storage. In the beginning we used dropbox as storage and the uploading process would just be copying the bags to dropbox and then press the index button in the web interface. This didn't scale very well, near the end of the season we were recording over 100 gigabytes a day. We then switched to amazon AWS S3 for storage, and then later we again switched. This time to minio , which is a self-hosted storage system that behaves the same as S3. Minio is also used in the demo here on github. So to upload the bag you will have to put it into minio, there are several ways to do this.

• You can put it directly in the folder where minio stores its files. (This is somewhere in deploy/local-stack/buckets in case you use the demo setup)
• You can login to the minio web interface and drag the files there. (This is http://localhost:9000/ if you use the demo setup)
• You can use an S3 compatible client that can transfer files into the bucket. (e.g. rclone, minio-client, ...)
• You can mount the S3 bucket as a local drive. (This I've never done before, googling something like "mounting an s3 bucket" will definitely point you to the right place 😉 )

After you've uploaded the bag into the bucket you have to press index on the web interface. It will then discover the bag, and run any extraction configurations you have linked to it to visualize what's inside.

Let me know if something is still not clear.