Tools, Tips & Tricks
Tools
These are some (but not all!) of the libraries and packages you can use with OSN. If you have a tool to add to the list, please let the OSN team know at help@osn.mghpcc.org.
S3 command-line clients
| Tool | Platform |
|---|---|
| rclone | all |
S3 libraries
| Tool | Language | Platform |
|---|---|---|
| Boto3 | Python | All |
| aws.s3 | R | All |
Best Practices
Naming Conventions
For broad compatibility with tools, libraries, and filesystems: use lower-case letters, numbers, spaces, hyphens (-), underscores (_), and periods (.) in file and folder names. Avoid unnecessary special characters, names that differ only by capitalization, and leading or trailing spaces or periods. Deviating from this may result in data that is unreadable in certain circumstances.
S3 permits many special characters in object names, but some tools and libraries may interpret them differently. For example, a name containing a plus sign (+) may conflict with an otherwise identical name containing a space:
test file.txt
test+file.txtNames that differ only by capitalization may also conflict when used with some tools or filesystems:
test file.txt
Test File.txtForward slashes (/) may be used to separate “folders” or “directories” in a path, such as:
project/data/test file.txtHowever, a forward slash should not be used within the name of an individual file or directory.