The storage1 command-line interface (CLI) allows to use most features of the Google storage service from the comfort of your terminal.

By default all output is printed to standard out, but flags can be set to direct it into a file independent of your shell's capabilities. Errors will be printed to standard error, and cause the program's exit code to be non-zero.

If data-structures are requested, these will be returned as pretty-printed JSON, to be useful as input to other tools.

Everything else about the storage API can be found at the official documentation site.

Installation and Source Code

Install the command-line interface with cargo using:

cargo install google-storage1-cli

Find the source code on github.

Usage

This documentation was generated from the storage API at revision 20240229. The CLI is at version 5.0.4.

storage1 [options]
        anywhere-caches
                disable <bucket> <anywhere-cache-id> [-p <v>]... [-o <out>]
                get <bucket> <anywhere-cache-id> [-p <v>]... [-o <out>]
                insert <bucket> (-r <kv>)... [-p <v>]... [-o <out>]
                list <bucket> [-p <v>]... [-o <out>]
                pause <bucket> <anywhere-cache-id> [-p <v>]... [-o <out>]
                resume <bucket> <anywhere-cache-id> [-p <v>]... [-o <out>]
                update <bucket> <anywhere-cache-id> (-r <kv>)... [-p <v>]... [-o <out>]
        bucket-access-controls
                delete <bucket> <entity> [-p <v>]...
                get <bucket> <entity> [-p <v>]... [-o <out>]
                insert <bucket> (-r <kv>)... [-p <v>]... [-o <out>]
                list <bucket> [-p <v>]... [-o <out>]
                patch <bucket> <entity> (-r <kv>)... [-p <v>]... [-o <out>]
                update <bucket> <entity> (-r <kv>)... [-p <v>]... [-o <out>]
        buckets
                delete <bucket> [-p <v>]...
                get <bucket> [-p <v>]... [-o <out>]
                get-iam-policy <bucket> [-p <v>]... [-o <out>]
                insert <project> (-r <kv>)... [-p <v>]... [-o <out>]
                list <project> [-p <v>]... [-o <out>]
                lock-retention-policy <bucket> <if-metageneration-match> [-p <v>]... [-o <out>]
                operations-cancel <bucket> <operation-id> [-p <v>]...
                operations-get <bucket> <operation-id> [-p <v>]... [-o <out>]
                operations-list <bucket> [-p <v>]... [-o <out>]
                patch <bucket> (-r <kv>)... [-p <v>]... [-o <out>]
                set-iam-policy <bucket> (-r <kv>)... [-p <v>]... [-o <out>]
                test-iam-permissions <bucket> <permissions>... [-p <v>]... [-o <out>]
                update <bucket> (-r <kv>)... [-p <v>]... [-o <out>]
        channels
                stop (-r <kv>)... [-p <v>]...
        default-object-access-controls
                delete <bucket> <entity> [-p <v>]...
                get <bucket> <entity> [-p <v>]... [-o <out>]
                insert <bucket> (-r <kv>)... [-p <v>]... [-o <out>]
                list <bucket> [-p <v>]... [-o <out>]
                patch <bucket> <entity> (-r <kv>)... [-p <v>]... [-o <out>]
                update <bucket> <entity> (-r <kv>)... [-p <v>]... [-o <out>]
        folders
                delete <bucket> <folder> [-p <v>]...
                get <bucket> <folder> [-p <v>]... [-o <out>]
                insert <bucket> (-r <kv>)... [-p <v>]... [-o <out>]
                list <bucket> [-p <v>]... [-o <out>]
                rename <bucket> <source-folder> <destination-folder> [-p <v>]... [-o <out>]
        managed-folders
                delete <bucket> <managed-folder> [-p <v>]...
                get <bucket> <managed-folder> [-p <v>]... [-o <out>]
                get-iam-policy <bucket> <managed-folder> [-p <v>]... [-o <out>]
                insert <bucket> (-r <kv>)... [-p <v>]... [-o <out>]
                list <bucket> [-p <v>]... [-o <out>]
                set-iam-policy <bucket> <managed-folder> (-r <kv>)... [-p <v>]... [-o <out>]
                test-iam-permissions <bucket> <managed-folder> <permissions>... [-p <v>]... [-o <out>]
        notifications
                delete <bucket> <notification> [-p <v>]...
                get <bucket> <notification> [-p <v>]... [-o <out>]
                insert <bucket> (-r <kv>)... [-p <v>]... [-o <out>]
                list <bucket> [-p <v>]... [-o <out>]
        object-access-controls
                delete <bucket> <object> <entity> [-p <v>]...
                get <bucket> <object> <entity> [-p <v>]... [-o <out>]
                insert <bucket> <object> (-r <kv>)... [-p <v>]... [-o <out>]
                list <bucket> <object> [-p <v>]... [-o <out>]
                patch <bucket> <object> <entity> (-r <kv>)... [-p <v>]... [-o <out>]
                update <bucket> <object> <entity> (-r <kv>)... [-p <v>]... [-o <out>]
        objects
                bulk-restore <bucket> (-r <kv>)... [-p <v>]... [-o <out>]
                compose <destination-bucket> <destination-object> (-r <kv>)... [-p <v>]... [-o <out>]
                copy <source-bucket> <source-object> <destination-bucket> <destination-object> (-r <kv>)... [-p <v>]... [-o <out>]
                delete <bucket> <object> [-p <v>]...
                get <bucket> <object> [-p <v>]... [-o <out>]
                get-iam-policy <bucket> <object> [-p <v>]... [-o <out>]
                insert <bucket> (-r <kv>)... (-u simple -f <file> [-m <mime>]) [-p <v>]... [-o <out>]
                list <bucket> [-p <v>]... [-o <out>]
                patch <bucket> <object> (-r <kv>)... [-p <v>]... [-o <out>]
                restore <bucket> <object> <generation> (-r <kv>)... [-p <v>]... [-o <out>]
                rewrite <source-bucket> <source-object> <destination-bucket> <destination-object> (-r <kv>)... [-p <v>]... [-o <out>]
                set-iam-policy <bucket> <object> (-r <kv>)... [-p <v>]... [-o <out>]
                test-iam-permissions <bucket> <object> <permissions>... [-p <v>]... [-o <out>]
                update <bucket> <object> (-r <kv>)... [-p <v>]... [-o <out>]
                watch-all <bucket> (-r <kv>)... [-p <v>]... [-o <out>]
        projects
                hmac-keys-create <project-id> <service-account-email> [-p <v>]... [-o <out>]
                hmac-keys-delete <project-id> <access-id> [-p <v>]...
                hmac-keys-get <project-id> <access-id> [-p <v>]... [-o <out>]
                hmac-keys-list <project-id> [-p <v>]... [-o <out>]
                hmac-keys-update <project-id> <access-id> (-r <kv>)... [-p <v>]... [-o <out>]
                service-account-get <project-id> [-p <v>]... [-o <out>]
  storage1 --help

Configuration:
  [--scope <url>]...
            Specify the authentication a method should be executed in. Each scope
            requires the user to grant this application permission to use it.
            If unset, it defaults to the shortest scope url for a particular method.
  --config-dir <folder>
            A directory into which we will store our persistent data. Defaults to
            a user-writable directory that we will create during the first invocation.
            [default: ~/.google-service-cli]

Configuration

The program will store all persistent data in the ~/.google-service-cli directory in JSON files prefixed with storage1-. You can change the directory used to store configuration with the --config-dir flag on a per-invocation basis.

More information about the various kinds of persistent data are given in the following paragraphs.

Authentication

Most APIs require a user to authenticate any request. If this is the case, the scope determines the set of permissions granted. The granularity of these is usually no more than read-only or full-access.

If not set, the system will automatically select the smallest feasible scope, e.g. when invoking a method that is read-only, it will ask only for a read-only scope. You may use the --scope flag to specify a scope directly. All applicable scopes are documented in the respective method's CLI documentation.

The first time a scope is used, the user is asked for permission. Follow the instructions given by the CLI to grant permissions, or to decline.

If a scope was authenticated by the user, the respective information will be stored as JSON in the configuration directory, e.g. ~/.google-service-cli/storage1-token-<scope-hash>.json. No manual management of these tokens is necessary.

To revoke granted authentication, please refer to the official documentation.

Application Secrets

In order to allow any application to use Google services, it will need to be registered using the Google Developer Console. APIs the application may use are then enabled for it one by one. Most APIs can be used for free and have a daily quota.

To allow more comfortable usage of the CLI without forcing anyone to register an own application, the CLI comes with a default application secret that is configured accordingly. This also means that heavy usage all around the world may deplete the daily quota.

You can workaround this limitation by putting your own secrets file at this location: ~/.google-service-cli/storage1-secret.json, assuming that the required storage API was enabled for it. Such a secret file can be downloaded in the Google Developer Console at APIs & auth -> Credentials -> Download JSON and used as is.

Learn more about how to setup Google projects and enable APIs using the official documentation.

Debugging

Even though the CLI does its best to provide usable error messages, sometimes it might be desirable to know what exactly led to a particular issue. This is done by allowing all client-server communication to be output to standard error as-is.

The --debug flag will print errors using the Debug representation to standard error.

You may consider redirecting standard error into a file for ease of use, e.g. storage1 --debug <resource> <method> [options] 2>debug.txt.