• Creation of repositories, relying on existing brokers or accessing cloud storage directly through AWS s3 protocol, or accessing HDFS directly.
    • If it is a read-only repository, restores can only be done on the repository. If not, backup and restore operations are available.
    • PROPERTIES are different according to different types of broker or S3 or hdfs, see the example for details.
    • ON LOCATION : if it is S3 , here followed by the Bucket Name.
    1. Create a warehouse named bos_repo, rely on BOS broker “bos_broker”, and the data root directory is: bos://palo_backup
    1. WITH BROKER `bos_broker`
    2. ON LOCATION "bos://palo_backup"
    3. PROPERTIES
    4. (
    5. "bos_endpoint" = "http://gz.bcebos.com",
    6. "bos_accesskey" = "bos_accesskey",
    7. "bos_secret_accesskey"="bos_secret_accesskey"
    8. );
    1. Create the same repository as Example 1, but with read-only properties:
    1. CREATE READ ONLY REPOSITORY `bos_repo`
    2. WITH BROKER `bos_broker`
    3. PROPERTIES
    4. (
    5. "bos_endpoint" = "http://gz.bcebos.com",
    6. "bos_accesskey" = "bos_accesskey",
    7. );
    1. Create a warehouse named hdfs_repo, rely on Baidu hdfs broker “hdfs_broker”, the data root directory is: hdfs://hadoop-name-node:54310/path/to/repo/
    1. Create a repository named s3_repo to link cloud storage directly without going through the broker.
    1. CREATE REPOSITORY `s3_repo`
    2. WITH S3
    3. ON LOCATION "s3://s3-repo"
    4. PROPERTIES
    5. (
    6. "AWS_ENDPOINT" = "http://s3-REGION.amazonaws.com",
    7. "AWS_ACCESS_KEY" = "AWS_ACCESS_KEY",
    8. "AWS_SECRET_KEY"="AWS_SECRET_KEY",
    9. "AWS_REGION" = "REGION"
    10. );
    1. Create a repository named hdfs_repo to link HDFS directly without going through the broker.
    1. CREATE REPOSITORY `hdfs_repo`
    2. WITH hdfs
    3. ON LOCATION "hdfs://hadoop-name-node:54310/path/to/repo/"
    4. "fs.defaultFS"="hdfs://hadoop-name-node:54310",
    5. "hadoop.username"="user"
    6. );
    7. ### Keywords
    1. Create a repository named minio_repo to link minio storage directly through the s3 protocol.
    1. Create a repository named minio_repo via temporary security credentials.
    1. CREATE REPOSITORY `minio_repo`
    2. WITH S3
    3. ON LOCATION "s3://minio_repo"
    4. PROPERTIES
    5. (
    6. "AWS_ENDPOINT" = "AWS_ENDPOINT",
    7. "AWS_ACCESS_KEY" = "AWS_TEMP_ACCESS_KEY",
    8. "AWS_SECRET_KEY" = "AWS_TEMP_SECRET_KEY",
    9. "AWS_TOKEN" = "AWS_TEMP_TOKEN",
    10. "AWS_REGION" = "AWS_REGION"
    1. CREATE, REPOSITORY
    1. A cluster can create multiple warehouses. Only users with ADMIN privileges can create repositories.
    2. Any user can view the created repositories through the command.