{"id":2198,"date":"2022-10-07T14:46:54","date_gmt":"2022-10-07T06:46:54","guid":{"rendered":"https:\/\/cowmanchiang.me\/wp\/?p=2198"},"modified":"2023-10-31T15:41:35","modified_gmt":"2023-10-31T07:41:35","slug":"rocksdb-tool","status":"publish","type":"post","link":"https:\/\/cowmanchiang.me\/wp\/?p=2198","title":{"rendered":"RocksDB Tool"},"content":{"rendered":"
    \n
  1. \n

    Install rocksdb first.<\/p>\n

    brew install rocksdb<\/pre>\n<\/li>\n
  2. \n
    Add alias in zshrc<\/p>\n
    alias ldb = 'rocksdb_ldb --db=. '<\/pre>\n<\/li>\n
  3. \n
    List all column families<\/p>\n
    # ldb list_column_families\nColumn families in .:\n{default, S1, User, C1, C2, U1, C3}<\/pre>\n<\/li>\n
  4. \n
    Scan command:<\/p>\n
    # ldb --column_family=User scan\nUser_U_name : cowman\nUser_U_status : 0\nUser_U_type : 0\nUser_U_updatedTimestamp :\nUser_U_userId : U<\/pre>\n<\/li>\n
  5. \n
    Show result with hex value<\/p>\n
    ldb --column_family=User scan --value_hex\nUser_U_name : 0x636F776D616E\nUser_U_status : 0x30\nUser_U_type : 0x30\nUser_U_updatedTimestamp : 0x0000000000000000\nUser_U_userId : 0x55<\/pre>\n<\/li>\n
  6. \n
    Command description (Some commands are inconsistent with how they are used on linux servers)<\/p>\n
    ldb - RocksDB Tool\n\ncommands MUST specify --db=<full_path_to_db_directory> when necessary\n\ncommands can optionally specify\n  --env_uri=<uri_of_environment> or --fs_uri=<uri_of_filesystem> if necessary\n  --secondary_path=<secondary_path> to open DB as secondary instance. Operations not supported in secondary instance will fail.\n\nThe following optional parameters control if keys\/values are input\/output as hex or as plain strings:\n  --key_hex : Keys are input\/output as hex\n  --value_hex : Values are input\/output as hex\n  --hex : Both keys and values are input\/output as hex\n\nThe following optional parameters control the database internals:\n  --column_family=<string> : name of the column family to operate on. default: default column family\n  --ttl with 'put','get','scan','dump','query','batchput' : DB supports ttl and value is internally timestamp-suffixed\n  --try_load_options : Try to load option file from DB. Default to true if db is specified and not creating a new DB and not open as TTL DB. Can be set to false explicitly.\n  --disable_consistency_checks : Set options.force_consistency_checks = false.\n  --ignore_unknown_options : Ignore unknown options when loading option file.\n  --bloom_bits=<int,e.g.:14>\n  --fix_prefix_len=<int,e.g.:14>\n  --compression_type=<no|snappy|zlib|bzip2|lz4|lz4hc|xpress|zstd>\n  --compression_max_dict_bytes=<int,e.g.:16384>\n  --block_size=<block_size_in_bytes>\n  --auto_compaction=<true|false>\n  --db_write_buffer_size=<int,e.g.:16777216>\n  --write_buffer_size=<int,e.g.:4194304>\n  --file_size=<int,e.g.:2097152>\n  --enable_blob_files : Enable key-value separation using BlobDB\n  --min_blob_size=<int,e.g.:2097152>\n  --blob_file_size=<int,e.g.:2097152>\n  --blob_compression_type=<no|snappy|zlib|bzip2|lz4|lz4hc|xpress|zstd>\n  --enable_blob_garbage_collection : Enable blob garbage collection\n  --blob_garbage_collection_age_cutoff=<double,e.g.:0.25>\n  --blob_garbage_collection_force_threshold=<double,e.g.:0.25>\n  --blob_compaction_readahead_size=<int,e.g.:2097152>\n\n\nData Access Commands:\n  put <key> <value> [--create_if_missing] [--ttl]\n  get <key> [--ttl]\n  batchput <key> <value> [<key> <value>] [..] [--create_if_missing] [--ttl]\n  scan [--from] [--to]  [--ttl] [--timestamp] [--max_keys=<N>q]  [--start_time=<N>:- is inclusive] [--end_time=<N>:- is exclusive] [--no_value]\n  delete <key>\n  deleterange <begin key> <end key>\n  query [--ttl]\n    Starts a REPL shell.  Type help for list of available commands.\n  approxsize [--from] [--to]\n  checkconsistency\n  list_file_range_deletes [--max_keys=<N>] : print tombstones in SST files.\n\n\nAdmin Commands:\n  dump_wal --walfile=<write_ahead_log_file_path> [--header]  [--print_value]  [--write_committed=true|false]\n  compact [--from] [--to]\n  reduce_levels --new_levels=<New number of levels> [--print_old_levels]\n  change_compaction_style --old_compaction_style=<Old compaction style: 0 for level compaction, 1 for universal compaction> --new_compaction_style=<New compaction style: 0 for level compaction, 1 for universal compaction>\n  dump [--from] [--to]  [--ttl] [--max_keys=<N>] [--timestamp] [--count_only] [--count_delim=<char>] [--stats] [--bucket=<N>] [--start_time=<N>:- is inclusive] [--end_time=<N>:- is exclusive] [--path=<path_to_a_file>] [--decode_blob_index] [--dump_uncompressed_blobs]\n  load [--create_if_missing] [--disable_wal] [--bulk_load] [--compact]\n  manifest_dump [--verbose] [--json] [--path=<path_to_manifest_file>]\n  update_manifest [--update_temperatures]      MUST NOT be used on a live DB.\n  file_checksum_dump [--path=<path_to_manifest_file>]\n  get_property <property_name>\n  list_column_families\n  create_column_family --db=<db_path> <new_column_family_name>\n  drop_column_family --db=<db_path> <column_family_name_to_drop>\n  dump_live_files [--decode_blob_index]  [--dump_uncompressed_blobs]\n  idump [--from] [--to]  [--input_key_hex] [--max_keys=<N>] [--count_only] [--count_delim=<char>] [--stats] [--decode_blob_index]\n  list_live_files_metadata [--sort_by_filename]\n  repair [--verbose]\n  backup [--backup_env_uri | --backup_fs_uri]  [--backup_dir]  [--num_threads]  [--stderr_log_level=<int (InfoLogLevel)>]\n  restore [--backup_env_uri | --backup_fs_uri]  [--backup_dir]  [--num_threads]  [--stderr_log_level=<int (InfoLogLevel)>]\n  checkpoint [--checkpoint_dir]\n  write_extern_sst <output_sst_path>\n  ingest_extern_sst <input_sst_path> [--move_files]  [--snapshot_consistency]  [--allow_global_seqno]  [--allow_blocking_flush]  [--ingest_behind]  [--write_global_seqno]\n  unsafe_remove_sst_file <SST file number        MUST NOT be used on a live DB.<\/pre>\n<\/li>\n<\/ol>\n","protected":false},"excerpt":{"rendered":"
    Install rocksdb first. brew install rocksdb Add alias in zshrc alias ldb = 'rocksdb_ldb –db=. ' List all column families # ldb list_column_families Column families in .: {default, S1, User, C1, C2, U1, C3} Scan command: # ldb –column_family=User scan … Continue reading →<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[105],"tags":[],"class_list":["post-2198","post","type-post","status-publish","format-standard","hentry","category-rocksdb"],"_links":{"self":[{"href":"https:\/\/cowmanchiang.me\/wp\/index.php?rest_route=\/wp\/v2\/posts\/2198","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/cowmanchiang.me\/wp\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/cowmanchiang.me\/wp\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/cowmanchiang.me\/wp\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/cowmanchiang.me\/wp\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=2198"}],"version-history":[{"count":1,"href":"https:\/\/cowmanchiang.me\/wp\/index.php?rest_route=\/wp\/v2\/posts\/2198\/revisions"}],"predecessor-version":[{"id":2199,"href":"https:\/\/cowmanchiang.me\/wp\/index.php?rest_route=\/wp\/v2\/posts\/2198\/revisions\/2199"}],"wp:attachment":[{"href":"https:\/\/cowmanchiang.me\/wp\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=2198"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/cowmanchiang.me\/wp\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=2198"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/cowmanchiang.me\/wp\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=2198"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}