Contents
- 1 InfiniDBとは
- 2 環境
- 3 サーバの構築
- 4 設定
- 5 ツール
- 5.1 autoConfigure
- 5.2 binary_installer.sh
- 5.3 bulklogReport.sh
- 5.4 calpontAlias
- 5.5 calpontConsole
- 5.6 calpontDBWrite
- 5.7 calpontLogRotate
- 5.8 calpontSupport
- 5.9 calpontSyslog
- 5.10 calpontSyslog-ng
- 5.11 calpontUninstall.sh
- 5.12 clearShm
- 5.13 cleartablelock
- 5.14 colxml
- 5.15 configReport.sh
- 5.16 configxml.sh
- 5.17 controllernode
- 5.18 cpimport
- 5.19 cpimport.bin
- 5.20 cplogger
- 5.21 dbbuilder
- 5.22 dbrmctl
- 5.23 ddlcleanup
- 5.24 DDLProc
- 5.25 DecomSvr
- 5.26 director_installer.sh
- 5.27 DMLProc
- 5.28 editem
- 5.29 ExeMgr
- 5.30 getConfig
- 5.31 hadoopReport.sh
- 5.32 hardwareReport.sh
- 5.33 hdfsCheck
- 5.34 IDBInstanceCmds.sh
- 5.35 idbmeminfo
- 5.36 IDBVolumeCmds.sh
- 5.37 infinidb
- 5.38 infinidb.def
- 5.39 load_brm
- 5.40 logReport.sh
- 5.41 master-rep-infinidb.sh
- 5.42 module_installer.sh
- 5.43 myCnf-exclude-args.text
- 5.44 myCnf-include-args.text
- 5.45 mycnfUpgrade
- 5.46 os_check.sh
- 5.47 patchInstaller
- 5.48 patch_installer.sh
- 5.49 performance_installer.sh
- 5.50 postConfigure
- 5.51 post-mysqld-install
- 5.52 post-mysql-install
- 5.53 pre-uninstall
- 5.54 PrimProc
- 5.55 ProcMgr
- 5.56 ProcMon
- 5.57 remote_command.sh
- 5.58 remote_scp_get.sh
- 5.59 remote_scp_put.sh
- 5.60 remotessh.exp
- 5.61 reset_locks
- 5.62 resourceReport.sh
- 5.63 rollback
- 5.64 rsync.sh
- 5.65 run.sh
- 5.66 save_brm
- 5.67 sendtrap
- 5.68 ServerMonitor
- 5.69 setConfig
- 5.70 setenv-hdfs-12
- 5.71 setenv-hdfs-20
- 5.72 slave-rep-infinidb.sh
- 5.73 softwareReport.sh
- 5.74 startupTests.sh
- 5.75 syslogSetup.sh
- 5.76 transactionLog
- 5.77 transactionLogArchiver.sh
- 5.78 trapHandler
- 5.79 使用しないツール
InfiniDBとは
公式ページ:http://www.infinidb.co/
ドキュメント:http://infinidb.co/content/infinidb-4-documentation
PDFでダウンロード
日本の販社による日本語マニュアル
特徴
- データは通常他のデータベースから持ってくるので、NOT NULL等の制約、auto incrementなどは使用できない
- インデックス、主キーの指定は出来ない
用語
Tips
- MySQL Workbenchは使用できない。使用しようとすると次のようなエラーが出る。
Table creation is not allowed in infinidb_vtable schema.
これはデフォルトで作成されるinfinidb_vtableデータベースを削除しても解消されない。
環境
- OS
CentOS release 6.4 (64bit)
- InfiniDB Version
4.5.0-1
サーバの構築
InfiniDBインストール
rpmからインストール
- rootになる
su -
- ダウンロードサイトでは認証が必要なため、ユーザ登録の後に一旦ローカルにアーカイブをダウンロードする。
infinidb-4.5.0-1.x86_64.rpm.tar.gz
- サーバにアーカイブを転送する
- アーカイブファイルを展開する
tar xvzf infinidb-*.rpm.tar.gz
- 展開された各rpmをインストールする
yum localinstall infinidb-*.rpm
※全て/usr/local/Calpontにインストールされる。 - インストール先の名前を変更する
mv /usr/local/Calpont /usr/local/infinidb-4.5.0-1
- インストールディレクトリへのシンボリックリンクを作成する
ln -s /usr/local/infinidb-4.5.0-1 /usr/local/infinidb
これによって、複数のバージョンを同居させ、リンクを切り替えることで、バージョン変更が可能 - インストールに使用したパッケージを削除する
rm -rf infinidb*
- ライブラリのパスを設定する
echo /usr/local/infinidb/lib > /etc/ld.so.conf.d/infinidb.conf # 確認 ldconfig -v
- ツール類のデフォルトのパスのためにリンクを作成する
ln -s /usr/local/infinidb /usr/local/Calpont
- インストールスクリプトを実行する
/usr/local/infinidb/bin/postConfigure
途中いくつかの質問に答える必要がある
- ログ
This is the Calpont InfiniDB System Configuration and Installation tool. It will Configure the Calpont InfiniDB System and will perform a Package Installation of all of the Servers within the System that is being configured. IMPORTANT: This tool should only be run on the Parent OAM Module which is a Performance Module, preferred Module #1 Prompting instructions: Press 'enter' to accept a value in (), if available or Enter one of the options within [], if available, or Enter a new value ===== Setup System Server Type Configuration ===== There are 2 options when configuring the System Server Type: single and multi 'single' - Single-Server install is used when there will only be 1 server configured on the system. It's a shorter install procedure used for POC testing, as an example. It can also be used for production systems, if the plan is to stay single-server. 'multi' - Multi-Server install is used when you want to configure multiple servers now or in the future. With Multi-Server install, you can still configure just 1 server now and add on addition servers/modules in the future. This is used more for production installs. Select the type of System Server install [1=single, 2=multi] (1) > Performing the Single Server Install. Enter System Name (calpont-1) > ===== Setup Storage Configuration ===== ----- Setup High Availability Data Storage Mount Configuration ----- There are 2 options when configuring the storage: internal or external 'internal' - This is specified when a local disk is used for the dbroot storage or the dbroot storage directories are manually mounted externally but no High Availability Support is required. 'external' - This is specified when the dbroot directories are externally mounted and High Availability Failover Support is required. Select the type of Data Storage [1=internal, 2=external] (1) > Enter the list (Nx,Ny,Nz) or range (Nx-Nz) of dbroot IDs assigned to module 'pm1' (1) > ===== InfiniDB SNMP-Trap Process Check ===== InfiniDB is packaged with an SNMP-Trap process. If the system where InfiniDB is being installed already has an SNMP-Trap process running, then you have the option of disabling InfiniDB's SNMP-Trap process. Not having the InfiniDB SNMP-Trap process will affect the generation of InfiniDB alarms and associated SNMP traps. Please reference the Calpont InfiniDB Installation Guide for additional information. InfiniDB SNMP-Trap process is enabled, would you like to disable it [y,n] (n) > InfiniDB SNMP Process successfully enabled ===== Setup the Network Management System (NMS) Server Configuration ===== This would be used to receive SNMP Traps from InfiniDB, like a Network Control Center Enter IP Address(es) of NMS Server (0.0.0.0) > ===== Performing Configuration Setup and InfiniDB Startup ===== NOTE: Setting 'NumBlocksPct' to 50% Setting 'TotalUmMemory' to 25% of total memory (Combined Server Install maximum value is 16G). Value set to 1G Running the Infinidb MySQL setup scripts Starting MySQL. SUCCESS! Shutting down MySQL. SUCCESS! SUCCESS! Starting InfiniDB Database Platform InfiniDB Database Platform Starting, please wait ....... DONE System Catalog Successfull Created InfiniDB Install Successfully Completed, System is Active Enter the following command to define InfiniDB Alias Commands . /usr/local/infinidb-4.5.0-1/bin/calpontAlias Enter 'idbmysql' to access the InfiniDB MySQL console Enter 'cc' to access the InfiniDB OAM console
- ログ
- 起動スクリプトにパーミッションを設定する
chmod 554 /etc/init.d/infinidb
- サービス登録する
chkconfig --add infinidb # 登録を確認する chkconfig --list infinidb
- 共通した環境とするために環境変数を設定する
export INFINIDB_HOME=/usr/local/infinidb
- ツール類にパスを通す
export PATH=$INFINIDB_HOME/bin:$INFINIDB_HOME/sbin:$INFINIDB_HOME/mysql/bin:$PATH
- 環境変数を再起動後も有効にする
echo "export INFINIDB_HOME=/usr/local/infinidb" >> /etc/bashrc echo "export PATH=\$INFINIDB_HOME/bin:\$INFINIDB_HOME/sbin:\$INFINIDB_HOME/mysql/bin:\$PATH" >> /etc/bashrc
- UNIXソケットのリンクを作成する
ln -s $INFINIDB_HOME/mysql/lib/mysql/mysql.sock /tmp/mysql.sock
直接展開してインストール
- rootになる
su -
- ユーザ、グループを作成する
useradd --user-group --no-create-home --shell /sbin/nologin rabbitmq
- 関連パッケージをインストールする
- ダウンロードサイトでは認証が必要なため、ユーザ登録の後に一旦ローカルにアーカイブをダウンロードする。
- サーバにアーカイブを転送する
- アーカイブファイルを展開する
tar xzfv infinidb-*.bin.tar.gz
- ファイルをインストール場所へ移動する
mv Calpont /usr/local/infinidb-4.5.0-1
- インストールディレクトリへのシンボリックリンクを作成する
ln -s /usr/local/infinidb-4.5.0-1 /usr/local/infinidb
これによって、複数のバージョンを同居させ、リンクを切り替えることで、バージョン変更が可能 - インストールに使用したパッケージを削除する
rm -rf infinidb*
- ライブラリのパスを設定する
echo /usr/local/infinidb/lib > /etc/ld.so.conf.d/infinidb.conf # 確認 ldconfig -v
- ツール類のデフォルトのパスのためにリンクを作成する
ln -s /usr/local/infinidb /usr/local/Calpont
- インストールスクリプトを実行する
/usr/local/infinidb/bin/postConfigure
途中いくつかの質問に答える必要がある
- ログ
This is the Calpont InfiniDB System Configuration and Installation tool. It will Configure the Calpont InfiniDB System and will perform a Package Installation of all of the Servers within the System that is being configured. IMPORTANT: This tool should only be run on the Parent OAM Module which is a Performance Module, preferred Module #1 Prompting instructions: Press 'enter' to accept a value in (), if available or Enter one of the options within [], if available, or Enter a new value ===== Setup System Server Type Configuration ===== There are 2 options when configuring the System Server Type: single and multi 'single' - Single-Server install is used when there will only be 1 server configured on the system. It's a shorter install procedure used for POC testing, as an example. It can also be used for production systems, if the plan is to stay single-server. 'multi' - Multi-Server install is used when you want to configure multiple servers now or in the future. With Multi-Server install, you can still configure just 1 server now and add on addition servers/modules in the future. This is used more for production installs. Select the type of System Server install [1=single, 2=multi] (1) > Performing the Single Server Install. Enter System Name (calpont-1) > ===== Setup Storage Configuration ===== ----- Setup High Availability Data Storage Mount Configuration ----- There are 2 options when configuring the storage: internal or external 'internal' - This is specified when a local disk is used for the dbroot storage or the dbroot storage directories are manually mounted externally but no High Availability Support is required. 'external' - This is specified when the dbroot directories are externally mounted and High Availability Failover Support is required. Select the type of Data Storage [1=internal, 2=external] (1) > Enter the list (Nx,Ny,Nz) or range (Nx-Nz) of dbroot IDs assigned to module 'pm1' (1) > ===== InfiniDB SNMP-Trap Process Check ===== InfiniDB is packaged with an SNMP-Trap process. If the system where InfiniDB is being installed already has an SNMP-Trap process running, then you have the option of disabling InfiniDB's SNMP-Trap process. Not having the InfiniDB SNMP-Trap process will affect the generation of InfiniDB alarms and associated SNMP traps. Please reference the Calpont InfiniDB Installation Guide for additional information. InfiniDB SNMP-Trap process is enabled, would you like to disable it [y,n] (n) > InfiniDB SNMP Process successfully enabled ===== Setup the Network Management System (NMS) Server Configuration ===== This would be used to receive SNMP Traps from InfiniDB, like a Network Control Center Enter IP Address(es) of NMS Server (0.0.0.0) > ===== Performing Configuration Setup and InfiniDB Startup ===== NOTE: Setting 'NumBlocksPct' to 50% Setting 'TotalUmMemory' to 25% of total memory (Combined Server Install maximum value is 16G). Value set to 1G Running the Infinidb MySQL setup scripts Starting MySQL. SUCCESS! Shutting down MySQL. SUCCESS! SUCCESS! Starting InfiniDB Database Platform InfiniDB Database Platform Starting, please wait ....... DONE System Catalog Successfull Created InfiniDB Install Successfully Completed, System is Active Enter the following command to define InfiniDB Alias Commands . /usr/local/infinidb-4.5.0-1/bin/calpontAlias Enter 'idbmysql' to access the InfiniDB MySQL console Enter 'cc' to access the InfiniDB OAM console
- ログ
- 起動スクリプトにパーミッションを設定する
chmod 554 /etc/init.d/infinidb
- サービス登録する
chkconfig --add infinidb # 登録を確認する chkconfig --list infinidb
- 共通した環境とするために環境変数を設定する
export INFINIDB_HOME=/usr/local/infinidb
- ツール類にパスを通す
export PATH=$INFINIDB_HOME/bin:$INFINIDB_HOME/sbin:$INFINIDB_HOME/mysql/bin:$PATH
- 環境変数を再起動後も有効にする
echo "export INFINIDB_HOME=/usr/local/infinidb" >> /etc/bashrc echo "export PATH=\$INFINIDB_HOME/bin:\$INFINIDB_HOME/sbin:\$INFINIDB_HOME/mysql/bin:\$PATH" >> /etc/bashrc
- UNIXソケットのリンクを作成する
ln -s $INFINIDB_HOME/mysql/lib/mysql/mysql.sock /tmp/mysql.sock
設定
MySQLの設定
MySQLは5.1.73が使用されている。
MySQLの通常の設定方法にならい行う。
通常の設定項目のほか独自の設定項目が存在する。
なお、インストールにより/etc/init.d/mysql-Calpontが作成されるが、
こちらでrestartを指定しても正常にMySQLの再起動が行われないので、
/etc/init.d/infinidbを使用する必要がある。
正常に起動しなかった場合にエラーログは以下で確認できる。
$INFINIDB_HOME/mysql/db/*.err
- 設定ファイルパス
$INFINIDB_HOME/mysql/my.cnf
参考:http://dev.mysql.com/doc/refman/5.1/en/server-system-variables.html
初期状態
# # $Id: my.cnf 9502 2013-05-09 15:37:30Z pleblanc $ # # Example MySQL config file for very large systems. # # This is for a large system with memory of 1G-2G where the system runs mainly # MySQL. # # You can copy this file to # /etc/my.cnf to set global options, # mysql-data-dir/my.cnf to set server-specific options (in this # installation this directory is /var/lib/mysql) or # ~/.my.cnf to set user-specific options. # # In this file, you can use all long options that a program supports. # If you want to know which options a program supports, run the program # with the "--help" option. # The following options will be passed to all MySQL clients [client] #password = your_password port = 3306 socket = /usr/local/infinidb-4.5.0-1/mysql/lib/mysql/mysql.sock # Here follows entries for some specific programs # The MySQL server [mysqld] port = 3306 socket = /usr/local/infinidb-4.5.0-1/mysql/lib/mysql/mysql.sock datadir = /usr/local/infinidb-4.5.0-1/mysql/db skip-external-locking key_buffer = 512M max_allowed_packet = 1M table_cache = 512 sort_buffer_size = 4M read_buffer_size = 4M read_rnd_buffer_size = 16M myisam_sort_buffer_size = 64M thread_cache_size = 8 query_cache_size = 0 # Try number of CPU's*2 for thread_concurrency thread_concurrency = 8 thread_stack = 512K join_buffer_size = 128M lower_case_table_names=1 # Enable compression by default on create, set to 0 to turn off infinidb_compression_type=2 # Default for string table threshhold infinidb_stringtable_threshold=20 # infinidb local query flag # infinidb_local_query=1 basedir = /usr/local/infinidb-4.5.0-1/mysql/ character-sets-dir = /usr/local/infinidb-4.5.0-1/mysql/share/mysql/charsets/ language = /usr/local/infinidb-4.5.0-1/mysql/share/mysql/english/ plugin_dir = /usr/local/infinidb-4.5.0-1/mysql/lib/mysql/plugin # Don't listen on a TCP/IP port at all. This can be a security enhancement, # if all processes that need to connect to mysqld run on the same host. # All interaction with mysqld must be made via Unix sockets or named pipes. # Note that using this option without enabling named pipes on Windows # (via the "enable-named-pipe" option) will render mysqld useless! # #skip-networking # Replication Master Server (default) # binary logging is required for replication # log-bin=mysql-bin # required unique id between 1 and 2^32 - 1 # defaults to 1 if master-host # uses to 2+ if slave-host server-id = 1 # Replication Slave (comment out master section to use this) # # To configure this host as a replication slave, you can choose between # two methods : # # 1) Use the CHANGE MASTER TO command (fully described in our manual) - # the syntax is: # # CHANGE MASTER TO MASTER_HOST=<host>, MASTER_PORT=<port>, # MASTER_USER=<user>, MASTER_PASSWORD=<password> ; # # where you replace <host>, <user>, <password> by quoted strings and # <port> by the master's port number (3306 by default). # # Example: # # CHANGE MASTER TO MASTER_HOST='125.564.12.1', MASTER_PORT=3306, # MASTER_USER='joe', MASTER_PASSWORD='secret'; # # OR # # 2) Set the variables below. However, in case you choose this method, then # start replication for the first time (even unsuccessfully, for example # if you mistyped the password in master-password and the slave fails to # connect), the slave will create a master.info file, and any later # change in this file to the variables' values below will be ignored and # overridden by the content of the master.info file, unless you shutdown # the slave server, delete master.info and restart the slaver server. # For that reason, you may want to leave the lines below untouched # (commented) and instead use CHANGE MASTER TO (see above) # # # The replication master for this slave - required #master-host = <hostname> # # The username the slave will use for authentication when connecting # to the master - required #master-user = <username> # # The password the slave will authenticate with when connecting to # the master - required #master-password = <password> # # The port the master is listening on. # optional - defaults to 3306 #master-port = <port> # # binary logging - not required for slaves, but recommended #log-bin=mysql-bin #relay-log=HOSTNAME-relay-bin # Point the following paths to different dedicated disks #tmpdir = /tmp/ #log-update = /path-to-dedicated-directory/hostname # Uncomment the following if you are using InnoDB tables #innodb_data_home_dir = /usr/local/infinidb-4.5.0-1/mysql/lib/mysql/ #innodb_data_file_path = ibdata1:2000M;ibdata2:10M:autoextend #innodb_log_group_home_dir = /usr/local/infinidb-4.5.0-1/mysql/lib/mysql/ #innodb_log_arch_dir = /usr/local/infinidb-4.5.0-1/mysql/lib/mysql/ # You can set .._buffer_pool_size up to 50 - 80 % # of RAM but beware of setting memory usage too high #innodb_buffer_pool_size = 384M #innodb_additional_mem_pool_size = 20M # Set .._log_file_size to 25 % of buffer pool size #innodb_log_file_size = 100M #innodb_log_buffer_size = 8M #innodb_flush_log_at_trx_commit = 1 #innodb_lock_wait_timeout = 50 [mysqldump] quick max_allowed_packet = 16M [mysql] no-auto-rehash # Remove the next comment character if you are not familiar with SQL #safe-updates [isamchk] key_buffer = 256M sort_buffer_size = 256M read_buffer = 2M write_buffer = 2M [myisamchk] key_buffer = 256M sort_buffer_size = 256M read_buffer = 2M write_buffer = 2M [mysqlhotcopy] interactive-timeout
InfiniDB用の設定
InfiniDBの設定もmy.cnfを通して行う。
infinidb_compression_type=2
infinidb_decimal_scale=8
infinidb_double_for_decimal_math=OFF
infinidb_local_query=0
infinidb_ordered_only=OFF
infinidb_string_scan_threshold=10
infinidb_stringtable_threshold=20
infinidb_use_decimal_scale=OFF
infinidb_varbin_always_hex=OFF
infinidb_vtable_mode=1
- デフォルト
infinidb_compression_type=2 infinidb_decimal_scale=8 infinidb_double_for_decimal_math=OFF infinidb_local_query=0 infinidb_ordered_only=OFF infinidb_string_scan_threshold=10 infinidb_stringtable_threshold=20 infinidb_use_decimal_scale=OFF infinidb_varbin_always_hex=OFF infinidb_vtable_mode=1
設定例
[client] port = 3306 socket = /usr/local/infinidb-4.5.0-1/mysql/lib/mysql/mysql.sock [mysqld] port = 3306 socket = /usr/local/infinidb-4.5.0-1/mysql/lib/mysql/mysql.sock datadir = /usr/local/infinidb-4.5.0-1/mysql/db skip-external-locking key_buffer = 512M max_allowed_packet = 1M table_cache = 512 sort_buffer_size = 4M read_buffer_size = 4M read_rnd_buffer_size = 16M myisam_sort_buffer_size = 64M thread_cache_size = 8 query_cache_size = 0 thread_concurrency = 8 thread_stack = 512K join_buffer_size = 128M lower_case_table_names=1 infinidb_compression_type=2 infinidb_stringtable_threshold=20 basedir = /usr/local/infinidb-4.5.0-1/mysql/ character-sets-dir = /usr/local/infinidb-4.5.0-1/mysql/share/mysql/charsets/ language = /usr/local/infinidb-4.5.0-1/mysql/share/mysql/english/ plugin_dir = /usr/local/infinidb-4.5.0-1/mysql/lib/mysql/plugin server-id = 1 default_storage_engine=InfiniDB character_set_server=utf8 lc_time_names= [mysqldump] quick max_allowed_packet = 16M [mysql] no-auto-rehash [isamchk] key_buffer = 256M sort_buffer_size = 256M read_buffer = 2M write_buffer = 2M [myisamchk] key_buffer = 256M sort_buffer_size = 256M read_buffer = 2M write_buffer = 2M [mysqlhotcopy] interactive-timeout
InfiniDBの設定
InfiniDBはMySQL内で動作する以外に単独で監視サービスなども提供する。
設定はXMLファイルで行い、以下のパスに存在する。
$INFINIDB_HOME/etc/Calpont.xml
初期設定
<?xml version="1.0" encoding="UTF-8"?> <!-- $Id: Calpont.xml 1286 2009-03-30 22:39:41Z dcathey $ --> <Calpont Version="V1.0.0"> <ExeMgr1> <IPAddr>127.0.0.1</IPAddr> <Port>8601</Port> <Module>pm1</Module> </ExeMgr1> <JobProc> <IPAddr>0.0.0.0</IPAddr> <Port>8602</Port> </JobProc> <ProcMgr> <IPAddr>127.0.0.1</IPAddr> <Port>8603</Port> </ProcMgr> <ProcStatusControl> <IPAddr>127.0.0.1</IPAddr> <Port>8604</Port> </ProcStatusControl> <ProcStatusControlStandby> <IPAddr>0.0.0.0</IPAddr> <Port>8605</Port> </ProcStatusControlStandby> <localhost_ProcessMonitor> <IPAddr>127.0.0.1</IPAddr> <Port>8800</Port> </localhost_ProcessMonitor> <dm1_ProcessMonitor> <IPAddr>0.0.0.0</IPAddr> <Port>8800</Port> </dm1_ProcessMonitor> <um1_ProcessMonitor> <IPAddr>0.0.0.0</IPAddr> <Port>8800</Port> </um1_ProcessMonitor> <pm1_ProcessMonitor> <IPAddr>127.0.0.1</IPAddr> <Port>8800</Port> </pm1_ProcessMonitor> <dm1_ServerMonitor> <IPAddr>0.0.0.0</IPAddr> <Port>8622</Port> </dm1_ServerMonitor> <um1_ServerMonitor> <IPAddr>0.0.0.0</IPAddr> <Port>8622</Port> </um1_ServerMonitor> <pm1_ServerMonitor> <IPAddr>127.0.0.1</IPAddr> <Port>8622</Port> </pm1_ServerMonitor> <pm1_WriteEngineServer> <IPAddr>127.0.0.1</IPAddr> <Port>8630</Port> </pm1_WriteEngineServer> <DDLProc> <IPAddr>127.0.0.1</IPAddr> <Port>8612</Port> </DDLProc> <DMLProc> <IPAddr>127.0.0.1</IPAddr> <Port>8614</Port> </DMLProc> <BatchInsert> <RowsPerBatch>10000</RowsPerBatch> </BatchInsert> <PrimitiveServers> <Count>1</Count> <ConnectionsPerPrimProc>8</ConnectionsPerPrimProc> <ProcessorThreshold>128</ProcessorThreshold> <!-- <ProcessorThreads>16</ProcessorThreads> --> <!-- defaults to num cores * 2 --> <ProcessorQueueSize>10K</ProcessorQueueSize> <!-- minimum of extent size 8192 --> <DebugLevel>0</DebugLevel> <LBID_Shift>13</LBID_Shift> <ColScanBufferSizeBlocks>512</ColScanBufferSizeBlocks> <ColScanReadAheadBlocks>512</ColScanReadAheadBlocks> <!-- s/b factor of extent size 8192 --> <!-- <BPPCount>16</BPPCount> --> <!-- Default num cores * 2. A cap on the number of simultaneous primitives per jobstep --> <PrefetchThreshold>1</PrefetchThreshold> <PTTrace>0</PTTrace> <RotatingDestination>n</RotatingDestination> <!-- <HighPriorityPercentage>60</HighPriorityPercentage> --> <!-- <MediumPriorityPercentage>30</MediumPriorityPercentage> --> <!-- <LowPriorityPercentage>10</LowPriorityPercentage> --> <AggregationMemoryCheck>95</AggregationMemoryCheck> <DirectIO>y</DirectIO> </PrimitiveServers> <PMS1> <IPAddr>127.0.0.1</IPAddr> <Port>8620</Port> </PMS1> <PMS2> <IPAddr>127.0.0.1</IPAddr> <Port>8620</Port> </PMS2> <PMS3> <IPAddr>127.0.0.1</IPAddr> <Port>8620</Port> </PMS3> <PMS4> <IPAddr>127.0.0.1</IPAddr> <Port>8620</Port> </PMS4> <PMS5> <IPAddr>127.0.0.1</IPAddr> <Port>8620</Port> </PMS5> <PMS6> <IPAddr>127.0.0.1</IPAddr> <Port>8620</Port> </PMS6> <PMS7> <IPAddr>127.0.0.1</IPAddr> <Port>8620</Port> </PMS7> <PMS8> <IPAddr>127.0.0.1</IPAddr> <Port>8620</Port> </PMS8> <PMS9> <IPAddr>127.0.0.1</IPAddr> <Port>8620</Port> </PMS9> <PMS10> <IPAddr>127.0.0.1</IPAddr> <Port>8620</Port> </PMS10> <PMS11> <IPAddr>127.0.0.1</IPAddr> <Port>8620</Port> </PMS11> <PMS12> <IPAddr>127.0.0.1</IPAddr> <Port>8620</Port> </PMS12> <PMS13> <IPAddr>127.0.0.1</IPAddr> <Port>8620</Port> </PMS13> <PMS14> <IPAddr>127.0.0.1</IPAddr> <Port>8620</Port> </PMS14> <PMS15> <IPAddr>127.0.0.1</IPAddr> <Port>8620</Port> </PMS15> <PMS16> <IPAddr>127.0.0.1</IPAddr> <Port>8620</Port> </PMS16> <PMS17> <IPAddr>127.0.0.1</IPAddr> <Port>8620</Port> </PMS17> <PMS18> <IPAddr>127.0.0.1</IPAddr> <Port>8620</Port> </PMS18> <PMS19> <IPAddr>127.0.0.1</IPAddr> <Port>8620</Port> </PMS19> <PMS20> <IPAddr>127.0.0.1</IPAddr> <Port>8620</Port> </PMS20> <PMS21> <IPAddr>127.0.0.1</IPAddr> <Port>8620</Port> </PMS21> <PMS22> <IPAddr>127.0.0.1</IPAddr> <Port>8620</Port> </PMS22> <PMS23> <IPAddr>127.0.0.1</IPAddr> <Port>8620</Port> </PMS23> <PMS24> <IPAddr>127.0.0.1</IPAddr> <Port>8620</Port> </PMS24> <PMS25> <IPAddr>127.0.0.1</IPAddr> <Port>8620</Port> </PMS25> <PMS26> <IPAddr>127.0.0.1</IPAddr> <Port>8620</Port> </PMS26> <PMS27> <IPAddr>127.0.0.1</IPAddr> <Port>8620</Port> </PMS27> <PMS28> <IPAddr>127.0.0.1</IPAddr> <Port>8620</Port> </PMS28> <PMS29> <IPAddr>127.0.0.1</IPAddr> <Port>8620</Port> </PMS29> <PMS30> <IPAddr>127.0.0.1</IPAddr> <Port>8620</Port> </PMS30> <PMS31> <IPAddr>127.0.0.1</IPAddr> <Port>8620</Port> </PMS31> <PMS32> <IPAddr>127.0.0.1</IPAddr> <Port>8620</Port> </PMS32> <SystemConfig> <SystemLang>C</SystemLang> <SystemName>calpont-1</SystemName> <ParentOAMModuleName>pm1</ParentOAMModuleName> <StandbyOAMModuleName>unassigned</StandbyOAMModuleName> <!-- Disabled <ProcessHeartbeatPeriod>-1</ProcessHeartbeatPeriod> --> <!-- Warning: Do not change this value once database is built --> <DBRootCount>1</DBRootCount> <DBRoot1>/usr/local/infinidb-4.5.0-1/data1</DBRoot1> <DBRMRoot>$INSTALLDIR/data1/systemFiles/dbrm/BRM_saves</DBRMRoot> <TableLockSaveFile>$INSTALLDIR/data1/systemFiles/dbrm/tablelocks</TableLockSaveFile> <DBRMTimeOut>20</DBRMTimeOut> <!-- in seconds --> <DBRMSnapshotInterval>100000</DBRMSnapshotInterval> <ExternalCriticalThreshold>90</ExternalCriticalThreshold> <ExternalMajorThreshold>80</ExternalMajorThreshold> <ExternalMinorThreshold>70</ExternalMinorThreshold> <TempDiskPath>/tmp</TempDiskPath> <WorkingDir>/tmp</WorkingDir> <TransactionArchivePeriod>10</TransactionArchivePeriod> <NMSIPAddress>0.0.0.0</NMSIPAddress> <TempSaveSize>128M</TempSaveSize> <!-- default SWSDL max element save size --> <WaitPeriod>10</WaitPeriod> <!-- in seconds --> <TempFileDir>/tmp/infinidb_tmp_files</TempFileDir> <CalpontHome>$INSTALLDIR</CalpontHome> <ModuleHeartbeatPeriod>10</ModuleHeartbeatPeriod> <ModuleHeartbeatCount>3</ModuleHeartbeatCount> <ProcessRestartCount>10</ProcessRestartCount> <ProcessRestartPeriod>120</ProcessRestartPeriod> <SwapAction>restartSystem</SwapAction> <!-- OAM command (or 'none') to run when swap space exceeds Major Threshold --> <ActivePmFailoverDisabled>n</ActivePmFailoverDisabled> <MemoryCheckPercent>95</MemoryCheckPercent> <!-- Max real memory to limit growth of buffers to --> <DataFileLog>OFF</DataFileLog> <!-- enable if you want to limit how much memory may be used for hdfs read/write memory buffers. <hdfsRdwrBufferMaxSize>8G</hdfsRdwrBufferMaxSize> --> <hdfsRdwrScratch>/tmp/rdwrscratch</hdfsRdwrScratch> <!-- Do not set to an hdfs file path --> <PrimaryUMModuleName>pm1</PrimaryUMModuleName> </SystemConfig> <SystemModuleConfig> <ModuleType1>dm</ModuleType1> <ModuleDesc1>Director Module</ModuleDesc1> <RunType1>SIMPLEX</RunType1> <ModuleCount1>0</ModuleCount1> <ModuleIPAddr1-1-1>0.0.0.0</ModuleIPAddr1-1-1> <ModuleHostName1-1-1>unassigned</ModuleHostName1-1-1> <ModuleDisableState1-1>ENABLED</ModuleDisableState1-1> <ModuleCPUCriticalThreshold1>0</ModuleCPUCriticalThreshold1> <ModuleCPUMajorThreshold1>0</ModuleCPUMajorThreshold1> <ModuleCPUMinorThreshold1>0</ModuleCPUMinorThreshold1> <ModuleCPUMinorClearThreshold1>0</ModuleCPUMinorClearThreshold1> <ModuleDiskCriticalThreshold1>90</ModuleDiskCriticalThreshold1> <ModuleDiskMajorThreshold1>80</ModuleDiskMajorThreshold1> <ModuleDiskMinorThreshold1>70</ModuleDiskMinorThreshold1> <ModuleMemCriticalThreshold1>90</ModuleMemCriticalThreshold1> <ModuleMemMajorThreshold1>0</ModuleMemMajorThreshold1> <ModuleMemMinorThreshold1>0</ModuleMemMinorThreshold1> <ModuleSwapCriticalThreshold1>90</ModuleSwapCriticalThreshold1> <ModuleSwapMajorThreshold1>80</ModuleSwapMajorThreshold1> <ModuleSwapMinorThreshold1>70</ModuleSwapMinorThreshold1> <ModuleDiskMonitorFileSystem1-1>/</ModuleDiskMonitorFileSystem1-1> <ModuleDBRootCount1-1>unassigned</ModuleDBRootCount1-1> <ModuleDBRootID1-1-1>unassigned</ModuleDBRootID1-1-1> <ModuleType2>um</ModuleType2> <ModuleDesc2>User Module</ModuleDesc2> <RunType2>SIMPLEX</RunType2> <ModuleCount2>0</ModuleCount2> <ModuleIPAddr1-1-2>0.0.0.0</ModuleIPAddr1-1-2> <ModuleHostName1-1-2>unassigned</ModuleHostName1-1-2> <ModuleDisableState1-2>ENABLED</ModuleDisableState1-2> <ModuleCPUCriticalThreshold2>0</ModuleCPUCriticalThreshold2> <ModuleCPUMajorThreshold2>0</ModuleCPUMajorThreshold2> <ModuleCPUMinorThreshold2>0</ModuleCPUMinorThreshold2> <ModuleCPUMinorClearThreshold2>0</ModuleCPUMinorClearThreshold2> <ModuleDiskCriticalThreshold2>90</ModuleDiskCriticalThreshold2> <ModuleDiskMajorThreshold2>80</ModuleDiskMajorThreshold2> <ModuleDiskMinorThreshold2>70</ModuleDiskMinorThreshold2> <ModuleMemCriticalThreshold2>90</ModuleMemCriticalThreshold2> <ModuleMemMajorThreshold2>0</ModuleMemMajorThreshold2> <ModuleMemMinorThreshold2>0</ModuleMemMinorThreshold2> <ModuleSwapCriticalThreshold2>90</ModuleSwapCriticalThreshold2> <ModuleSwapMajorThreshold2>80</ModuleSwapMajorThreshold2> <ModuleSwapMinorThreshold2>70</ModuleSwapMinorThreshold2> <ModuleDiskMonitorFileSystem1-2>/</ModuleDiskMonitorFileSystem1-2> <ModuleDBRootCount1-2>unassigned</ModuleDBRootCount1-2> <ModuleDBRootID1-1-2>unassigned</ModuleDBRootID1-1-2> <ModuleType3>pm</ModuleType3> <ModuleDesc3>Performance Module</ModuleDesc3> <RunType3>SIMPLEX</RunType3> <ModuleCount3>1</ModuleCount3> <ModuleIPAddr1-1-3>127.0.0.1</ModuleIPAddr1-1-3> <ModuleHostName1-1-3>localhost</ModuleHostName1-1-3> <ModuleDisableState1-3>ENABLED</ModuleDisableState1-3> <ModuleCPUCriticalThreshold3>0</ModuleCPUCriticalThreshold3> <ModuleCPUMajorThreshold3>0</ModuleCPUMajorThreshold3> <ModuleCPUMinorThreshold3>0</ModuleCPUMinorThreshold3> <ModuleCPUMinorClearThreshold3>0</ModuleCPUMinorClearThreshold3> <ModuleDiskCriticalThreshold3>90</ModuleDiskCriticalThreshold3> <ModuleDiskMajorThreshold3>80</ModuleDiskMajorThreshold3> <ModuleDiskMinorThreshold3>70</ModuleDiskMinorThreshold3> <ModuleMemCriticalThreshold3>90</ModuleMemCriticalThreshold3> <ModuleMemMajorThreshold3>0</ModuleMemMajorThreshold3> <ModuleMemMinorThreshold3>0</ModuleMemMinorThreshold3> <ModuleSwapCriticalThreshold3>90</ModuleSwapCriticalThreshold3> <ModuleSwapMajorThreshold3>80</ModuleSwapMajorThreshold3> <ModuleSwapMinorThreshold3>70</ModuleSwapMinorThreshold3> <ModuleDiskMonitorFileSystem1-3>/</ModuleDiskMonitorFileSystem1-3> <ModuleDBRootCount1-3>1</ModuleDBRootCount1-3> <ModuleDBRootID1-1-3>1</ModuleDBRootID1-1-3> </SystemModuleConfig> <SystemExtDeviceConfig> <Count>0</Count> <Name1>unassigned</Name1> <IPAddr1>0.0.0.0</IPAddr1> <DisableState1>ENABLED</DisableState1> </SystemExtDeviceConfig> <SessionManager> <MaxConcurrentTransactions>1000</MaxConcurrentTransactions> <SharedMemoryTmpFile>$INSTALLDIR/data1/systemFiles/dbrm/CalpontShm</SharedMemoryTmpFile> <TxnIDFile>$INSTALLDIR/data1/systemFiles/dbrm/SMTxnID</TxnIDFile> </SessionManager> <SessionMonitor> <SharedMemoryTmpFile>$INSTALLDIR/data1/systemFiles/dbrm/CalpontSessionMonitorShm</SharedMemoryTmpFile> <TransactionAgeLimit>10</TransactionAgeLimit> </SessionMonitor> <VersionBuffer> <!-- VersionBufferFileSize must be a multiple of 8192. One version buffer file will be put on each DB root. --> <VersionBufferFileSize>1GB</VersionBufferFileSize> </VersionBuffer> <OIDManager> <!-- XXXPAT: This is located in tmp so we all have R/W access. It should be relocated to $INSTALLDIR/share/oidbitmap on the production machine--> <!-- Do not change this file after database built --> <OIDBitmapFile>$INSTALLDIR/data1/systemFiles/dbrm/oidbitmap</OIDBitmapFile> <!-- Do not change this value after database built --> <FirstOID>3000</FirstOID> </OIDManager> <WriteEngine> <BulkRoot>$INSTALLDIR/data/bulk</BulkRoot> <BulkRollbackDir>$INSTALLDIR/data/bulk/rollback</BulkRollbackDir> <MaxFileSystemDiskUsagePct>98</MaxFileSystemDiskUsagePct> <CompressedPaddingBlocks>1</CompressedPaddingBlocks> <!-- Number of blocks used to pad compressed chunks --> </WriteEngine> <DBRM_Controller> <NumWorkers>1</NumWorkers> <IPAddr>127.0.0.1</IPAddr> <Port>8616</Port> </DBRM_Controller> <!-- Worker Port: 8700 - 8720 is reserved to support External Modules--> <DBRM_Worker1> <IPAddr>127.0.0.1</IPAddr> <Port>8700</Port> <Module>pm1</Module> </DBRM_Worker1> <DBRM_Worker2> <IPAddr>0.0.0.0</IPAddr> <Port>8700</Port> <Module>unassigned</Module> </DBRM_Worker2> <DBRM_Worker3> <IPAddr>0.0.0.0</IPAddr> <Port>8700</Port> <Module>unassigned</Module> </DBRM_Worker3> <DBRM_Worker4> <IPAddr>0.0.0.0</IPAddr> <Port>8700</Port> <Module>unassigned</Module> </DBRM_Worker4> <DBRM_Worker5> <IPAddr>0.0.0.0</IPAddr> <Port>8700</Port> <Module>unassigned</Module> </DBRM_Worker5> <DBRM_Worker6> <IPAddr>0.0.0.0</IPAddr> <Port>8700</Port> <Module>unassigned</Module> </DBRM_Worker6> <DBRM_Worker7> <IPAddr>0.0.0.0</IPAddr> <Port>8700</Port> <Module>unassigned</Module> </DBRM_Worker7> <DBRM_Worker8> <IPAddr>0.0.0.0</IPAddr> <Port>8700</Port> <Module>unassigned</Module> </DBRM_Worker8> <DBRM_Worker9> <IPAddr>0.0.0.0</IPAddr> <Port>8700</Port> <Module>unassigned</Module> </DBRM_Worker9> <DBRM_Worker10> <IPAddr>0.0.0.0</IPAddr> <Port>8700</Port> <Module>unassigned</Module> </DBRM_Worker10> <DBBC> <!-- The percentage of RAM to use for the disk block cache. Defaults to 86% --> <NumBlocksPct>50</NumBlocksPct> <!-- <NumThreads>16</NumThreads> --> <!-- 1-256. Default is 16. --> <NumCaches>1</NumCaches><!-- # of parallel caches to instantiate --> <IOMTracing>0</IOMTracing> <BRPTracing>0</BRPTracing> <ReportFrequency>65536</ReportFrequency> <MaxOpenFiles>2K</MaxOpenFiles> <DecreaseOpenFilesCount>200</DecreaseOpenFilesCount> <FDCacheTrace>0</FDCacheTrace> </DBBC> <Installation> <SystemStartupOffline>n</SystemStartupOffline> <InitialInstallFlag>y</InitialInstallFlag> <SingleServerInstall>y</SingleServerInstall> <ServerTypeInstall>2</ServerTypeInstall> <PMwithUM>n</PMwithUM> <MySQLRep>n</MySQLRep> <DBRootStorageType>internal</DBRootStorageType> <UMStorageType>internal</UMStorageType> <SystemLogConfigFile>/etc/rsyslog.d/calpont.conf</SystemLogConfigFile> <rpw>unassigned</rpw> <Cloud>unassigned</Cloud> <EEPackageType>rpm</EEPackageType> <EnableSNMP>y</EnableSNMP> <AmazonX509Certificate>unassigned</AmazonX509Certificate> <AmazonX509PrivateKey>unassigned</AmazonX509PrivateKey> <AmazonRegion>us-east-1</AmazonRegion> <AmazonZone>unassigned</AmazonZone> <AmazonSubNetID>unassigned</AmazonSubNetID> <AmazonVPCNextPrivateIP>unassigned</AmazonVPCNextPrivateIP> <PMInstanceType>unassigned</PMInstanceType> <UMInstanceType>unassigned</UMInstanceType> <UMSecurityGroup>unassigned</UMSecurityGroup> <UMVolumeSize>unassigned</UMVolumeSize> <PMVolumeSize>unassigned</PMVolumeSize> <AmazonAutoTagging>n</AmazonAutoTagging> <AmazonElasticIPCount>0</AmazonElasticIPCount> <AmazonElasticIPAddr1>unassigned</AmazonElasticIPAddr1> <AmazonElasticModule1>unassigned</AmazonElasticModule1> <CoreFileFlag>n</CoreFileFlag> <GlusterConfig>n</GlusterConfig> </Installation> <ExtentMap> <!-- WARNING: these can only be changed on an empty system. Once any object has been allocated it cannot be changed!. Valid values for ExtentRows are: 64M, 8M and 1M. The default is 8M. --> <FilesPerColumnPartition>4</FilesPerColumnPartition> <!-- should be multiple of DBRootCount --> <ExtentsPerSegmentFile>2</ExtentsPerSegmentFile> <BRM_UID>0x0</BRM_UID> </ExtentMap> <HashJoin> <MaxBuckets>128</MaxBuckets> <MaxElems>128K</MaxElems> <!-- 128 buckets * 128K * 16 = 256 MB --> <FifoSizeLargeSide>128</FifoSizeLargeSide> <PmMaxMemorySmallSide>64M</PmMaxMemorySmallSide><!-- divide by 48 to get element count --> <TotalUmMemory>1G</TotalUmMemory> <TotalPmUmMemory>10%</TotalPmUmMemory> <CPUniqueLimit>100</CPUniqueLimit> </HashJoin> <JobList> <FlushInterval>16K</FlushInterval> <FifoSize>32</FifoSize> <RequestSize>1</RequestSize> <!-- Number of extents per request, should be less than MaxOutstandingRequests. Otherwise, default value 1 is used. --> <!-- ProcessorThreadsPerScan is the number of jobs issued to process each extent. The default is 16. MaxOutstandingRequests is the size of the window of work in terms of extents. A value of 20 means there is 20 extents worth of work for the PMs to process at any given time. ProcessorThreadsPerScan * MaxOutstandingRequests should be at least as many threads are available across all PMs. --> <!-- <ProcessorThreadsPerScan>16</ProcessorThreadsPerScan> --> <MaxOutstandingRequests>20</MaxOutstandingRequests> </JobList> <TupleWSDL> <MaxSize>1M</MaxSize> <!-- Max size in bytes per bucket --> <InitialCapacity>1M</InitialCapacity> <!-- Initial capacity per bucket --> <MaxBuckets>512</MaxBuckets> <!-- Number of buckets --> </TupleWSDL> <RowAggregation> <!-- <RowAggrThreads>8</RowAggrThreads> --> <!-- Default value is number of cores --> <!-- <RowAggrBuckets>32</RowAggrBuckets> --> <!-- Default value is number of cores * 4 --> <!-- <RowAggrRowGroupsPerThread>20</RowAggrRowGroupsPerThread> --> <!-- Default value is 20 --> </RowAggregation> <CrossEngineSupport> <Host>unassigned</Host> <Port>3306</Port> <User>unassigned</User> <Password/> </CrossEngineSupport> <QueryStats> <Enabled>N</Enabled> </QueryStats> <UserPriority> <Enabled>N</Enabled> </UserPriority> <NetworkCompression> <Enabled>Y</Enabled> </NetworkCompression> <QueryTele> <Host>127.0.0.1</Host> <Port>0</Port> </QueryTele> </Calpont>
ツール
autoConfigure
binary_installer.sh
bulklogReport.sh
calpontAlias
calpontConsole
InfiniDBにアクセスするコンソールツール
calpontDBWrite
calpontLogRotate
calpontSupport
calpontSyslog
calpontSyslog-ng
calpontUninstall.sh
clearShm
cleartablelock
colxml
configReport.sh
configxml.sh
controllernode
cpimport
InfiniDBのデータをロードするツール
- 使用方法
[root@XXXXX bin]# cpimport -h Simple usage using positional parameters (no XML job file): cpimport dbName tblName [loadFile] [-h] [-m mode] [-f path] [-d debugLevel] [-c readbufSize] [-b readBufs] [-r readers] [-j JobID] [-e maxErrs] [-B libBufSize] [-w parsers] [-s c] [-E enclosedChar] [-C escapeChar] [-n NullOption] [-q batchQty] [-p jobPath] [-P list of PMs] [-S] [-i] [-v verbose] [-I binaryOpt] Traditional usage without positional parameters (XML job file required): cpimport -j jobID [-h] [-m mode] [-r readers] [-w parsers] [-s c] [-f path] [-b readBufs] [-p path] [-c readBufSize] [-e maxErrs] [-B libBufSize] [-n NullOption] [-E encloseChar] [-C escapeChar] [-i] [-v verbose] [-d debugLevel] [-q batchQty] [-l loadFile] [-P list of PMs] [-S] [-I binaryOpt] Positional parameters: dbName Name of the database to load tblName Name of table to load loadFile Optional input file name in current directory, unless a fully qualified name is given. If not given, input read from STDIN. Options: -b Number of read buffers -c Application read buffer size(in bytes) -d Print different level(1-3) debug message -e Max number of allowable error per table per PM -f Data file directory path. Default is current working directory. In Mode 1, -f represents the local input file path. In Mode 2, -f represents the PM based input file path. In Mode 3, -f represents the local input file path. -l Name of import file to be loaded, relative to -f path, -h Print this message. -q Batch Quantity, Number of rows distributed per batch in Mode 1 -i Print extended info to console in Mode 3. -j Job ID. In simple usage, default is the table OID. unless a fully qualified input file name is given. -n NullOption (0-treat the string NULL as data (default); 1-treat the string NULL as a NULL value) -p Path for XML job description file. -r Number of readers. -s 'c' is the delimiter between column values. -B I/O library read buffer size (in bytes) -w Number of parsers. -E Enclosed by character if field values are enclosed. -C Escape character used in conjunction with 'enclosed by' character, or as part of NULL escape sequence ('\N'); default is '\' -I Import binary data; how to treat NULL values: 1 - import NULL values 2 - saturate NULL values -P List of PMs ex: -P 1,2,3. Default is all PMs. -S Treat string truncations as errors. -m mode 1 - rows will be loaded in a distributed manner across PMs. 2 - PM based input files loaded onto their respective PM. 3 - input files will be loaded on the local PM. Example1: Traditional usage cpimport -j 1234 Example2: Some column values are enclosed within double quotes. cpimport -j 3000 -E '"' Example3: Import a nation table without a Job XML file cpimport -j 301 tpch nation nation.tbl Example4: Import a nation table to all PMs in Mode 1 cpimport -m 1 tpch nation nation.tbl Example4: Import a nation table to only PM1 and PM2 in Mode 1 cpimport -m 1 -P 1,2 tpch nation nation.tbl Example5: Import nation.tbl from PMs to nation table in Mode 2 cpimport -m 2 tpch nation -l nation.tbl Example6: Import nation.tbl in mode 3 cpimport -m 3 tpch nation nation.tbl
- 使用例
- データの取得
mysql -h <別のDBサーバ> -u <ユーザ> -p<パスワード> -e "select * from <DB名>.<テーブル名>;" > out.tbl
- データの取得
- ロード
cpimport test test1 out.tbl
cpimport.bin
cplogger
dbbuilder
dbrmctl
ddlcleanup
DDLProc
DecomSvr
director_installer.sh
DMLProc
editem
ExeMgr
getConfig
hadoopReport.sh
hardwareReport.sh
hdfsCheck
IDBInstanceCmds.sh
idbmeminfo
IDBVolumeCmds.sh
infinidb
infinidb.def
load_brm
logReport.sh
master-rep-infinidb.sh
module_installer.sh
myCnf-exclude-args.text
myCnf-include-args.text
mycnfUpgrade
os_check.sh
patchInstaller
patch_installer.sh
performance_installer.sh
postConfigure
post-mysqld-install
post-mysql-install
pre-uninstall
PrimProc
ProcMgr
ProcMon
remote_command.sh
remote_scp_get.sh
remote_scp_put.sh
remotessh.exp
reset_locks
resourceReport.sh
rollback
rsync.sh
run.sh
save_brm
sendtrap
ServerMonitor
setConfig
setenv-hdfs-12
setenv-hdfs-20
slave-rep-infinidb.sh
softwareReport.sh
startupTests.sh
syslogSetup.sh
transactionLog
transactionLogArchiver.sh
trapHandler
使用しないツール
- alarmReport.sh
ログファイルからレポートを生成するツール
単に/var/log/Calpont/archive/alarm.log-XXX をコピーするだけなので、あまり意味はない。
- amazonInstaller
AWSにてAmazon InfiniDB AMIを使用する際にインストール&設定を行うツール
- installer
- install-infinidb.sh
- post-install
- system_installer.sh
リモートホストにRPMをインストールするスクリプト
- viewtablelock
DB名とテーブル名を与えると、テーブルロックの状況を出力するツール
- upgrade-infinidb.sh
InfiniDBの更新を行うスクリプトであるが、手動実行は出来ず、内部的に呼び出される。
- workernode
- WriteEngineServer
- xm_installer.sh