- Parallelism (hence, speed) and performance (avoids expensive character set conversion routines, efficient code overall)
- Easier to manage output (separate files for tables, dump metadata, etc, easy to view/parse data)
- Consistency - maintains snapshot across all threads, provides accurate master and slave log positions, etc
- Manageability - supports PCRE for specifying database and tables inclusions and exclusions
One needs to install development tools:
- Ubuntu or Debian:
apt-get install cmake g++ git
- Fedora, RedHat and CentOS:
yum install -y cmake gcc gcc-c++ git make
- MacOSX:
brew install cmake pkg-config sphinx-doc glib mysql-client [email protected] pcre
port install pkgconfig cmake
One needs to install development versions of GLib, ZLib and PCRE:
- Ubuntu or Debian:
apt-get install libglib2.0-dev zlib1g-dev libpcre3-dev libssl-dev
- Fedora, RedHat and CentOS:
yum install -y glib2-devel mysql-devel openssl-devel pcre-devel zlib-devel
- openSUSE:
zypper install glib2-devel libmysqlclient-devel pcre-devel zlib-devel
- MacOSX: port install glib2 pcre One needs to install MySQL/Percona/MariaDB development versions:
- Ubuntu or Debian:
apt-get install libmysqlclient-dev
apt-get install libperconaserverclient20-dev
apt-get install libmariadbclient-dev
- Fedora, RedHat and CentOS:
yum install -y mysql-devel
yum install -y Percona-Server-devel-57
yum install -y mariadb-devel
CentOS 7 comes by default with MariaDB 5.5 libraries which are very old. It might be better to download a newer version of these libraries (MariaDB, MySQL, Percona etc).
- openSUSE:
zypper install libmysqlclient-devel
- MacOSX: port install mysql5 (You may want to run 'port select mysql mysql5' afterwards)
See Usage
First get the correct url from the releases section then:
yum install https://github.com/maxbube/mydumper/releases/download/v0.11.1-3/mydumper-0.11.1-3.el7.x86_64.rpm
yum install https://github.com/maxbube/mydumper/releases/download/v0.11.1-3/mydumper-0.11.1-3.el8.x86_64.rpmFor ubuntu, you need to install the dependencies:
apt-get install libatomic1Then you can download and install the package:
wget https://github.com/maxbube/mydumper/releases/download/v0.11.1-3/mydumper_0.11.1-3.$(lsb_release -cs)_amd64.deb
dpkg -i mydumper_0.11.1-3.$(lsb_release -cs)_amd64.debBy using Homebrew
brew install mydumperRun:
cmake .
makeOne has to make sure, that pkg-config, mysql_config, pcre-config are all in $PATH
Binlog dump is disabled by default to compile with it you need to add -DWITH_BINLOG=ON to cmake options
To build against mysql libs < 5.7 you need to disable SSL adding -DWITH_SSL=OFF
This is all done following best MySQL practices and traditions:
- As a precaution, slow running queries on the server either abort the dump, or get killed
- Global read lock is acquired ("FLUSH TABLES WITH READ LOCK")
- Various metadata is read ("SHOW SLAVE STATUS","SHOW MASTER STATUS")
- Other threads connect and establish snapshots ("START TRANSACTION WITH CONSISTENT SNAPSHOT") ** On pre-4.1.8 it creates dummy InnoDB table, and reads from it.
- Once all worker threads announce the snapshot establishment, master executes "UNLOCK TABLES" and starts queueing jobs.
This for now does not provide consistent snapshots for non-transactional engines - support for that is expected in 0.2 :)
Once can use --regex functionality, for example not to dump mysql and test databases:
mydumper --regex '^(?!(mysql\.|test\.))'To dump only mysql and test databases:
mydumper --regex '^(mysql\.|test\.)'To not dump all databases starting with test:
mydumper --regex '^(?!(test))'To dump specify tables in different databases (Note: The name of tables should end with $. related issue):
mydumper --regex '^(db1\.table1$|db2\.table2$)'Of course, regex functionality can be used to describe pretty much any list of tables.