Skip to content

This is repo for tunned mysql configuration. This mysql configuration can take 40k values per second. Server is VM in VMWare. HW: 12cpu, 48GB RAM, 400GB SAS HDD. SW: Zabbix 4, CentOS 7, MariaDB 10.3. Server is only for DB.

Notifications You must be signed in to change notification settings

hermanekt/Zabbix_MYSQL_tunned_for_40k

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

23 Commits
 
 
 
 

Repository files navigation

Zabbix MYSQL tuned for 40000 values per second.

This is repo for tuned mysql configuration. This mysql configuration can take 40k values per second. Server is VM in VMWare. HW: 12cpu, 48GB RAM, 400GB SAS HDD. SW: Zabbix 4, CentOS 7, MariaDB 10.3. Server is only for DB.

How i have configured server:

1) MariaDB

vi /etc/yum.repos.d/mariadb.repo
[mariadb]
name = MariaDB
baseurl = http://yum.mariadb.org/10.3/rhel7-amd64
gpgkey=https://yum.mariadb.org/RPM-GPG-KEY-MariaDB
gpgcheck=1
yum install MariaDB-server MariaDB-client
systemctl enable mysql.service
systemctl start mysql.service

Securing DB

/usr/bin/mysql_secure_installation
NOTE: RUNNING ALL PARTS OF THIS SCRIPT IS RECOMMENDED FOR ALL MariaDB
      SERVERS IN PRODUCTION USE!  PLEASE READ EACH STEP CAREFULLY!

In order to log into MariaDB to secure it, we'll need the current
password for the root user.  If you've just installed MariaDB, and
you haven't set the root password yet, the password will be blank,
so you should just press enter here.

Enter current password for root (enter for none):
OK, successfully used password, moving on...

Setting the root password ensures that nobody can log into the MariaDB
root user without the proper authorisation.

Set root password? [Y/n] y
New password:
Re-enter new password:
Password updated successfully!
Reloading privilege tables..
 ... Success!


By default, a MariaDB installation has an anonymous user, allowing anyone
to log into MariaDB without having to have a user account created for
them.  This is intended only for testing, and to make the installation
go a bit smoother.  You should remove them before moving into a
production environment.

Remove anonymous users? [Y/n] y
 ... Success!

Normally, root should only be allowed to connect from 'localhost'.  This
ensures that someone cannot guess at the root password from the network.

Disallow root login remotely? [Y/n] y
 ... Success!

By default, MariaDB comes with a database named 'test' that anyone can
access.  This is also intended only for testing, and should be removed
before moving into a production environment.

Remove test database and access to it? [Y/n] y
 - Dropping test database...
 ... Success!
 - Removing privileges on test database...
 ... Success!

Reloading the privilege tables will ensure that all changes made so far
will take effect immediately.

Reload privilege tables now? [Y/n] y
 ... Success!

Cleaning up...

All done!  If you've completed all of the above steps, your MariaDB
installation should now be secure.

Thanks for using MariaDB!

2) Set partioning

I use this howto for setting of partitionings https://zabbix.org/wiki/Docs/howto/mysql_partition

After this i create task for automatic recreating tables and deleting this:

mysql -p
MariaDB [(none)]> use zabbix;
CREATE EVENT Partitions ON SCHEDULE EVERY 1 DAY DO CALL partition_maintenance_all('zabbix');

Check partitions:

mysql -p
MariaDB [(none)]> use zabbix;
CALL partition_maintenance_all('zabbix');
SELECT PARTITION_NAME, TABLE_ROWS FROM INFORMATION_SCHEMA.PARTITIONS WHERE TABLE_NAME='history_uint';

3) Huge memory

I use this howto for counting my momory https://www.linkedin.com/pulse/configuring-huge-pages-mysql-server-red-hat-linux-juan-soto/

vi /etc/security/limits.conf
# /etc/security/limits.conf
#
#This file sets the resource limits for the users logged in via PAM.
#It does not affect resource limits of the system services.
#
#Also note that configuration files in /etc/security/limits.d directory,
#which are read in alphabetical order, override the settings in this
#file in case the domain is the same or more specific.
#That means for example that setting a limit for wildcard domain here
#can be overriden with a wildcard setting in a config file in the
#subdirectory, but a user specific setting here can be overriden only
#with a user specific setting in the subdirectory.
#
#Each line describes a limit for a user in the form:
#
#<domain>        <type>  <item>  <value>
#
#Where:
#<domain> can be:
#        - a user name
#        - a group name, with @group syntax
#        - the wildcard *, for default entry
#        - the wildcard %, can be also used with %group syntax,
#                 for maxlogin limit
#
#<type> can have the two values:
#        - "soft" for enforcing the soft limits
#        - "hard" for enforcing hard limits
#
#<item> can be one of the following:
#        - core - limits the core file size (KB)
#        - data - max data size (KB)
#        - fsize - maximum filesize (KB)
#        - memlock - max locked-in-memory address space (KB)
#        - nofile - max number of open file descriptors
#        - rss - max resident set size (KB)
#        - stack - max stack size (KB)
#        - cpu - max CPU time (MIN)
#        - nproc - max number of processes
#        - as - address space limit (KB)
#        - maxlogins - max number of logins for this user
#        - maxsyslogins - max number of logins on the system
#        - priority - the priority to run user process with
#        - locks - max number of file locks the user can hold
#        - sigpending - max number of pending signals
#        - msgqueue - max memory used by POSIX message queues (bytes)
#        - nice - max nice priority allowed to raise to values: [-20, 19]
#        - rtprio - max realtime priority
#
#<domain>      <type>  <item>         <value>
#

#*               soft    core            0
#*               hard    rss             10000
#@student        hard    nproc           20
#@faculty        soft    nproc           20
#@faculty        hard    nproc           50
#ftp             hard    nproc           0
#@student        -       maxlogins       4

@mysql      soft    memlock     unlimited
@mysql      hard    memlock     unlimited

# End of file

4) Use tuned my.cnf

Backup old config

mv /etc/my.cnf.d/server.cnf /etc/my.cnf.d/server.cnf_ORIG

Copy new configuration

wget -O /etc/my.cnf.d/server.cnf https://raw.githubusercontent.com/hermanekt/Zabbix_MYSQL_tunned_for_40k/master/server.cnf

Create log path

mkdir /var/log/mariadb
chown mysql:mysql /var/log/mariadb/

Restart mariaDB and check log

systemctl restart mysql.service
less /var/log/mariadb/mariadb-error.log

Authors

Acknowledgments

This is Alfa version, please give me feadback if you find bug or need some another check. Email is info"@"tomashermanek.cz, twitter is: hermanekt.

paypal

About

This is repo for tunned mysql configuration. This mysql configuration can take 40k values per second. Server is VM in VMWare. HW: 12cpu, 48GB RAM, 400GB SAS HDD. SW: Zabbix 4, CentOS 7, MariaDB 10.3. Server is only for DB.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published