Skip to main content
We’ve updated our Terms of Service. A new AI Addendum clarifies how Stack Overflow utilizes AI interactions.
replaced http://serverfault.com/ with https://serverfault.com/
Source Link

I'm running Ubuntu 16.04 Server on XenServer and I'm running into an issue with MySql's open file limit.

Here's what I've done so far:

sudo nano /etc/security/limits.conf (reference)

* soft nofile 1024000 * hard nofile 1024000 * soft nproc 102400 * hard nproc 102400 mysql soft nofile 1024000 mysql hard nofile 1024000 

sudo nano /etc/init/mysql.conf (reference)(reference)

limit nofile 1024000 1024000 limit nproc 102400 102400 

sudo nano /etc/mysql/mysql.conf.d/mysqld.cnf (reference)

[mysqld_safe] open_files_limit = 1024000 [mysqld] open_files_limit = 1024000 

When the above didn't work, I went on to the the following:

sudo nano /etc/sysctl.conf

fs.file-max = 1024000 

sudo nano /etc/pam.d/common-session

session required pam_limits.so 

sudo nano /etc/pam.d/common-session-noninteractive

session required pam_limits.so 

sudo nano /lib/systemd/system/mysql.service

LimitNOFILE=infinity LimitMEMLOCK=infinity 

When I log into my user account everything seems fine:

ulimit -Hn 1024000 ulimit -Sn 1024000 

If I login as mysql it looks good too:

mysql@server:~$ ulimit -Hn 1024000 mysql@server:~$ ulimit -Sn 1024000 

However, when I look at the proc:

ps -ef | grep mysql cat /proc/1023/limits | grep open Max open files 65536 65536 files 

Or when I look at it in MySql:

mysql> show global variables like 'open%'; +------------------+-------+ | Variable_name | Value | +------------------+-------+ | open_files_limit | 65536 | +------------------+-------+ 

From the logs (/var/log/mysql/error.log ):

2016-07-25T05:44:35.453668Z 0 [Warning] Could not increase number of max_open_files to more than 65536 (request: 1024000)

I'm completely out of ideas here. In the beginning I did start with open_files_limit at 1024, and one of the above must have changed it, but I need it to go higher. I'm hitting this limit already as I have a lot of databases and tables that sometimes have a lot of partitions.

I've even tried numbers less aggressive than 1024000, with no luck.

Any ideas out there?

I'm running Ubuntu 16.04 Server on XenServer and I'm running into an issue with MySql's open file limit.

Here's what I've done so far:

sudo nano /etc/security/limits.conf (reference)

* soft nofile 1024000 * hard nofile 1024000 * soft nproc 102400 * hard nproc 102400 mysql soft nofile 1024000 mysql hard nofile 1024000 

sudo nano /etc/init/mysql.conf (reference)

limit nofile 1024000 1024000 limit nproc 102400 102400 

sudo nano /etc/mysql/mysql.conf.d/mysqld.cnf (reference)

[mysqld_safe] open_files_limit = 1024000 [mysqld] open_files_limit = 1024000 

When the above didn't work, I went on to the the following:

sudo nano /etc/sysctl.conf

fs.file-max = 1024000 

sudo nano /etc/pam.d/common-session

session required pam_limits.so 

sudo nano /etc/pam.d/common-session-noninteractive

session required pam_limits.so 

sudo nano /lib/systemd/system/mysql.service

LimitNOFILE=infinity LimitMEMLOCK=infinity 

When I log into my user account everything seems fine:

ulimit -Hn 1024000 ulimit -Sn 1024000 

If I login as mysql it looks good too:

mysql@server:~$ ulimit -Hn 1024000 mysql@server:~$ ulimit -Sn 1024000 

However, when I look at the proc:

ps -ef | grep mysql cat /proc/1023/limits | grep open Max open files 65536 65536 files 

Or when I look at it in MySql:

mysql> show global variables like 'open%'; +------------------+-------+ | Variable_name | Value | +------------------+-------+ | open_files_limit | 65536 | +------------------+-------+ 

From the logs (/var/log/mysql/error.log ):

2016-07-25T05:44:35.453668Z 0 [Warning] Could not increase number of max_open_files to more than 65536 (request: 1024000)

I'm completely out of ideas here. In the beginning I did start with open_files_limit at 1024, and one of the above must have changed it, but I need it to go higher. I'm hitting this limit already as I have a lot of databases and tables that sometimes have a lot of partitions.

I've even tried numbers less aggressive than 1024000, with no luck.

Any ideas out there?

I'm running Ubuntu 16.04 Server on XenServer and I'm running into an issue with MySql's open file limit.

Here's what I've done so far:

sudo nano /etc/security/limits.conf (reference)

* soft nofile 1024000 * hard nofile 1024000 * soft nproc 102400 * hard nproc 102400 mysql soft nofile 1024000 mysql hard nofile 1024000 

sudo nano /etc/init/mysql.conf (reference)

limit nofile 1024000 1024000 limit nproc 102400 102400 

sudo nano /etc/mysql/mysql.conf.d/mysqld.cnf (reference)

[mysqld_safe] open_files_limit = 1024000 [mysqld] open_files_limit = 1024000 

When the above didn't work, I went on to the the following:

sudo nano /etc/sysctl.conf

fs.file-max = 1024000 

sudo nano /etc/pam.d/common-session

session required pam_limits.so 

sudo nano /etc/pam.d/common-session-noninteractive

session required pam_limits.so 

sudo nano /lib/systemd/system/mysql.service

LimitNOFILE=infinity LimitMEMLOCK=infinity 

When I log into my user account everything seems fine:

ulimit -Hn 1024000 ulimit -Sn 1024000 

If I login as mysql it looks good too:

mysql@server:~$ ulimit -Hn 1024000 mysql@server:~$ ulimit -Sn 1024000 

However, when I look at the proc:

ps -ef | grep mysql cat /proc/1023/limits | grep open Max open files 65536 65536 files 

Or when I look at it in MySql:

mysql> show global variables like 'open%'; +------------------+-------+ | Variable_name | Value | +------------------+-------+ | open_files_limit | 65536 | +------------------+-------+ 

From the logs (/var/log/mysql/error.log ):

2016-07-25T05:44:35.453668Z 0 [Warning] Could not increase number of max_open_files to more than 65536 (request: 1024000)

I'm completely out of ideas here. In the beginning I did start with open_files_limit at 1024, and one of the above must have changed it, but I need it to go higher. I'm hitting this limit already as I have a lot of databases and tables that sometimes have a lot of partitions.

I've even tried numbers less aggressive than 1024000, with no luck.

Any ideas out there?

Tweeted twitter.com/ServerFault/status/804008537806540804
added 175 characters in body
Source Link
J Pierret
  • 181
  • 1
  • 1
  • 6

I'm running Ubuntu 16.04 Server on XenServer and I'm running into an issue with MySql's open file limit.

Here's what I've done so far:

sudo nano /etc/security/limits.conf (reference)

* soft nofile 1024000 * hard nofile 1024000 * soft nproc 102400 * hard nproc 102400 mysql soft nofile 1024000 mysql hard nofile 1024000 

sudo nano /etc/init/mysql.conf (reference)

limit nofile 1024000 1024000 limit nproc 102400 102400 

sudo nano /etc/mysql/mysql.conf.d/mysqld.cnf (reference)

[mysqld_safe] open_files_limit = 1024000 [mysqld] open_files_limit = 1024000 

When the above didn't work, I went on to the the following:

sudo nano /etc/sysctl.conf

fs.file-max = 1024000 

sudo nano /etc/pam.d/common-session

session required pam_limits.so 

sudo nano /etc/pam.d/common-session-noninteractive

session required pam_limits.so 

sudo nano /lib/systemd/system/mysql.service

LimitNOFILE=infinity LimitMEMLOCK=infinity 

When I log into my user account everything seems fine:

ulimit -Hn 1024000 ulimit -Sn 1024000 

If I login as mysql it looks good too:

mysql@server:~$ ulimit -Hn 1024000 mysql@server:~$ ulimit -Sn 1024000 

However, when I look at the proc:

ps -ef | grep mysql cat /proc/1023/limits | grep open Max open files 65536 65536 files 

Or when I look at it in MySql:

mysql> show global variables like 'open%'; +------------------+-------+ | Variable_name | Value | +------------------+-------+ | open_files_limit | 65536 | +------------------+-------+ 

From the logs (/var/log/mysql/error.log ):

2016-07-25T05:44:35.453668Z 0 [Warning] Could not increase number of max_open_files to more than 65536 (request: 1024000)

I'm completely out of ideas here. In the beginning I did start with open_files_limit at 1024, and one of the above must have changed it, but I need it to go higher. I'm hitting this limit already as I have a lot of databases and tables that sometimes have a lot of partitions.

I've even tried numbers less aggressive than 1024000, with no luck.

Any ideas out there?

I'm running Ubuntu 16.04 Server on XenServer and I'm running into an issue with MySql's open file limit.

Here's what I've done so far:

sudo nano /etc/security/limits.conf (reference)

* soft nofile 1024000 * hard nofile 1024000 * soft nproc 102400 * hard nproc 102400 mysql soft nofile 1024000 mysql hard nofile 1024000 

sudo nano /etc/init/mysql.conf (reference)

limit nofile 1024000 1024000 limit nproc 102400 102400 

sudo nano /etc/mysql/mysql.conf.d/mysqld.cnf (reference)

[mysqld_safe] open_files_limit = 1024000 [mysqld] open_files_limit = 1024000 

When the above didn't work, I went on to the the following:

sudo nano /etc/sysctl.conf

fs.file-max = 1024000 

sudo nano /etc/pam.d/common-session

session required pam_limits.so 

sudo nano /etc/pam.d/common-session-noninteractive

session required pam_limits.so 

When I log into my user account everything seems fine:

ulimit -Hn 1024000 ulimit -Sn 1024000 

If I login as mysql it looks good too:

mysql@server:~$ ulimit -Hn 1024000 mysql@server:~$ ulimit -Sn 1024000 

However, when I look at the proc:

ps -ef | grep mysql cat /proc/1023/limits | grep open Max open files 65536 65536 files 

Or when I look at it in MySql:

mysql> show global variables like 'open%'; +------------------+-------+ | Variable_name | Value | +------------------+-------+ | open_files_limit | 65536 | +------------------+-------+ 

I'm completely out of ideas here. In the beginning I did start with open_files_limit at 1024, and one of the above must have changed it, but I need it to go higher. I'm hitting this limit already as I have a lot of databases and tables that sometimes have a lot of partitions.

I've even tried numbers less aggressive than 1024000, with no luck.

Any ideas out there?

I'm running Ubuntu 16.04 Server on XenServer and I'm running into an issue with MySql's open file limit.

Here's what I've done so far:

sudo nano /etc/security/limits.conf (reference)

* soft nofile 1024000 * hard nofile 1024000 * soft nproc 102400 * hard nproc 102400 mysql soft nofile 1024000 mysql hard nofile 1024000 

sudo nano /etc/init/mysql.conf (reference)

limit nofile 1024000 1024000 limit nproc 102400 102400 

sudo nano /etc/mysql/mysql.conf.d/mysqld.cnf (reference)

[mysqld_safe] open_files_limit = 1024000 [mysqld] open_files_limit = 1024000 

When the above didn't work, I went on to the the following:

sudo nano /etc/sysctl.conf

fs.file-max = 1024000 

sudo nano /etc/pam.d/common-session

session required pam_limits.so 

sudo nano /etc/pam.d/common-session-noninteractive

session required pam_limits.so 

sudo nano /lib/systemd/system/mysql.service

LimitNOFILE=infinity LimitMEMLOCK=infinity 

When I log into my user account everything seems fine:

ulimit -Hn 1024000 ulimit -Sn 1024000 

If I login as mysql it looks good too:

mysql@server:~$ ulimit -Hn 1024000 mysql@server:~$ ulimit -Sn 1024000 

However, when I look at the proc:

ps -ef | grep mysql cat /proc/1023/limits | grep open Max open files 65536 65536 files 

Or when I look at it in MySql:

mysql> show global variables like 'open%'; +------------------+-------+ | Variable_name | Value | +------------------+-------+ | open_files_limit | 65536 | +------------------+-------+ 

From the logs (/var/log/mysql/error.log ):

2016-07-25T05:44:35.453668Z 0 [Warning] Could not increase number of max_open_files to more than 65536 (request: 1024000)

I'm completely out of ideas here. In the beginning I did start with open_files_limit at 1024, and one of the above must have changed it, but I need it to go higher. I'm hitting this limit already as I have a lot of databases and tables that sometimes have a lot of partitions.

I've even tried numbers less aggressive than 1024000, with no luck.

Any ideas out there?

Source Link
J Pierret
  • 181
  • 1
  • 1
  • 6

Ubuntu 16.04 Server MySql open_file_limit won't go higher than 65536

I'm running Ubuntu 16.04 Server on XenServer and I'm running into an issue with MySql's open file limit.

Here's what I've done so far:

sudo nano /etc/security/limits.conf (reference)

* soft nofile 1024000 * hard nofile 1024000 * soft nproc 102400 * hard nproc 102400 mysql soft nofile 1024000 mysql hard nofile 1024000 

sudo nano /etc/init/mysql.conf (reference)

limit nofile 1024000 1024000 limit nproc 102400 102400 

sudo nano /etc/mysql/mysql.conf.d/mysqld.cnf (reference)

[mysqld_safe] open_files_limit = 1024000 [mysqld] open_files_limit = 1024000 

When the above didn't work, I went on to the the following:

sudo nano /etc/sysctl.conf

fs.file-max = 1024000 

sudo nano /etc/pam.d/common-session

session required pam_limits.so 

sudo nano /etc/pam.d/common-session-noninteractive

session required pam_limits.so 

When I log into my user account everything seems fine:

ulimit -Hn 1024000 ulimit -Sn 1024000 

If I login as mysql it looks good too:

mysql@server:~$ ulimit -Hn 1024000 mysql@server:~$ ulimit -Sn 1024000 

However, when I look at the proc:

ps -ef | grep mysql cat /proc/1023/limits | grep open Max open files 65536 65536 files 

Or when I look at it in MySql:

mysql> show global variables like 'open%'; +------------------+-------+ | Variable_name | Value | +------------------+-------+ | open_files_limit | 65536 | +------------------+-------+ 

I'm completely out of ideas here. In the beginning I did start with open_files_limit at 1024, and one of the above must have changed it, but I need it to go higher. I'm hitting this limit already as I have a lot of databases and tables that sometimes have a lot of partitions.

I've even tried numbers less aggressive than 1024000, with no luck.

Any ideas out there?