%E3%80%81(09)%20%E5%92%8C%20(32)%20%E9%94%99%E8%AF%AF%EF%BC%9Amod_fcgid%3A%20ap_pass_brigade%20%E5%9C%A8handle_request_ipc%20%E5%87%BD%E6%95%B0%E4%B8%AD%E5%A4%B1%E8%B4%A5.png)
我在跟踪 WordPress 网站和非缓存页面的 Web 服务器性能缓慢的根源时遇到问题。
服务器操作系统：Debian 8“Jesssie”-Linux 版本 4.9.58-xxxx-std-ipv6-64（[电子邮件受保护]) (gcc 版本 6.3.0 20170516 (Debian 6.3.0-18) ) #1 SMP 2017 年 10 月 23 日星期一 11:35:59 CEST (ISP配置）
网络服务器：服务器版本：Apache/2.4.10（Debian）
PHP（默认）：PHP 7.0.26
PHP（选定）：PHP版本7.1.8
处理器：英特尔 2 个至强 E5-2630v3 - 16/32t - 2.4GHz /3.2GHz
内存： 128GB DDR4 ECC 1866 MHz
磁盘：SoftRaid 2x450GB SSD NVMe
Apache2.conf:
Timeout 300
KeepAlive On
MaxKeepAliveRequests 300
KeepAliveTimeout 5
服务器状态（最后 40 分钟）：
Server Version: Apache/2.4.10 (Debian) mod_fastcgi/mod_fastcgi-SNAP-0910052141 mod_fcgid/2.3.9 mod_python/3.3.1 Python/2.7.9 OpenSSL/1.0.1t
Server MPM: worker
Server Built: Sep 20 2017 04:37:43
Current Time: Monday, 22-Jan-2018 05:24:45 EST
Restart Time: Monday, 22-Jan-2018 04:43:55 EST
Parent Server Config. Generation: 1
Parent Server MPM Generation: 0
Server uptime: 40 minutes 50 seconds
Server load: 0.06 0.09 0.33
Total accesses: 8359 - Total Traffic: 147.2 MB
CPU Usage: u20.73 s2.61 cu0 cs0 - .953% CPU load
3.41 requests/sec - 61.5 kB/second - 18.0 kB/request
13 requests currently being processed, 237 idle workers
apache2ctl-M:
Loaded Modules:
core_module (static)
so_module (static)
watchdog_module (static)
http_module (static)
log_config_module (static)
logio_module (static)
version_module (static)
unixd_module (static)
access_compat_module (shared)
actions_module (shared)
alias_module (shared)
auth_basic_module (shared)
auth_digest_module (shared)
authn_core_module (shared)
authn_file_module (shared)
authz_core_module (shared)
authz_host_module (shared)
authz_user_module (shared)
autoindex_module (shared)
dav_module (shared)
dav_fs_module (shared)
deflate_module (shared)
dir_module (shared)
env_module (shared)
expires_module (shared)
fastcgi_module (shared)
fcgid_module (shared)
filter_module (shared)
include_module (shared)
mime_module (shared)
mpm_worker_module (shared)
negotiation_module (shared)
proxy_module (shared)
proxy_fcgi_module (shared)
python_module (shared)
reqtimeout_module (shared)
rewrite_module (shared)
setenvif_module (shared)
socache_shmcb_module (shared)
ssl_module (shared)
status_module (shared)
suexec_module (shared)
服务器 MPM：工作人员:
<IfModule mpm_worker_module>
StartServers 10
MinSpareThreads 25
MaxSpareThreads 400
ThreadLimit 64
ThreadsPerChild 25
MaxRequestWorkers 500
MaxConnectionsPerChild 0
</IfModule>
我的cnf（MySQL）：
innodb_buffer_pool_size = 61440M
innodb_file_per_table=1
innodb_log_file_size = 1024M
innodb_buffer_pool_instances=60
key_buffer = 2048M
max_allowed_packet = 16M
thread_stack = 192K
thread_cache_size = 8
# This replaces the startup script and checks MyISAM tables if needed
# the first time they are touched
myisam-recover = BACKUP
#max_connections = 100
#table_cache = 64
#thread_concurrency = 10
#
# * Query Cache Configuration
#
query_cache_limit = 1M
query_cache_size = 0
query_cache_type = 0
#query_cache_size = 8192M
domain.com.vhost-le-ssl.conf （...）
<Directory /var/www/domain.com/web>
# Clear PHP settings of this website
<FilesMatch ".+\.ph(p[345]?|t|tml)$">
SetHandler None
</FilesMatch>
Options +FollowSymLinks
AllowOverride All
Require all granted
</Directory>
<Directory /var/www/clients/client1/web1/web>
# Clear PHP settings of this website
<FilesMatch ".+\.ph(p[345]?|t|tml)$">
SetHandler None
</FilesMatch>
Options +FollowSymLinks
AllowOverride All
Require all granted
</Directory>
# suexec enabled
<IfModule mod_suexec.c>
SuexecUserGroup web1 client1
</IfModule>
# php as fast-cgi enabled
# For config options see: http://httpd.apache.org/mod_fcgid/mod/mod_fcgid.html
<IfModule mod_fcgid.c>
FcgidIdleTimeout 300
FcgidProcessLifeTime 3600
FcgidInitialEnv PHP_FCGI_MAX_REQUESTS 10000
#FcgidMaxProcesses 1000
FcgidMaxRequestsPerProcess 10000
FcgidMinProcessesPerClass 0
FcgidMaxProcessesPerClass 10
FcgidConnectTimeout 20
FcgidIOTimeout 600
FcgidBusyTimeout 3600
FcgidOutputBufferSize 0
# FcgidBusyScanInterval 120
FcgidMaxRequestLen 1073741824
</IfModule>
<Directory /var/www/domain.com/web>
<FilesMatch "\.php[345]?$">
SetHandler fcgid-script
</FilesMatch>
FCGIWrapper /var/www/php-fcgi-scripts/web1/.php-fcgi-starter .php
FCGIWrapper /var/www/php-fcgi-scripts/web1/.php-fcgi-starter .php3
FCGIWrapper /var/www/php-fcgi-scripts/web1/.php-fcgi-starter .php4
FCGIWrapper /var/www/php-fcgi-scripts/web1/.php-fcgi-starter .php5
Options +ExecCGI
AllowOverride All
Require all granted
</Directory>
<Directory /var/www/clients/client1/web1/web>
<FilesMatch "\.php[345]?$">
SetHandler fcgid-script
</FilesMatch>
FCGIWrapper /var/www/php-fcgi-scripts/web1/.php-fcgi-starter .php
FCGIWrapper /var/www/php-fcgi-scripts/web1/.php-fcgi-starter .php3
FCGIWrapper /var/www/php-fcgi-scripts/web1/.php-fcgi-starter .php4
FCGIWrapper /var/www/php-fcgi-scripts/web1/.php-fcgi-starter .php5
Options +ExecCGI
AllowOverride All
Require all granted
</Directory>
# add support for apache mpm_itk
<IfModule mpm_itk_module>
AssignUserId web1 client1
</IfModule>
<IfModule mod_dav_fs.c>
# Do not execute PHP files in webdav directory
<Directory /var/www/clients/client1/web1/webdav>
<ifModule mod_security2.c>
SecRuleRemoveById 960015
SecRuleRemoveById 960032
</ifModule>
<FilesMatch "\.ph(p3?|tml)$">
SetHandler None
</FilesMatch>
</Directory>
DavLockDB /var/www/clients/client1/web1/tmp/DavLock
# DO NOT REMOVE THE COMMENTS!
# IF YOU REMOVE THEM, WEBDAV WILL NOT WORK ANYMORE!
# WEBDAV BEGIN
# WEBDAV END
</IfModule>
(...)
问题:
我主持一个单WordPress 网站在这台机器上。 (32) 即使网站正在开发中并且唯一的用户是我，错误也会时不时地出现。目前我每天大约有 5000 名独立访客（https://domain.com） 和我的错误日志显示多个 (104)、(9) 和 (32) 错误，包括：
(...)
(104)Connection reset by peer: [client: XXX.XX.XX.XX:XXXX] mod_fcgid: error reading data from FastCGI server
(104)Connection reset by peer: [client: XXX.XX.XX.XX:XXXX] mod_fcgid: ap_pass_brigade failed in handle_request_ipc function
(9)Bad file descriptor: [client: XXX.XX.XX.XX:XXXX] mod_fcgid: ap_pass_brigade failed in handle_request_ipc function
(32)Broken pipe: [client: XXX.XX.XX.XX:XXXX] mod_fcgid: ap_pass_brigade failed in handle_request_ipc function
(104)Connection reset by peer: [client: XXX.XX.XX.XX:XXXX] mod_fcgid: error reading data from FastCGI server, referer: https://domain.com/wp-admin/post.php?post=XXXXXXX&action=edit
(...)
最常见的错误是：
(32)Broken pipe: [client: XXX.XX.XX.XX:XXXX] mod_fcgid: ap_pass_brigade failed in handle_request_ipc function
我想说，这个错误发生在所有访问的 5%-10% 中，目前这个数字很低，只是因为我的大部分页面都被缓存了。这开始让我担心，因为我的网站的点击量日益增加，越来越多的访问者注册并使用“搜索”选项，或者只是单击“标签”链接，这些链接由于其动态内容而未被缓存。
据我观察，这些错误大多发生在 PHP 运行时。为了进行测试，我在选项卡中打开了大约 20 个帖子，然后单击“编辑”按钮。这导致了 (104)、(9) 和 (32) 错误。 (32) 也会在访问者进行搜索时出现。我的 WordPress 中总共有大约 50 万个帖子。
我做了什么来尝试修复它（没有成功）： 1。我从PHP-FPM到快速CGI并在选项卡中打开 20 个帖子并单击“编辑”按钮。错误仍然出现在 error.log 中，并且帖子未加载，浏览器显示“等待可用的套接字”（缓存页面运行速度超快）。
辅助 | grep “php”
root 7554 0.0 0.0 210764 24084 ? Ss 2017 0:47 php-fpm: master process (/etc/php/7.0/fpm/php-fpm.conf)
root 21443 0.0 0.0 280056 8700 ? Ss 05:49 0:00 php-fpm: master process (/opt/php-7.1/etc/php-fpm.conf)
www-data 21444 0.0 0.0 280056 6904 ? S 05:49 0:00 php-fpm: pool www
www-data 21445 0.0 0.0 280056 6904 ? S 05:49 0:00 php-fpm: pool www
web1 21801 1.4 0.0 367796 83900 ? S 05:49 0:05 /opt/php-7.1/bin/php-cgi -d open_basedir=/var/www/clients/client1/web1/web:/var/www/clients/client1/web1/private:/var/www/clients/client1/web1/tmp:/var/www/domain.com/web:/srv/www/domain.com/web:/usr/share/php5:/usr/share/php:/tmp:/usr/share/phpmyadmin:/etc/phpmyadmin:/var/lib/phpmyadmin:/dev/random:/dev/urandom -d upload_tmp_dir=/var/www/clients/client1/web1/tmp -d session.save_path=/var/www/clients/client1/web1/tmp -d sendmail_path=/usr/sbin/sendmail -t -i -f [email protected]
web1 21802 0.9 0.0 367716 81768 ? S 05:49 0:03 /opt/php-7.1/bin/php-cgi -d open_basedir=/var/www/clients/client1/web1/web:/var/www/clients/client1/web1/private:/var/www/clients/client1/web1/tmp:/var/www/domain.com/web:/srv/www/domain.com/web:/usr/share/php5:/usr/share/php:/tmp:/usr/share/phpmyadmin:/etc/phpmyadmin:/var/lib/phpmyadmin:/dev/random:/dev/urandom -d upload_tmp_dir=/var/www/clients/client1/web1/tmp -d session.save_path=/var/www/clients/client1/web1/tmp -d sendmail_path=/usr/sbin/sendmail -t -i -f [email protected]
web1 21803 0.7 0.0 291716 80684 ? S 05:49 0:02 /opt/php-7.1/bin/php-cgi -d open_basedir=/var/www/clients/client1/web1/web:/var/www/clients/client1/web1/private:/var/www/clients/client1/web1/tmp:/var/www/domain.com/web:/srv/www/domain.com/web:/usr/share/php5:/usr/share/php:/tmp:/usr/share/phpmyadmin:/etc/phpmyadmin:/var/lib/phpmyadmin:/dev/random:/dev/urandom -d upload_tmp_dir=/var/www/clients/client1/web1/tmp -d session.save_path=/var/www/clients/client1/web1/tmp -d sendmail_path=/usr/sbin/sendmail -t -i -f [email protected]
web1 21804 0.6 0.0 367656 81500 ? S 05:49 0:02 /opt/php-7.1/bin/php-cgi -d open_basedir=/var/www/clients/client1/web1/web:/var/www/clients/client1/web1/private:/var/www/clients/client1/web1/tmp:/var/www/domain.com/web:/srv/www/domain.com/web:/usr/share/php5:/usr/share/php:/tmp:/usr/share/phpmyadmin:/etc/phpmyadmin:/var/lib/phpmyadmin:/dev/random:/dev/urandom -d upload_tmp_dir=/var/www/clients/client1/web1/tmp -d session.save_path=/var/www/clients/client1/web1/tmp -d sendmail_path=/usr/sbin/sendmail -t -i -f [email protected]
web1 21805 0.4 0.0 291716 80304 ? S 05:49 0:01 /opt/php-7.1/bin/php-cgi -d open_basedir=/var/www/clients/client1/web1/web:/var/www/clients/client1/web1/private:/var/www/clients/client1/web1/tmp:/var/www/domain.com/web:/srv/www/domain.com/web:/usr/share/php5:/usr/share/php:/tmp:/usr/share/phpmyadmin:/etc/phpmyadmin:/var/lib/phpmyadmin:/dev/random:/dev/urandom -d upload_tmp_dir=/var/www/clients/client1/web1/tmp -d session.save_path=/var/www/clients/client1/web1/tmp -d sendmail_path=/usr/sbin/sendmail -t -i -f [email protected]
web1 21817 0.3 0.0 366944 80224 ? S 05:49 0:01 /opt/php-7.1/bin/php-cgi -d open_basedir=/var/www/clients/client1/web1/web:/var/www/clients/client1/web1/private:/var/www/clients/client1/web1/tmp:/var/www/domain.com/web:/srv/www/domain.com/web:/usr/share/php5:/usr/share/php:/tmp:/usr/share/phpmyadmin:/etc/phpmyadmin:/var/lib/phpmyadmin:/dev/random:/dev/urandom -d upload_tmp_dir=/var/www/clients/client1/web1/tmp -d session.save_path=/var/www/clients/client1/web1/tmp -d sendmail_path=/usr/sbin/sendmail -t -i -f [email protected]
web1 21818 0.7 0.0 361524 76512 ? S 05:49 0:02 /opt/php-7.1/bin/php-cgi -d open_basedir=/var/www/clients/client1/web1/web:/var/www/clients/client1/web1/private:/var/www/clients/client1/web1/tmp:/var/www/domain.com/web:/srv/www/domain.com/web:/usr/share/php5:/usr/share/php:/tmp:/usr/share/phpmyadmin:/etc/phpmyadmin:/var/lib/phpmyadmin:/dev/random:/dev/urandom -d upload_tmp_dir=/var/www/clients/client1/web1/tmp -d session.save_path=/var/www/clients/client1/web1/tmp -d sendmail_path=/usr/sbin/sendmail -t -i -f [email protected]
web1 21998 0.8 0.0 369600 85560 ? S 05:50 0:02 /opt/php-7.1/bin/php-cgi -d open_basedir=/var/www/clients/client1/web1/web:/var/www/clients/client1/web1/private:/var/www/clients/client1/web1/tmp:/var/www/domain.com/web:/srv/www/domain.com/web:/usr/share/php5:/usr/share/php:/tmp:/usr/share/phpmyadmin:/etc/phpmyadmin:/var/lib/phpmyadmin:/dev/random:/dev/urandom -d upload_tmp_dir=/var/www/clients/client1/web1/tmp -d session.save_path=/var/www/clients/client1/web1/tmp -d sendmail_path=/usr/sbin/sendmail -t -i -f [email protected]
web1 22192 3.9 0.0 289668 79848 ? S 05:53 0:06 /opt/php-7.1/bin/php-cgi -d open_basedir=/var/www/clients/client1/web1/web:/var/www/clients/client1/web1/private:/var/www/clients/client1/web1/tmp:/var/www/domain.com/web:/srv/www/domain.com/web:/usr/share/php5:/usr/share/php:/tmp:/usr/share/phpmyadmin:/etc/phpmyadmin:/var/lib/phpmyadmin:/dev/random:/dev/urandom -d upload_tmp_dir=/var/www/clients/client1/web1/tmp -d session.save_path=/var/www/clients/client1/web1/tmp -d sendmail_path=/usr/sbin/sendmail -t -i -f [email protected]
web1 22193 0.8 0.0 285392 75288 ? S 05:53 0:01 /opt/php-7.1/bin/php-cgi -d open_basedir=/var/www/clients/client1/web1/web:/var/www/clients/client1/web1/private:/var/www/clients/client1/web1/tmp:/var/www/domain.com/web:/srv/www/domain.com/web:/usr/share/php5:/usr/share/php:/tmp:/usr/share/phpmyadmin:/etc/phpmyadmin:/var/lib/phpmyadmin:/dev/random:/dev/urandom -d upload_tmp_dir=/var/www/clients/client1/web1/tmp -d session.save_path=/var/www/clients/client1/web1/tmp -d sendmail_path=/usr/sbin/sendmail -t -i -f [email protected]
ispconf+ 22268 0.0 0.0 285232 22940 ? Ss 05:54 0:00 /usr/bin/php-cgi -d disable_classes= -d disable_functions= -d magic_quotes_gpc=off -d open_basedir= -d session.save_path=/usr/local/ispconfig/interface/temp
ispconf+ 22270 0.1 0.0 285528 16064 ? S 05:54 0:00 /usr/bin/php-cgi -d disable_classes= -d disable_functions= -d magic_quotes_gpc=off -d open_basedir= -d session.save_path=/usr/local/ispconfig/interface/temp
root 22433 0.0 0.0 13216 2172 pts/0 S+ 05:55 0:00 grep php
root 24127 0.0 0.0 306300 8952 ? Ss 2017 0:37 php-fpm: master process (/usr/local/php-7.1.8/etc/php-fpm.conf)
www-data 24128 0.0 0.0 306640 9228 ? S 2017 0:00 php-fpm: pool www
www-data 24129 0.0 0.0 306300 6980 ? S 2017 0:00 php-fpm: pool www
www-data 29862 0.0 0.0 213180 19708 ? S Jan19 0:04 php-fpm: pool www
www-data 29891 0.0 0.0 213176 21532 ? S Jan19 0:04 php-fpm: pool www
www-data 29948 0.0 0.0 211136 17540 ? S Jan19 0:03 php-fpm: pool www
顶部:
top - 06:02:08 up 27 days, 17:45, 1 user, load average: 2.45, 3.20, 2.26
Tasks: 487 total, 1 running, 486 sleeping, 0 stopped, 0 zombie
%Cpu(s): 12.5 us, 3.6 sy, 0.0 ni, 83.4 id, 0.0 wa, 0.0 hi, 0.5 si, 0.0 st
KiB Mem: 13198007+total, 12718466+used, 4795408 free, 2421808 buffers
KiB Swap: 1046520 total, 0 used, 1046520 free. 10000835+cached Mem
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
27655 mysql 20 0 68.220g 0.012t 11640 S 519.8 10.1 3798:47 mysqld
21602 www-data 20 0 2058172 17132 7092 S 0.3 0.0 0:00.77 apache2
(...)
编辑:
这些 MySQL 查询使 mysqld 产生 128.9% 的 CPU 使用率：
mysql> show full processlist;
+--------+---------------+-----------+---------------+---------+------+----------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Id | User | Host | db | Command | Time | State | Info |
+--------+---------------+-----------+---------------+---------+------+----------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| 284863 | root | localhost | c1DATABASE | Query | 0 | NULL | show full processlist |
| 287063 | c1DATABASE | localhost | c1DATABASE | Sleep | 0 | | NULL |
| 287064 | c1DATABASE | localhost | c1DATABASE | Query | 0 | Sorting result | SELECT t.*, tt.* FROM wp_terms AS t INNER JOIN wp_term_taxonomy AS tt ON t.term_id = tt.term_id WHERE tt.taxonomy IN ('post_tag') AND tt.count > 0 ORDER BY tt.count DESC LIMIT 45 |
| 287065 | c1DATABASE | localhost | c1DATABASE | Query | 1 | Copying to tmp table | SELECT SQL_CALC_FOUND_ROWS wp_posts.ID FROM wp_posts WHERE 1=1 AND wp_posts.post_type = 'post' AND (wp_posts.post_status = 'publish') ORDER BY RAND() LIMIT 0, 10 |
| 287066 | c1DATABASE | localhost | c1DATABASE | Sleep | 0 | | NULL |
+--------+---------------+-----------+---------------+---------+------+----------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
5 rows in set (0.00 sec)
2。我更新并调整了以下选项：
FcgidBusyTimeout 3600
FcgidProcessLifeTime 3600
FcgidOutputBufferSize 0
Apache mod_fcgid 文档列出了另一种可能性“mod_fcgid：ap_pass_brigade 在handle_request_ipc 函数中失败" 可能会出现错误，这是由于限制PHP_FCGI_MAX_REQUESTS和/或每个进程的 FcgidMaxRequests。 PHP FastCGI 进程在处理 500 个请求后退出，并且它们可能在该模块已经连接到应用程序并发送下一个请求后退出，从而导致“mod_fcgid: ap_pass_brigade failed in handle_request_ipc function”错误。
根据 Apache mod_fcgid 文档和此问题，我还更新了以下选项：
FcgidMaxRequestsPerProcess 10000
FcgidInitialEnv PHP_FCGI_MAX_REQUESTS 10000
不幸的是，两者1） 和2）没有解决我的问题：-/任何建议如何从这台机器中压缩最大（Intel 2x Xeon E5-2630v3 - 16/32t - 2.4GHz /3.2GHz + 128GB DDR4 ECC 1866 MHz RAM）并解决问题mod_fcgid错误？干杯!
答案1
meta_key 上的索引是错误的，它只包含 255 个可能字符中的 191 个，因此 mysql 不会使用它。这就是您查询缓慢的原因。
https://stackoverflow.com/questions/37675274/wordpress-query-slow-with-many-posts-and-custom-fields
这个人（Killer Loop）将wp_postmeta中的meta_key更改为191个字符，并在第2/10秒得到结果。