客户端启动时发送许多记录。Nginx 502 坏网关打开的文件过多

客户端启动时发送许多记录。Nginx 502 坏网关打开的文件过多

我有一个 nodejs 应用程序,它在客户端启动时发送 > 800 个 mongodb 文档(仅当客户端第一次访问我的应用程序时执行)。

Nginx 作为节点服务器前端的反向代理。

应用服务器规格

  • 数字海洋
  • CentOS 7.2
  • 2GB 内存
  • 2CPU

MongoDB 服务器规格

  • 数字海洋
  • Ubuntu 14.04
  • 512 内存
  • 1 个 CPU

nginx -v // nginx 版本:nginx/1.8.1

nginx 配置

user  nginx;
worker_processes  2;
worker_rlimit_nofile 100480;

error_log  /var/log/nginx/error.log;

pid        /run/nginx.pid;

events {
  worker_connections  1024;
}

http {
  include   /etc/nginx/mime.types;
  default_type  application/octet-stream;

  log_format  main  '$remote_addr - $remote_user [$time_local] "$request" '
  '$status $body_bytes_sent "$http_referer" '
  '"$http_user_agent" "$http_x_forwarded_for"';

  access_log  /var/log/nginx/access.log  main;

  sendfile        on;

  index   index.html index.htm;

  server {
    server_name 128.199.139.xxx;

    root /var/www/myapp/bundle/public;

    module_app_type node;

    module_startup_file main.js;

    module_env_var MONGO_URL mongodb://{username}:{password}@128.199.139.xxx:27017/;

    module_env_var ROOT_URL http://128.199.139.xxx;

    location / {
      proxy_pass http://128.199.139.xxx;
      proxy_http_version 1.1;

      #proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;
      #proxy_set_header X-Real-IP $remote_addr;

      # pass the host header - http://wiki.nginx.org/HttpProxyModule#proxy_pass
      #proxy_set_header Host $host;

      # WebSocket proxying - from http://nginx.org/en/docs/http/websocket.html
      proxy_set_header Upgrade "upgrade";
      proxy_set_header Connection $http_upgrade;

      #add_header 'Access-Control-Allow-Origin' '*';
    }
  }

  server {
    listen       80 default_server;
    server_name  localhost;
    root         /usr/share/nginx/html;

    #charset koi8-r;

    #access_log  /var/log/nginx/host.access.log  main;

    # Load configuration files for the default server block.
    include /etc/nginx/default.d/*.conf;

    location / {
    }

    # redirect server error pages to the static page /40x.html
    #
    error_page  404              /404.html;
    location = /40x.html {
    }

    # redirect server error pages to the static page /50x.html
    #
    error_page   500 502 503 504  /50x.html;
    location = /50x.html {
    }
  }
}

错误日志

以下错误日志:

2016/03/17 09:46:00 [crit] 10295#0: accept4() failed (24: Too many open files)
2016/03/17 09:46:01 [crit] 10295#0: accept4() failed (24: Too many open files)
2016/03/17 09:46:01 [crit] 10295#0: accept4() failed (24: Too many open files)
.....many duplicate error as above
2016/03/17 09:47:35 [error] 10295#0: *4064 recv() failed (104: Connection reset by peer) while reading response header from upstream, client: 128.199.139.160, server: 128.199.139.1$
2016/03/17 09:47:35 [alert] 10295#0: accept4() failed (9: Bad file descriptor)
[ 2016-03-17 09:53:47.8144 10403/7f2833c9a700 age/Ust/UstRouterMain.cpp:422 ]: Signal received. Gracefully shutting down... (send signal 2 more time(s) to force shutdown)
[ 2016-03-17 09:53:47.8145 10403/7f2839500880 age/Ust/UstRouterMain.cpp:492 ]: Received command to shutdown gracefully. Waiting until all clients have disconnected...
[ 2016-03-17 09:53:47.8146 10403/7f2833c9a700 Ser/Server.h:464 ]: [UstRouter] Shutdown finished
2016/03/17 09:54:11 [alert] 10549#0: 1024 worker_connections are not enough
2016/03/17 09:54:11 [error] 10549#0: *1021 recv() failed (104: Connection reset by peer) while reading response header from upstream, client: 128.199.139.160, server: 128.199.139.1$
2016/03/17 09:54:12 [alert] 10549#0: 1024 worker_connections are not enough
2016/03/17 09:54:12 [error] 10549#0: *2043 recv() failed (104: Connection reset by peer) while reading response header from upstream, client: 128.199.139.160, server: 128.199.139.1$
2016/03/17 11:43:20 [alert] 10549#0: 1024 worker_connections are not enough
2016/03/17 11:43:20 [error] 10549#0: *3069 recv() failed (104: Connection reset by peer) while reading response header from upstream, client: 128.199.139.160, server: 128.199.139.1$
2016/03/17 13:49:54 [error] 10549#0: *3071 open() "/usr/share/nginx/html/robots.txt" failed (2: No such file or directory), client: 180.97.106.xx, server: localhost, request: "GET

感谢任何帮助或线索

问题

问题是,根据上述设置我收到以下错误:

  • 打开的文件过多
  • worker_connections 不够
  • (104:对端重置连接)读取上游的响应头时

如何解决这个问题?谢谢

答案1

好吧,似乎用谷歌搜索一下,比如“工作者连接不足”或“nginx 打开太多文件”已经给出了一些线索,比如可能代理到端口 80(在公共 IP 上):

  proxy_pass http://128.199.139.xxx;

导致循环(因此“打开太多文件”和“1024 个工作者不够”)。

也许您应该尝试这些提示,如果它们没有解决您的问题,请告知我们。

https://stackoverflow.com/questions/28265717/worker-connections-are-not-enough

Nginx 打开的文件太多,似乎无法提高限制

http://www.cyberciti.biz/faq/linux-unix-nginx-too-many-open-files/

https://anothersysadmin.wordpress.com/2013/08/09/nginx-and-the-too-many-open-files-limit/

相关内容