nginx反向代理webman高并发偶发502[已解决]

问题描述

我们生产环境使用了nginx反向代理webman，高并发的请求下会偶发502

今天上nginx半天一共是300万请求成功的，3000个请求失败的。

不知道跟我开启了http2 有没有关系

报错信息

报错一共三种：
upstream prematurely closed connection while reading response header from upstream   request: "POST /chat/getMyChatPrice HTTP/2.0", upstream:"http://127.0.0.1:8585/chat/getMyChatPrice"  （这个次数最多 错误日志85%是这个错

recv() failed (104: Connection reset by peer) while reading response header from upstream
（15%是这个错

connect() failed (111: Connection refused) while connecting to upstream  （这个只有五次

nginx配置文件

upstream webman {
    server 127.0.0.1:8585;
    keepalive 10240;
}
server
{
    listen 80;
    listen 443 ssl http2;
    server_name api.**.com;
    index index.php index.html index.htm default.php default.htm default.html;
    root /www/wwwroot/api.**.com;
    #CERT-APPLY-CHECK--START
    # 用于SSL证书申请时的文件验证相关配置 -- 请勿删除
    include /www/server/panel/vhost/nginx/well-known/api.88.com.conf;
    #CERT-APPLY-CHECK--END

    #SSL-START SSL相关配置，请勿删除或修改下一行带注释的404规则
    #error_page 404/404.html;
    ssl_certificate    /www/server/panel/vhost/cert/api.**.com/fullchain.pem;
    ssl_certificate_key    /www/server/panel/vhost/cert/api.**.com/privkey.pem;
    ssl_protocols TLSv1.1 TLSv1.2 TLSv1.3;
    ssl_ciphers EECDH+CHACHA20:EECDH+CHACHA20-draft:EECDH+AES128:RSA+AES128:EECDH+AES256:RSA+AES256:EECDH+3DES:RSA+3DES:!MD5;
    ssl_prefer_server_ciphers on;
    ssl_session_cache shared:SSL:10m;
    ssl_session_timeout 10m;
    add_header Strict-Transport-Security "max-age=31536000";
    error_page 497  https://$host$request_uri;

    #SSL-END

    #ERROR-PAGE-START  错误页配置，可以注释、删除或修改
    #error_page 404 /404.html;
    #error_page 502 /502.html;
    #ERROR-PAGE-END

    #PHP-INFO-START  PHP引用配置，可以注释或修改
    include enable-php-80.conf;
    #PHP-INFO-END

    #REWRITE-START URL重写规则引用,修改后将导致面板设置的伪静态规则失效
    include /www/server/panel/vhost/rewrite/api.**.com.conf;
    #REWRITE-END

    #禁止访问的文件或目录
    location ~ ^/(\.user.ini|\.htaccess|\.git|\.env|\.svn|\.project|LICENSE|README.md)
    {
        return 404;
    }

    #一键申请SSL证书验证目录相关设置
    location ~ \.well-known{
        allow all;
    }

    #禁止在证书验证目录放入敏感文件
    if ( $uri ~ "^/\.well-known/.*\.(php|jsp|py|js|css|lua|ts|go|zip|tar\.gz|rar|7z|sql|bak)$" ) {
        return 403;
    }

    location ~ .*\.(gif|jpg|jpeg|png|bmp|swf)$
    {
        expires      30d;
        error_log /dev/null;
        access_log /dev/null;
    }

    location ~ .*\.(js|css)?$
    {
        expires      12h;
        error_log /dev/null;
        access_log /dev/null;
    }
    access_log  /www/wwwlogs/api.ttayu.com.log;
    error_log  /www/wwwlogs/api.ttayu.com.error.log;
    location ^~ / {
      proxy_set_header X-Real-IP $remote_addr;
      proxy_set_header Host $host;
      proxy_set_header X-Forwarded-Proto $scheme;
      #proxy_http_version 1.1;
      proxy_set_header Connection "";
      if (!-f $request_filename){
          proxy_pass http://webman;
      }
    }
}

操作系统及workerman/webman等框架组件具体版本

系统：centos7.9
webman：1.5.13
nginx:1.18
php: 8.0.26 ( NTS )
环境：宝塔面板

错误信息以及运行状态

php start.php status

runtime/log/workerman.log没有报错 只有我每分钟定时任务