Skip to content
TheChatArchiveThe Chat Archive
gpt-3.5-turbo-0301· openaiHugging Face Suzhen/CodeChat

nginx文件上传

  1. User

    nginx文件上传

  2. Assistant

    在nginx配置文件中,可以使用以下指令来配置文件上传功能:

    http {
        ...
        server {
            ...
            # 设置上传文件的缓存目录和大小限制
            client_body_temp_path /var/nginx/upload/;
            client_max_body_size 100m;
    
            location /upload {
                # 设置文件上传处理脚本
                upload_pass /upload/upload.php;
                # 设置上传文件的最大大小和文件类型限制
                upload_set_form_field $upload_field_name.name "$upload_file_name";
                upload_set_form_field $upload_field_name.content_type "$upload_content_type";
                upload_set_form_field $upload_field_name.path "$upload_tmp_path";
                upload_aggregate_form_field $upload_field_name.size "$upload_file_size";
                upload_pass_form_field "^submit$|^csrf_token$";
                # 设置上传文件的缓存路径和文件名
                upload_store /var/nginx/upload/;
                upload_store_access user:rw group:rw all:r;
                upload_cleanup 400 404 499 500-505;
            }
        }
    }
    

    以上配置中,client_body_temp_path指令设置文件上传的缓存目录,client_max_body_size指令设置上传文件的最大限制。upload_pass指令指定了处理上传文件的脚本路径,upload_set_form_field指令设置了上传文件的大小和类型限制,并设置了上传文件的缓存路径和文件名。upload_store_access指令设置了上传文件的访问权限,upload_cleanup指令设置了上传完成后清理文件的状态码。

    需要注意的是,以上配置需要安装nginx-upload-module模块,该模块提供了丰富的文件上传功能。

  3. User

    nginx处理文件上传,并返回路径,并做处理

  4. Assistant

    要实现nginx处理文件上传并返回路径,可以结合使用nginx-upload-module模块和lua脚本来实现。具体步骤如下:

    1. 下载并安装nginx-upload-module模块,可以使用以下命令来安装:
    wget https://github.com/fdintino/nginx-upload-module/archive/2.3.0.tar.gz
    tar zxvf 2.3.0.tar.gz
    cd nginx-upload-module-2.3.0
    ./configure --add-module=/path/to/nginx-upload-module
    make
    make install
    
    1. 配置nginx,在nginx.conf文件中增加以下配置:
    http {
        ...
        lua_package_path "/path/to/lua/?.lua;;";
    
        server {
            ...
            location /upload {
                upload_pass /path/to/upload/handler;
                upload_store /path/to/upload;
                upload_set_form_field "${upload_field_name}_name" "$upload_file_name";
                upload_set_form_field "${upload_field_name}_content_type" "$upload_content_type";
                upload_set_form_field "${upload_field_name}_path" "$upload_tmp_path";
                upload_set_form_field "${upload_field_name}_size" "$upload_file_size";
                upload_aggregate_form_field "${upload_field_name}_md5" "$upload_file_md5";
            }
    
            location /upload_info {
                content_by_lua_file /path/to/lua/upload_info.lua;
            }
        }
    }
    

    其中,upload_pass用于指定处理文件上传的脚本路径,upload_store用于指定文件上传后的存放路径。upload_set_form_field和upload_aggregate_form_field用于设置上传文件的元数据,其中${upload_field_name}表示上传文件的表单字段名。

    1. 写处理文件上传的lua脚本,将上传后的文件信息保存到redis中,并返回文件路径。示例脚本如下:
    local upload = require "resty.upload"
    local redis = require "resty.redis"
    
    local red = redis:new()
    red:set_timeout(1000)
    
    local ok, err = red:connect("127.0.0.1", 6379)
    if not ok then
        ngx.say("failed to connect: ", err)
        return
    end
    
    local chunk_size = 8192
    local chunk_cnt = 0
    local file_name = nil
    local file_type = nil
    local file_md5 = nil
    local file_size = 0
    
    function get_extension(file_name)
        return file_name:match(".+%.(%w+)$")
    end
    
    function handle_file(meta, file)
        while true do
            local data, err, partial = file:read(chunk_size)
            if err then
                ngx.log(ngx.ERR, "failed to read file: ", err)
                return err
            end
    
            if not data then
                file:close()
                break
            end
    
            chunk_cnt = chunk_cnt + 1
            file_size = file_size + #data
    
            local key = string.format("%s-%d", meta.name, chunk_cnt)
            local ok, err = red:set(key, data)
            if not ok then
                ngx.log(ngx.ERR, "failed to set redis: ", err)
                return err
            end
        end
    
        local ext = get_extension(file_name)
        file_md5 = ngx.md5(meta.md5)
        local path = string.format("/upload/%s.%s", file_md5, ext)
        path = ngx.escape_uri(path)
        local ok, err = red:set(file_md5, path)
        if not ok then
            ngx.log(ngx.ERR, "failed to set redis: ", err)
            return err
        end
    
        return path
    end
    
    local form, err = upload:new(chunk_size)
    if not form then
        ngx.log(ngx.ERR, "failed to new upload: ", err)
        return ngx.exit(500)
    end
    
    form:set_timeout(1000)
    while true do
        local typ, res, err = form:read()
        if not typ then
            ngx.log(ngx.ERR, "failed to read form: ", err)
            return ngx.exit(500)
        end
    
        if typ == "header" then
            if res[1] ~= "Content-Disposition" then
                file_type = res[2]
            else
                file_name = res[2]:match("filename=\"(.+)\"")
            end
        elseif typ == "body" then
            handle_file(res, form)
        elseif typ == "eof" then
            break
        end
    end
    
    local path = handle_file({name = file_name, md5 = file_md5}, nil)
    ngx.say(path)
    
    1. 实现上传文件的下载功能,从redis中获取文件信息并返回文件内容。示例脚本如下:
    local redis = require "resty.redis"
    local cgi = require "cgi"
    
    local red = redis:new()
    red:set_timeout(1000)
    
    local ok, err = red:connect("127.0.0.1", 6379)
    if not ok then
        ngx.say("failed to connect: ", err)
        return
    end
    
    local args, err = cgi:get_all()
    if not args or not args.path then
        ngx.say("invalid request")
        return
    end
    
    local path = ngx.unescape_uri(args.path)
    local file_md5 = path:match("/upload/([%w-]+)%.")
    if not file_md5 then
        ngx.say("invalid file path")
        return
    end
    
    local key_cnt, err = red:get(file_md5 .. "-count")
    if not key_cnt then
        ngx.log(ngx.ERR, "failed to get key count: ", err)
        return
    end
    
    ngx.header["Content-Length"] = tonumber(key_cnt)
    ngx.header["Content-Type"] = "application/octet-stream"
    ngx.header["Content-Disposition"] = "attachment; filename=\""..path.."\""
    
    local chunk_size = 8192
    for i = 1, key_cnt do
        local key = string.format("%s-%d", file_md5, i)
        local data, err = red:get(key)
        if not data then
            ngx.writeHead(500)
            ngx.say("failed to get data")
            return ngx.exit()
        end
        ngx.say(data)
    end
    

Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.