Jsoup异常org.jsoup.UnsupportedMimeTypeException: Unhandled content type的出现原因

港控/mmm° 2023-10-10 17:16 20阅读 0赞

**出现的异常：**

> Exception in thread “main” org.jsoup.UnsupportedMimeTypeException: Unhandled content type. Must be text/\*, application/xml, or application/xhtml+xml. Mimetype=application/json;charset=UTF-8, URL=https://xxx.com/apiname

![image.png][]

在网上看了好几篇文章讲的基本都是关于给Jsoup的Connection设置参数`ignoreContentType(true)`但是没有人说为什么，下面记录一下。

Jsoup发起请求伪代码：这里对28行`execute`进行断点调试

public static String searchTest() throws IOException {
        
            Map<String, String> params = new HashMap<>();
            params.put("p1", "v1");
            params.put("p2", 2);
            Connection connect = Jsoup.connect("https://xxx.com/apiname");
    
            // 把参数序列化为json字符串
            String p = JSON.toJSONString(params);
    
            // org.jsoup.UnsupportedMimeTypeException: Unhandled content type. Must be text/*, application/xml, or application/xhtml+xml. Mimetype=application/json;charset=UTF-8, URL=https://xxx.com/apiname
            /*
             * Jsoup发起POST请求，发送一段json参数到服务器。
        	 *
             * 设置了请求body和请求method，在执行execute时，会把参数写到conn创建链接的输出流当中，接收端能接收并进行解析转换
             * ignoreContentType(true) 忽略这个状态，这样会判断请求后的后端response中的Content-Type是否包含text/* ...等
             * */
            Connection.Response execute = connect
                    .method(Connection.Method.POST)
                	// 设置请求头
                    .header("Content-Type", "application/json; charset=UTF-8") 
                    .header("Accept", "text/plain, */*; q=0.01")
                    .header("Accept-Encoding", "gzip,deflate,sdch")
                    .header("Accept-Language", "es-ES,es;q=0.8")
                    .header("Connection", "keep-alive")
                    .header("X-Requested-With", "XMLHttpRequest")
                    .ignoreContentType(true)
                    .requestBody(p)
                    .execute();
    
            String body = execute.body();
            System.err.println(body);
            return body;
        }

**调试过程：**

1.  第一步：进入断点

![image.png][image.png 1]  
![image.png][image.png 2]

1.  第二步：请求后的res响应头，Content-Type类型判断

![image.png][image.png 3]

**重点：**  
Jsoup要求后端`Response`的类型必须包含`Must be text/*, application/xml, or application/xhtml+xml`，但是请求的服务端并没有返回包含这几个类型的Content-Type值，所以需要进行设置`ignoreContentType(true)`进行忽略，就不会直接抛出异常。

**源码分析：**  
部分注释写到代码上，重点关注第`15`、`27`、`64`、`134`行代码

static HttpConnection.Response execute(org.jsoup.Connection.Request req, HttpConnection.Response previousResponse) throws IOException {
        
                Validate.notNull(req, "Request must not be null");
                String protocol = req.url().getProtocol();
                if (!protocol.equals("http") && !protocol.equals("https")) {
        
                    throw new MalformedURLException("Only http & https protocols supported");
                } else {
        
                    boolean methodHasBody = req.method().hasBody(); // 判断是否包含请求方式：GET、POST...
                    boolean hasRequestBody = req.requestBody() != null; // 判断是否包含请求体
                    if (!methodHasBody) {
        
                        Validate.isFalse(hasRequestBody, "Cannot set a request body for HTTP method " + req.method());
                    }
    
                    String mimeBoundary = null;
                    if (req.data().size() > 0 && (!methodHasBody || hasRequestBody)) {
        
                        // 没有设置请求方式和data请求参数，会直接把参数序列化到url上面
                        serialiseRequestUrl(req);
                    } else if (methodHasBody) {
        
                        mimeBoundary = setOutputContentType(req);
                    }
    
                    HttpURLConnection conn = createConnection(req);
    
                    HttpConnection.Response res;
                    try {
        
                        conn.connect();
                        if (conn.getDoOutput()) {
        
                            // 写参数到请求中，见下面：writePost方法
                            writePost(req, conn.getOutputStream(), mimeBoundary);
                        }
    
                        int status = conn.getResponseCode();
                        res = new HttpConnection.Response(previousResponse);
                        res.setupFromConnection(conn, previousResponse);
                        res.req = req;
                        String contentType;
                        if (res.hasHeader("Location") && req.followRedirects()) {
        
                            if (status != 307) {
        
                                req.method(Method.GET);
                                req.data().clear();
                            }
    
                            contentType = res.header("Location");
                            if (contentType != null && contentType.startsWith("http:/") && contentType.charAt(6) != '/') {
        
                                contentType = contentType.substring(6);
                            }
    
                            URL redir = StringUtil.resolve(req.url(), contentType);
                            req.url(HttpConnection.encodeUrl(redir));
                            Iterator var11 = res.cookies.entrySet().iterator();
    
                            while(var11.hasNext()) {
        
                                Entry<String, String> cookie = (Entry)var11.next();
                                req.cookie((String)cookie.getKey(), (String)cookie.getValue());
                            }
    
                            HttpConnection.Response var21 = execute(req, res);
                            return var21;
                        }
    
                        if ((status < 200 || status >= 400) && !req.ignoreHttpErrors()) {
        
                            throw new HttpStatusException("HTTP error fetching URL", status, req.url().toString());
                        }
    
                        // 响应中的Content-Type是否包含下面逻辑匹配
                        contentType = res.contentType();
                        if (contentType != null && !req.ignoreContentType() && !contentType.startsWith("text/") && !xmlContentTypeRxp.matcher(contentType).matches()) {
        
                            throw new UnsupportedMimeTypeException("Unhandled content type. Must be text/*, application/xml, or application/xhtml+xml", contentType, req.url().toString());
                        }
    
                        if (contentType != null && xmlContentTypeRxp.matcher(contentType).matches() && req instanceof HttpConnection.Request && !((HttpConnection.Request)req).parserDefined) {
        
                            req.parser(Parser.xmlParser());
                        }
    
                        res.charset = DataUtil.getCharsetFromContentType(res.contentType);
                        if (conn.getContentLength() != 0 && req.method() != Method.HEAD) {
        
                            Object bodyStream = null;
    
                            try {
        
                                bodyStream = conn.getErrorStream() != null ? conn.getErrorStream() : conn.getInputStream();
                                if (res.hasHeaderWithValue("Content-Encoding", "gzip")) {
        
                                    bodyStream = new GZIPInputStream((InputStream)bodyStream);
                                }
    
                                res.byteData = DataUtil.readToByteBuffer((InputStream)bodyStream, req.maxBodySize());
                            } finally {
        
                                if (bodyStream != null) {
        
                                    ((InputStream)bodyStream).close();
                                }
    
                            }
                        } else {
        
                            res.byteData = DataUtil.emptyByteBuffer();
                        }
                    } finally {
        
                        conn.disconnect();
                    }
    
                    res.executed = true;
                    return res;
                }
            }
    
    
    
    private static void writePost(org.jsoup.Connection.Request req, OutputStream outputStream, String bound) throws IOException {
        
                Collection<org.jsoup.Connection.KeyVal> data = req.data();
                BufferedWriter w = new BufferedWriter(new OutputStreamWriter(outputStream, req.postDataCharset()));
                if (bound != null) {
        
                    for(Iterator var5 = data.iterator(); var5.hasNext(); w.write("\r\n")) {
        
                        org.jsoup.Connection.KeyVal keyVal = (org.jsoup.Connection.KeyVal)var5.next();
                        w.write("--");
                        w.write(bound);
                        w.write("\r\n");
                        w.write("Content-Disposition: form-data; name=\"");
                        w.write(HttpConnection.encodeMimeName(keyVal.key()));
                        w.write("\"");
                        if (keyVal.hasInputStream()) {
        
                            w.write("; filename=\"");
                            w.write(HttpConnection.encodeMimeName(keyVal.value()));
                            w.write("\"\r\nContent-Type: application/octet-stream\r\n\r\n");
                            w.flush();
                            DataUtil.crossStreams(keyVal.inputStream(), outputStream);
                            outputStream.flush();
                        } else {
        
                            w.write("\r\n\r\n");
                            w.write(keyVal.value());
                        }
                    }
    
                    w.write("--");
                    w.write(bound);
                    w.write("--");
                } else if (req.requestBody() != null) {
        
                    // 包含请求体，就把请求参数写到outputStream，outputStream提交到服务端进行解析
                    w.write(req.requestBody());
                } else {
        
                    boolean first = true;
                    Iterator var9 = data.iterator();
    
                    while(var9.hasNext()) {
        
                        org.jsoup.Connection.KeyVal keyVal = (org.jsoup.Connection.KeyVal)var9.next();
                        if (!first) {
        
                            w.append('&');
                        } else {
        
                            first = false;
                        }
    
                        w.write(URLEncoder.encode(keyVal.key(), req.postDataCharset()));
                        w.write(61);
                        w.write(URLEncoder.encode(keyVal.value(), req.postDataCharset()));
                    }
                }
    
                w.close();
            }

**参考文章：**  
[https://blog.csdn.net/dietime1943/article/details/78974194][https_blog.csdn.net_dietime1943_article_details_78974194]

[image.png]: https://img-blog.csdnimg.cn/img_convert/68a9544051ff6021d5d5667b692bfcc7.png#averageHue=#312d2c&clientId=uce1bd4df-c46c-4&from=paste&height=167&id=ubb4acbbf&name=image.png&originHeight=251&originWidth=1719&originalType=binary&ratio=1.5&rotation=0&showTitle=false&size=67304&status=done&style=none&taskId=u4c375c11-c454-4bb3-a0da-9afd49057fa&title=&width=1146
[image.png 1]: https://img-blog.csdnimg.cn/img_convert/5b1b44e9cb486a39dd4fc7fd1ffefc0d.png#averageHue=#a3723f&clientId=uce1bd4df-c46c-4&from=paste&height=105&id=u1eb9bbc4&name=image.png&originHeight=158&originWidth=929&originalType=binary&ratio=1.5&rotation=0&showTitle=false&size=21809&status=done&style=none&taskId=u5c2a4c3d-e7ea-411c-8a48-f41a7ad90b6&title=&width=619.3333333333334
[image.png 2]: https://img-blog.csdnimg.cn/img_convert/d994956e87635995d1f4b095a770c0d0.png#averageHue=#a47e4a&clientId=uce1bd4df-c46c-4&from=paste&height=77&id=u6c3d0462&name=image.png&originHeight=116&originWidth=1265&originalType=binary&ratio=1.5&rotation=0&showTitle=false&size=25280&status=done&style=none&taskId=uef6795bf-181d-4b4f-876d-daa32d91513&title=&width=843.3333333333334
[image.png 3]: https://img-blog.csdnimg.cn/img_convert/5e3b05ca1f1177b1be348192f1e3749c.png#averageHue=#2e2d2c&clientId=uce1bd4df-c46c-4&from=paste&height=99&id=u9d821415&name=image.png&originHeight=148&originWidth=1734&originalType=binary&ratio=1.5&rotation=0&showTitle=false&size=36322&status=done&style=none&taskId=uf42bc5d9-1ea5-4a05-b6d3-31c89254941&title=&width=1156
[https_blog.csdn.net_dietime1943_article_details_78974194]: https://blog.csdn.net/dietime1943/article/details/78974194