网络爬虫中解析json时遇到字符中包含双引号等字符

朱雀 2022-06-01 00:39 271阅读 0赞

在使用fastjson解析json时，有时会遇到json串中包含英文中的双引号，比如在评论中包含双引号的评论。

如下所示json串：

{"returncode":0,"message":"","result":{"pageindex":1,"pagecount":1,"rowcount":15,"list":[{"topicid":21376821,"topictype":"","title":"A4油耗设置，","postdate":"2013-04-01 09:10:06","lastreplydate":"2013-04-01 10:24:27","ispic":0,"ispoll":0,"ishtml":1,"isrecommend":0,"isdelete":0,"isclose":0,"isrefine":0,"replycount":5,"bbsid":692,"bbs":"c","bbsname":"奥迪A4L论坛"},{"topicid":21137731,"topictype":"","title":"这坛子没版主吗？提车作业不给精，不认证？","postdate":"2013-03-27 18:23:49","lastreplydate":"2013-03-28 12:57:49","ispic":0,"ispoll":0,"ishtml":1,"isrecommend":0,"isdelete":0,"isclose":0,"isrefine":0,"replycount":4,"bbsid":692,"bbs":"c","bbsname":"奥迪A4L论坛"},{"topicid":21081947,"topictype":"","title":"安装座套问题，求神指教","postdate":"2013-03-26 20:27:16","lastreplydate":"2013-03-27 12:17:22","ispic":0,"ispoll":0,"ishtml":1,"isrecommend":0,"isdelete":0,"isclose":0,"isrefine":0,"replycount":4,"bbsid":692,"bbs":"c","bbsname":"奥迪A4L论坛"},{"topicid":21037360,"topictype":"","title":"左后视镜虚线是什么功能？13款标准带后视镜电加热吗？","postdate":"2013-03-25 10:03:40","lastreplydate":"2013-03-25 14:26:23","ispic":0,"ispoll":0,"ishtml":1,"isrecommend":0,"isdelete":0,"isclose":0,"isrefine":0,"replycount":6,"bbsid":692,"bbs":"c","bbsname":"奥迪A4L论坛"},{"topicid":20889818,"topictype":"图","title":"屌丝"哥"提车记（申精）求认证","postdate":"2013-03-23 17:41:59","lastreplydate":"2013-04-08 11:54:46","ispic":1,"ispoll":0,"ishtml":1,"isrecommend":0,"isdelete":0,"isclose":0,"isrefine":0,"replycount":42,"bbsid":692,"bbs":"c","bbsname":"奥迪A4L论坛"},{"topicid":20799306,"topictype":"","title":"明天提车，4S要给我哪些东西啊","postdate":"2013-03-22 11:35:38","lastreplydate":"2013-03-22 13:42:17","ispic":0,"ispoll":0,"ishtml":1,"isrecommend":0,"isdelete":0,"isclose":0,"isrefine":0,"replycount":6,"bbsid":692,"bbs":"c","bbsname":"奥迪A4L论坛"},{"topicid":20730114,"topictype":"","title":"后天提车","postdate":"2013-03-21 20:47:53","lastreplydate":"2013-06-15 14:17:34","ispic":0,"ispoll":0,"ishtml":1,"isrecommend":0,"isdelete":0,"isclose":0,"isrefine":0,"replycount":4,"bbsid":692,"bbs":"c","bbsname":"奥迪A4L论坛"},{"topicid":20353689,"topictype":"","title":"咨询下做建行车贷的朋友","postdate":"2013-03-14 14:56:36","lastreplydate":"2013-03-14 18:29:22","ispic":0,"ispoll":0,"ishtml":1,"isrecommend":0,"isdelete":0,"isclose":0,"isrefine":0,"replycount":2,"bbsid":692,"bbs":"c","bbsname":"奥迪A4L论坛"},{"topicid":20346052,"topictype":"","title":"求教，车贷几天能放款","postdate":"2013-03-14 06:55:42","lastreplydate":"2013-03-14 09:59:55","ispic":0,"ispoll":0,"ishtml":1,"isrecommend":0,"isdelete":0,"isclose":0,"isrefine":0,"replycount":1,"bbsid":692,"bbs":"c","bbsname":"奥迪A4L论坛"},{"topicid":20296386,"topictype":"","title":"车贷问题可以问我，昨天订车，办完车贷","postdate":"2013-03-13 07:14:23","lastreplydate":"2013-03-13 14:33:09","ispic":0,"ispoll":0,"ishtml":1,"isrecommend":0,"isdelete":0,"isclose":0,"isrefine":0,"replycount":26,"bbsid":692,"bbs":"c","bbsname":"奥迪A4L论坛"},{"topicid":20268263,"topictype":"","title":"刚订车，常州价格","postdate":"2013-03-12 22:38:38","lastreplydate":"2013-03-13 14:55:48","ispic":0,"ispoll":0,"ishtml":1,"isrecommend":0,"isdelete":0,"isclose":0,"isrefine":0,"replycount":8,"bbsid":692,"bbs":"c","bbsname":"奥迪A4L论坛"},{"topicid":20097588,"topictype":"","title":"常州价格","postdate":"2013-03-07 18:19:55","lastreplydate":"2013-03-08 00:15:55","ispic":0,"ispoll":0,"ishtml":1,"isrecommend":0,"isdelete":0,"isclose":0,"isrefine":0,"replycount":5,"bbsid":692,"bbs":"c","bbsname":"奥迪A4L论坛"},{"topicid":19690200,"topictype":"","title":"贷款问题求指教","postdate":"2013-02-18 20:09:18","lastreplydate":"2013-02-18 20:33:08","ispic":0,"ispoll":0,"ishtml":1,"isrecommend":0,"isdelete":0,"isclose":0,"isrefine":0,"replycount":3,"bbsid":66,"bbs":"c","bbsname":"宝马3系论坛"},{"topicid":15926870,"topictype":"精","title":"提车作业咖啡金色","postdate":"2012-06-25 15:52:37","lastreplydate":"2012-08-03 15:49:26","ispic":0,"ispoll":0,"ishtml":1,"isrecommend":0,"isdelete":0,"isclose":0,"isrefine":3,"replycount":52,"bbsid":2566,"bbs":"c","bbsname":"欧诺论坛"},{"topicid":15899754,"topictype":"","title":"明天提车，等作业","postdate":"2012-06-23 08:08:15","lastreplydate":"2012-06-23 17:27:18","ispic":0,"ispoll":0,"ishtml":1,"isrecommend":0,"isdelete":0,"isclose":0,"isrefine":0,"replycount":5,"bbsid":2566,"bbs":"c","bbsname":"欧诺论坛"}]}}

上述字符串中包含的”“，导致没办法解析该json：

屌丝"哥"提车记（申精）求认证

为此，需要将json串进行转义，将这些双引号，转化为中文的双引号：

//将坏的json数据里面的双引号，改为中文的双引号 
        public static String jsonStringConvert(String s){  
            char[] temp = s.toCharArray();         
            int n = temp.length;  
            for(int i =0;i<n;i++){  
                if(temp[i]==':'&&temp[i+1]=='"'){  
                    for(int j =i+2;j<n;j++){  
                        if(temp[j]=='"'){  
                            if(temp[j+1]!=',' &&  temp[j+1]!='}'){  
                                temp[j]='”';  
                            }else if(temp[j+1]==',' ||  temp[j+1]=='}'){  
                                break ;  
                            }  
                        }  
                    }     
                }  
            }         
            return new String(temp);  
        }

发表评论取消回复

表情：

评论列表（有 0 条评论，271人围观）

还没有评论，来说两句吧...

相关阅读

相关 url中包含@、冒号等特殊字符

背景： springboot中，使用url连接mongodb时，一般用 mongodb://{username}:{password}@ip:port 如果密码中

r囧r小猫/ 2024年04月01日 10:30/ 0 赞/ 119 阅读

相关 json中增加转义字符“\“

一、使用 org.json.JSONObject，将第一个json对象转string之后，塞到第二个对象中，会自动加上转义字符。 import org.json.JS

今天药忘吃喽~/ 2023年09月26日 17:54/ 0 赞/ 54 阅读

相关单引号字符和双引号字符的区别

单引号字符和双引号字符的区别在C语言bai或者Java这类型语言中，单引号代表字符du，比如’1’代表zhi字符1，而不是数字的1。双引号代dao表的是字符串，一个字

小灰灰/ 2022年12月22日 12:29/ 0 赞/ 194 阅读

相关 MySQL之JSON数据类型key包含点等特殊字符时的查询方式

JSON数据为： {"platform.json": {"c-name": "ty"}} SQL查询语句： SELECT `parameters` ->

爱被打了一巴掌/ 2022年12月21日 04:42/ 0 赞/ 417 阅读

相关单引号、双引号在javascript、HTML中的转义字符

在一个网页中，对特殊字符的转义，就需要确认是属于JavaScript语法，还是html语法。先看个JavaScript中双引号的用法： <script type=”tex

逃离我推掉我的手/ 2022年08月18日 11:49/ 0 赞/ 227 阅读

相关网络爬虫中Json数据的解析[以时光网为例]

本文为原创博客，仅供技术学习使用。未经本人允许，不得将其复制下来上传到百度文库等平台。目录 json数据爬虫中Json数据的解析分

拼搏现实的明天。/ 2022年07月16日 22:15/ 0 赞/ 346 阅读

相关 json中非法字符

原文： Hi there, I just discovered Go and decided to port a little program to Go.

小灰灰/ 2022年07月16日 04:17/ 0 赞/ 267 阅读

相关 php中的单引号、双引号和转义字符详解

PHP单引号及双引号均可以修饰字符串类型的数据，如果修饰的字符串中含有变量（例$name）；最大的区别是：双引号会替换变量的值，而单引号会把它当做字符串输出。例如： [

青旅半醒/ 2022年06月16日 03:40/ 0 赞/ 480 阅读

相关网络爬虫中解析json时遇到字符中包含双引号等字符

在使用fastjson解析json时，有时会遇到json串中包含英文中的双引号，比如在评论中包含双引号的评论。如下所示json串： {"returncode":0

朱雀/ 2022年06月01日 00:39/ 0 赞/ 272 阅读

相关包含转义字符的JSON的处理

1.主要是用com.alibaba.fastjson和 net.sf.json 的jar包 String res="\"[{ \\\"state\\\"

傷城~/ 2022年05月21日 11:40/ 0 赞/ 217 阅读