csv文件的读取

谁借莪１个温暖的怀抱￠ 2021-09-13 22:40 594阅读 0赞

读取 CSV 文件  
python 的 CSV 库主要是面向本地文件，但进行网络数据采集的时候，很多文件都是在线的。有以下方法可以解决这个问题。

*  手动把 CSV 文件下载到本机，然后用 python 定位文件位置；
 *  写 python 程序下载文件，读取之后再把源文件删除；
 *  从网上直接把文件读成一个字符串，然后转换成一个StringIO对象，使它具有文件的属性。  
    综上，应选择第三种比较好，即直接把文件读成字符串，然后封装成 StringIO 对象，使它具有文件的属性。程序代码如下：

以网站 [http://pythonscraping.com/files/MontyPythonAlbums.csv][http_pythonscraping.com_files_MontyPythonAlbums.csv] 为例

# 第一种方法：列表表示 #

#coding:utf-8
    from urllib import urlopen
    from io import StringIO
    import csv
    
    data=urlopen("http://pythonscraping.com/files/MontyPythonAlbums.csv").read().decode('ascii','ignore')  #生成字符串对象
    print data
    print "\n******************************************\n"
    dataFile = StringIO(data)
    csvReader = csv.reader(dataFile)      #生成列表，里面含有标题
    
    for row in dictReader:
        print row

**输出结果如下：**

Name,Year
    Monty Python's Flying Circus,1970
    Another Monty Python Record,1971
    Monty Python's Previous Record,1972
    The Monty Python Matching Tie and Handkerchief,1973
    Monty Python Live at Drury Lane,1974
    An Album of the Soundtrack of the Trailer of the Film of Monty Python and the Holy Grail,1975
    Monty Python Live at City Center,1977
    The Monty Python Instant Record Collection,1977
    Monty Python's Life of Brian,1979
    Monty Python's Cotractual Obligation Album,1980
    Monty Python's The Meaning of Life,1983
    The Final Rip Off,1987
    Monty Python Sings,1989
    The Ultimate Monty Python Rip Off,1994
    Monty Python Sings Again,2014
    
    ******************************************
    
    ['Name', 'Year']
    ["Monty Python's Flying Circus", '1970']
    ['Another Monty Python Record', '1971']
    ["Monty Python's Previous Record", '1972']
    ['The Monty Python Matching Tie and Handkerchief', '1973']
    ['Monty Python Live at Drury Lane', '1974']
    ['An Album of the Soundtrack of the Trailer of the Film of Monty Python and the Holy Grail', '1975']
    ['Monty Python Live at City Center', '1977']
    ['The Monty Python Instant Record Collection', '1977']
    ["Monty Python's Life of Brian", '1979']
    ["Monty Python's Cotractual Obligation Album", '1980']
    ["Monty Python's The Meaning of Life", '1983']
    ['The Final Rip Off', '1987']
    ['Monty Python Sings', '1989']
    ['The Ultimate Monty Python Rip Off', '1994']
    ['Monty Python Sings Again', '2014']

# 第二种方法：字典表示 #

#coding:utf-8
    from urllib import urlopen
    from io import StringIO
    import csv
    
    data=urlopen("http://pythonscraping.com/files/MontyPythonAlbums.csv").read().decode('ascii','ignore')
    
    dataFile = StringIO(data)
    
    dictReader = csv.DictReader(dataFile) #生成字典对象
    
    
    for row in dictReader:
        print row

**输出结果如下：**

{'Name': "Monty Python's Flying Circus", 'Year': '1970'}
    {'Name': 'Another Monty Python Record', 'Year': '1971'}
    {'Name': "Monty Python's Previous Record", 'Year': '1972'}
    {'Name': 'The Monty Python Matching Tie and Handkerchief', 'Year': '1973'}
    {'Name': 'Monty Python Live at Drury Lane', 'Year': '1974'}
    {'Name': 'An Album of the Soundtrack of the Trailer of the Film of Monty Python and the Holy Grail', 'Year': '1975'}
    {'Name': 'Monty Python Live at City Center', 'Year': '1977'}
    {'Name': 'The Monty Python Instant Record Collection', 'Year': '1977'}
    {'Name': "Monty Python's Life of Brian", 'Year': '1979'}
    {'Name': "Monty Python's Cotractual Obligation Album", 'Year': '1980'}
    {'Name': "Monty Python's The Meaning of Life", 'Year': '1983'}
    {'Name': 'The Final Rip Off', 'Year': '1987'}
    {'Name': 'Monty Python Sings', 'Year': '1989'}
    {'Name': 'The Ultimate Monty Python Rip Off', 'Year': '1994'}
    {'Name': 'Monty Python Sings Again', 'Year': '2014'}

[http_pythonscraping.com_files_MontyPythonAlbums.csv]: http://pythonscraping.com/files/MontyPythonAlbums.csv