获取代理IP（proxy_pool）

r囧r小猫 2024-04-18 22:06 60阅读 0赞

**1.首先拉取代码**

https://github.com/jhao104/proxy_pool.git

**2.配置py环境：**

pip install -r requirements.txt

** 配置配置文件（redis）（Config中）**

DB_TYPE = getenv('db_type', 'REDIS').upper()
    DB_HOST = getenv('db_host', '127.0.0.1')
    DB_PORT = getenv('db_port', '6379')
    DB_PASSWORD = getenv('db_password', '')

**3.运行（cli）**

# 首先启动调度程序
    >>>python proxyPool.py schedule
    
    # 然后启动webApi服务
    >>>python proxyPool.py webserver

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzM3NTk4MDEx_size_16_color_FFFFFF_t_70][]

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzM3NTk4MDEx_size_16_color_FFFFFF_t_70 1][]

如果出现lxml不可用的情况，则运行

pip3 install lxml-4.2.1-cp37-cp37m-win_amd64.whl

lxml-4.2.1-cp37-cp37m-win_amd64.whl

![2019091314043478.png][]

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzM3NTk4MDEx_size_16_color_FFFFFF_t_70 2][]

github地址：[https://github.com/jhao104/proxy\_pool][https_github.com_jhao104_proxy_pool]

[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzM3NTk4MDEx_size_16_color_FFFFFF_t_70]: https://image.dandelioncloud.cn/pgy_files/images/2024/04/18/cc39e6d06fd64084a8cb0decce94a964.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzM3NTk4MDEx_size_16_color_FFFFFF_t_70 1]: https://image.dandelioncloud.cn/pgy_files/images/2024/04/18/a076751e149d4e1b9a218f536beb8e21.png
[2019091314043478.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/04/18/a0404803ddf441bca2d89ca1dd47913c.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzM3NTk4MDEx_size_16_color_FFFFFF_t_70 2]: https://image.dandelioncloud.cn/pgy_files/images/2024/04/18/5a737803fd904f1b84f5285867a55b92.png
[https_github.com_jhao104_proxy_pool]: https://github.com/jhao104/proxy_pool