基于OpenCV的基本图形识别

淩亂°似流年 2024-03-02 06:34 51阅读 0赞

目录  
1 形状特征描述 1  
1.1 傅里叶算子 1  
1.2 边缘检测 3  
2 神经网络 4  
2.1 样本准备 4  
2.2 神经网络训练 5  
2.3 增量学习 5  
3 GUI实现 5  
3.1 HighGUI下的轮廓叠加与高亮 5  
3.2 QT下的功能布局 6  
4 总结 6  
参 考 文 献 8  
2.1样本准备  
神经网络的训练需要大量样本，因此利用matlab编写了自动生成基本形状图片的程序。实现过程中需要考虑两个细节：  
一些具有偏差的基本形状可以近似认为符合某类的标准。如长宽比接近1的矩形、邻边不严格垂直但接近正方形，都可以归类为正方形。  
除去归一化大小减少的一个自由度，同一类形状具有多个自由度的变化。如三角形具有高、顶点的水平位置两个自由度。  
通过matlab随机生成的7类形状，每类样本达2000个，充分保证了神经网络的泛化能力。部分生成的样本如图 4 部分生成的样本 所示。  
![在这里插入图片描述][b3c02e3c8dc54f4d906ca6e3a23f37f9.png]

图 4 部分生成的样本

<?xml version="1.0" encoding="UTF-8"?>
    <ui version="4.0">
     <class>MainWindow</class>
     <widget class="QMainWindow" name="MainWindow">
      <property name="geometry">
       <rect>
        <x>0</x>
        <y>0</y>
        <width>570</width>
        <height>535</height>
       </rect>
      </property>
      <property name="windowTitle">
       <string>MainWindow</string>
      </property>
      <widget class="QWidget" name="centralWidget">
       <widget class="QGroupBox" name="groupBoxShapeRecognising">
        <property name="geometry">
         <rect>
          <x>30</x>
          <y>10</y>
          <width>251</width>
          <height>141</height>
         </rect>
        </property>
        <property name="title">
         <string>形状识别</string>
        </property>
        <widget class="QLabel" name="labelPreProcessingMethod">
         <property name="geometry">
          <rect>
           <x>10</x>
           <y>50</y>
           <width>71</width>
           <height>21</height>
          </rect>
         </property>
         <property name="text">
          <string>预处理方法：</string>
         </property>
        </widget>
        <widget class="QPushButton" name="pushButtonCameraIn">
         <property name="geometry">
          <rect>
           <x>130</x>
           <y>20</y>
           <width>111</width>
           <height>21</height>
          </rect>
         </property>
         <property name="text">
          <string>摄像头输入</string>
         </property>
        </widget>
        <widget class="QSlider" name="horizontalSliderAreaThreshold">
         <property name="geometry">
          <rect>
           <x>100</x>
           <y>110</y>
           <width>141</width>
           <height>22</height>
          </rect>
         </property>
         <property name="minimum">
          <number>5</number>
         </property>
         <property name="maximum">
          <number>100</number>
         </property>
         <property name="orientation">
          <enum>Qt::Horizontal</enum>
         </property>
        </widget>
        <widget class="QLabel" name="labelAreaThreshold">
         <property name="geometry">
          <rect>
           <x>10</x>
           <y>110</y>
           <width>71</width>
           <height>21</height>
          </rect>
         </property>
         <property name="text">
          <string>面积阈值：</string>
         </property>
        </widget>
        <widget class="QSpinBox" name="spinBoxCameraID">
         <property name="geometry">
          <rect>
           <x>100</x>
           <y>80</y>
           <width>141</width>
           <height>22</height>
          </rect>
         </property>
        </widget>
        <widget class="QLabel" name="labelCameraID">
         <property name="geometry">
          <rect>
           <x>10</x>
           <y>80</y>
           <width>71</width>
           <height>21</height>
          </rect>
         </property>
         <property name="text">
          <string>摄像头ID：</string>
         </property>
        </widget>
        <widget class="QPushButton" name="pushButtonImSelect">
         <property name="geometry">
          <rect>
           <x>10</x>
           <y>20</y>
           <width>111</width>
           <height>21</height>
          </rect>
         </property>
         <property name="text">
          <string>选取图片</string>
         </property>
        </widget>
        <widget class="QComboBox" name="comboBoxPreProcessingMethod">
         <property name="geometry">
          <rect>
           <x>80</x>
           <y>50</y>
           <width>161</width>
           <height>22</height>
          </rect>
         </property>
         <item>
          <property name="text">
           <string>OTSU（默认）</string>
          </property>
         </item>
         <item>
          <property name="text">
           <string>自适应二值化</string>
          </property>
         </item>
         <item>
          <property name="text">
           <string>CANNY边缘检测</string>
          </property>
         </item>
        </widget>
        <zorder>labelPreProcessingMethod</zorder>
        <zorder>pushButtonCameraIn</zorder>
        <zorder>horizontalSliderAreaThreshold</zorder>
        <zorder>labelAreaThreshold</zorder>
        <zorder>labelCameraID</zorder>
        <zorder>pushButtonImSelect</zorder>
        <zorder>spinBoxCameraID</zorder>
        <zorder>comboBoxPreProcessingMethod</zorder>
       </widget>
       <widget class="QGroupBox" name="groupBoxResetSampleNet">
        <property name="geometry">
         <rect>
          <x>30</x>
          <y>160</y>
          <width>251</width>
          <height>111</height>
         </rect>
        </property>
        <property name="title">
         <string>重置神经网络和样本</string>
        </property>
        <widget class="QPushButton" name="pushButtonResetSampleNet">
         <property name="enabled">
          <bool>true</bool>
         </property>
         <property name="geometry">
          <rect>
           <x>10</x>
           <y>80</y>
           <width>231</width>
           <height>21</height>
          </rect>
         </property>
         <property name="text">
          <string>重置</string>
         </property>
         <property name="checkable">
          <bool>false</bool>
         </property>
         <property name="checked">
          <bool>false</bool>
         </property>
        </widget>
        <widget class="QSpinBox" name="spinBoxNumLayers">
         <property name="geometry">
          <rect>
           <x>100</x>
           <y>20</y>
           <width>141</width>
           <height>22</height>
          </rect>
         </property>
         <property name="minimum">
          <number>1</number>
         </property>
        </widget>
        <widget class="QLabel" name="labelNumLayers">
         <property name="geometry">
          <rect>
           <x>10</x>
           <y>20</y>
           <width>71</width>
           <height>21</height>
          </rect>
         </property>
         <property name="text">
          <string>隐含层层数：</string>
         </property>
        </widget>
        <widget class="QLabel" name="labelHiddenLayerSize">
         <property name="geometry">
          <rect>
           <x>10</x>
           <y>50</y>
           <width>61</width>
           <height>21</height>
          </rect>
         </property>
         <property name="text">
          <string>层节点数：</string>
         </property>
        </widget>
        <widget class="QSpinBox" name="spinBoxHiddenLayerSize">
         <property name="geometry">
          <rect>
           <x>100</x>
           <y>50</y>
           <width>141</width>
           <height>21</height>
          </rect>
         </property>
         <property name="minimum">
          <number>1</number>
         </property>
         <property name="value">
          <number>9</number>
         </property>
        </widget>
       </widget>
       <widget class="QGroupBox" name="groupBoxRenameShape">
        <property name="enabled">
         <bool>true</bool>
        </property>
        <property name="geometry">
         <rect>
          <x>30</x>
          <y>280</y>
          <width>251</width>
          <height>171</height>
         </rect>
        </property>
        <property name="title">
         <string>点击图形纠错</string>
        </property>
        <widget class="QComboBox" name="comboBoxCategory">
         <property name="geometry">
          <rect>
           <x>100</x>
           <y>20</y>
           <width>141</width>
           <height>21</height>
          </rect>
         </property>
         <property name="currentIndex">
          <number>-1</number>
         </property>
         <property name="maxVisibleItems">
          <number>10</number>
         </property>
        </widget>
        <widget class="QLabel" name="labelClassify">
         <property name="geometry">
          <rect>
           <x>10</x>
           <y>20</y>
           <width>81</width>
           <height>21</height>
          </rect>
         </property>
         <property name="text">
          <string>选择类别：</string>
         </property>
        </widget>
        <widget class="QLineEdit" name="lineEditAddCategory">
         <property name="geometry">
          <rect>
           <x>100</x>
           <y>50</y>
           <width>91</width>
           <height>21</height>
          </rect>
         </property>
        </widget>
        <widget class="QLabel" name="labelAddCategory">
         <property name="geometry">
          <rect>
           <x>10</x>
           <y>50</y>
           <width>81</width>
           <height>21</height>
          </rect>
         </property>
         <property name="text">
          <string>添加类别：</string>
         </property>
        </widget>
        <widget class="QPushButton" name="pushButtonAddClassify">
         <property name="geometry">
          <rect>
           <x>200</x>
           <y>50</y>
           <width>41</width>
           <height>23</height>
          </rect>
         </property>
         <property name="text">
          <string>添加</string>
         </property>
        </widget>
        <widget class="QLabel" name="labelWeight">
         <property name="geometry">
          <rect>
           <x>10</x>
           <y>80</y>
           <width>81</width>
           <height>21</height>
          </rect>
         </property>
         <property name="text">
          <string>增加步长：</string>
         </property>
        </widget>
        <widget class="QLabel" name="labelNoiseStrength">
         <property name="geometry">
          <rect>
           <x>10</x>
           <y>110</y>
           <width>81</width>
           <height>21</height>
          </rect>
         </property>
         <property name="text">
          <string>添加噪声：</string>
         </property>
        </widget>
        <widget class="QSpinBox" name="spinBoxWeight">
         <property name="geometry">
          <rect>
           <x>100</x>
           <y>80</y>
           <width>141</width>
           <height>22</height>
          </rect>
         </property>
         <property name="minimum">
          <number>0</number>
         </property>
         <property name="maximum">
          <number>30000</number>
         </property>
         <property name="value">
          <number>30</number>
         </property>
        </widget>
        <widget class="QSpinBox" name="spinBoxNoiseStrength">
         <property name="geometry">
          <rect>
           <x>100</x>
           <y>110</y>
           <width>91</width>
           <height>22</height>
          </rect>
         </property>
         <property name="maximum">
          <number>20</number>
         </property>
         <property name="singleStep">
          <number>0</number>
         </property>
         <property name="value">
          <number>5</number>
         </property>
        </widget>
        <widget class="QPushButton" name="pushButtonStartFineTuning">
         <property name="geometry">
          <rect>
           <x>10</x>
           <y>140</y>
           <width>231</width>
           <height>21</height>
          </rect>
         </property>
         <property name="text">
          <string>微调神经网络</string>
         </property>
        </widget>
        <widget class="QLabel" name="labelNoiseUnit">
         <property name="geometry">
          <rect>
           <x>200</x>
           <y>110</y>
           <width>41</width>
           <height>21</height>
          </rect>
         </property>
         <property name="text">
          <string>像素</string>
         </property>
         <property name="alignment">
          <set>Qt::AlignCenter</set>
         </property>
        </widget>
       </widget>
       <widget class="QTextBrowser" name="textBrowserLog">
        <property name="geometry">
         <rect>
          <x>290</x>
          <y>20</y>
          <width>251</width>
          <height>491</height>
         </rect>
        </property>
        <property name="html">
         <string><!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0//EN" "http://www.w3.org/TR/REC-html40/strict.dtd">
    <html><head><meta name="qrichtext" content="1" /><style type="text/css">
    p, li {
         white-space: pre-wrap; }
    </style></head><body style=" font-family:'SimSun'; font-size:9pt; font-weight:400; font-style:normal;">
    <p style="-qt-paragraph-type:empty; margin-top:0px; margin-bottom:0px; margin-left:0px; margin-right:0px; -qt-block-indent:0; text-indent:0px;"><br /></p></body></html></string>
        </property>
       </widget>
       <widget class="QGroupBox" name="groupBoxAfterChange">
        <property name="enabled">
         <bool>true</bool>
        </property>
        <property name="geometry">
         <rect>
          <x>30</x>
          <y>460</y>
          <width>251</width>
          <height>51</height>
         </rect>
        </property>
        <property name="title">
         <string>保存或还原神经网络和样本</string>
        </property>
        <widget class="QPushButton" name="pushButtonSaveNetAndSample">
         <property name="geometry">
          <rect>
           <x>10</x>
           <y>20</y>
           <width>111</width>
           <height>21</height>
          </rect>
         </property>
         <property name="text">
          <string>保存</string>
         </property>
        </widget>
        <widget class="QPushButton" name="pushButtonLoadNetAndSample">
         <property name="geometry">
          <rect>
           <x>130</x>
           <y>20</y>
           <width>111</width>
           <height>21</height>
          </rect>
         </property>
         <property name="text">
          <string>还原</string>
         </property>
        </widget>
       </widget>
      </widget>
     </widget>
     <layoutdefault spacing="6" margin="11"/>
     <resources/>
     <connections/>
    </ui>

![在这里插入图片描述][3a4429e72532491680fbe0f19fac002b.png_pic_center]  
![在这里插入图片描述][4ecbb9042e5e46bf83d0acca87a999e3.png_pic_center]  
![在这里插入图片描述][ac15d3839ff648ee9af252e272d05f0b.png_pic_center]  
![在这里插入图片描述][5441585df8634df09835227e98f1bad9.png_pic_center]  
![在这里插入图片描述][79b0cb7b3069435794425dc78ea1faf8.png_pic_center]  
![在这里插入图片描述][19c0f6730c47440890f690a5112d6898.png_pic_center]  
![在这里插入图片描述][d08c52bcf82f4ed2b55224187c0801f2.png_pic_center]  
![在这里插入图片描述][66aa10640df947ee8a5e55089ddf86c9.png_pic_center]  
![在这里插入图片描述][05b1103abbf04675a1189b8ce5e9147e.png_pic_center]  
![在这里插入图片描述][88edaeebf3b2408eb226fdfd61b1130f.png_pic_center]  
![在这里插入图片描述][9b48e8b347d64244a1e448a4c3ede2bb.png_pic_center]  
![在这里插入图片描述][582162d30918439089f05e00ac9398f6.png_pic_center]  
![在这里插入图片描述][0b9620a91b944e71a89e2d061261980f.png_pic_center]  
![在这里插入图片描述][d37d769723a04d6f8f6a905eeb188f17.png_pic_center]  
![在这里插入图片描述][d8c74aafce9b476c81fb7b34055eefe3.png_pic_center]  
![在这里插入图片描述][cc1ded8a16b4449b91b2f555bcdb752f.png_pic_center]

[b3c02e3c8dc54f4d906ca6e3a23f37f9.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/03/02/cfb7a01589e54073a225d1fd281ddb63.png
[3a4429e72532491680fbe0f19fac002b.png_pic_center]: https://image.dandelioncloud.cn/pgy_files/images/2024/03/02/9469be4383fd42f1982783d6155a705e.png
[4ecbb9042e5e46bf83d0acca87a999e3.png_pic_center]: https://image.dandelioncloud.cn/pgy_files/images/2024/03/02/4e934e6857214591a1d2af825484958b.png
[ac15d3839ff648ee9af252e272d05f0b.png_pic_center]: https://image.dandelioncloud.cn/pgy_files/images/2024/03/02/63f348a806b24e97a2a3cb8adcaae2c9.png
[5441585df8634df09835227e98f1bad9.png_pic_center]: https://image.dandelioncloud.cn/pgy_files/images/2024/03/02/28ca98c219c34ae394ca72457c701e33.png
[79b0cb7b3069435794425dc78ea1faf8.png_pic_center]: https://image.dandelioncloud.cn/pgy_files/images/2024/03/02/aca606af073b4b9497b6332aef47cf03.png
[19c0f6730c47440890f690a5112d6898.png_pic_center]: https://image.dandelioncloud.cn/pgy_files/images/2024/03/02/10d058e28b9444d9b83c42cd5c75e4e9.png
[d08c52bcf82f4ed2b55224187c0801f2.png_pic_center]: https://image.dandelioncloud.cn/pgy_files/images/2024/03/02/6086957b6dc84f74804ba4b04d66e77b.png
[66aa10640df947ee8a5e55089ddf86c9.png_pic_center]: https://image.dandelioncloud.cn/pgy_files/images/2024/03/02/82c5e865bf2f4271960172f89c67a19c.png
[05b1103abbf04675a1189b8ce5e9147e.png_pic_center]: https://image.dandelioncloud.cn/pgy_files/images/2024/03/02/d14e453c36e54dd880df0a1513db5810.png
[88edaeebf3b2408eb226fdfd61b1130f.png_pic_center]: https://image.dandelioncloud.cn/pgy_files/images/2024/03/02/b46c9778dda14d6a810ab1eac8d15795.png
[9b48e8b347d64244a1e448a4c3ede2bb.png_pic_center]: https://image.dandelioncloud.cn/pgy_files/images/2024/03/02/19dd12a4b7ce48c097f6b16441b87500.png
[582162d30918439089f05e00ac9398f6.png_pic_center]: https://image.dandelioncloud.cn/pgy_files/images/2024/03/02/879c9ab984f34b4fb063c303bd71d4bd.png
[0b9620a91b944e71a89e2d061261980f.png_pic_center]: https://image.dandelioncloud.cn/pgy_files/images/2024/03/02/cf60bedb8a7545ee83da36f925503ea4.png
[d37d769723a04d6f8f6a905eeb188f17.png_pic_center]: https://image.dandelioncloud.cn/pgy_files/images/2024/03/02/69e56c6257ff4f72a6c360462bda7ea8.png
[d8c74aafce9b476c81fb7b34055eefe3.png_pic_center]: https://image.dandelioncloud.cn/pgy_files/images/2024/03/02/a08612f8dfa44879a2801095c65c9957.png
[cc1ded8a16b4449b91b2f555bcdb752f.png_pic_center]: https://image.dandelioncloud.cn/pgy_files/images/2024/03/02/48e94258766149f4b4b885faaa4bf081.png