無線傳感器網(wǎng)絡下線性支持向量機分布式協(xié)同訓練方法研究
doi: 10.11999/JEIT140408 cstr: 32379.14.JEIT140408
基金項目:
國家自然科學基金青年基金(61203377)資助課題
Research on the Distributed Training Method for Linear SVM in WSN
-
摘要: 針對無線傳感器網(wǎng)絡中分散在各節(jié)點上的訓練數(shù)據(jù)傳輸?shù)綌?shù)據(jù)融合中心集中訓練支持向量機(Support Vector Machine, SVM)時存在的高通信代價和高能量消耗問題,該文研究了僅依靠相鄰節(jié)點間的相互協(xié)作,在網(wǎng)內(nèi)分布式協(xié)同訓練線性SVM的方法。首先,在各節(jié)點分類器決策變量與集中式分類器決策變量相一致的約束下,對集中式SVM訓練問題進行等價分解,然后利用增廣拉格朗日乘子法,對分解后的SVM問題進行求解和推導,進而提出基于全局平均一致性的線性SVM分布式訓練算法(Average Consensus based Distributed Supported Vector Machine, AC-DSVM);為了降低AC-DSVM算法中全局平均一致性的通信開銷,利用相鄰節(jié)點間的局部平均一致性近似全局平均一致性,提出基于一次全局平均一致性的線性SVM分布式訓練算法(Once Average Consensus based Distributed Supported Vector Machine, 1-AC-DSVM)。仿真實驗結(jié)果表明,與已有算法相比,AC-DSVM算法的迭代次數(shù)和數(shù)據(jù)傳輸量略高,但其能夠完全收斂到集中式訓練結(jié)果;1-AC-DSVM算法具有較好的收斂性,而且在收斂速度和數(shù)據(jù)傳輸量上也表現(xiàn)出顯著優(yōu)勢。
-
關(guān)鍵詞:
- 無線傳感器網(wǎng)絡 /
- 支持向量機 /
- 分布式學習 /
- 增廣拉格朗日乘子法 /
- 平均一致性
Abstract: In Wireless Sensor Network (WSN), transferring all training samples distributed across different nodes to a centralized fusion center for training Support Vector Machine (SVM) significantly increases the communication overhead and energy consumption. Therefore, this paper studies the distributed training approach for linear SVM through the collaboration of neighboring nodes within the networks. First, the centralized linear SVM problem is cast as the solution of coupled decentralized convex optimization sub-problems with consensus constraints on the classifier parameters. Second, the distributed linear SVM problem is solved and derived using the augmented Lagrange multipliers method, and a novel distributed training algorithm, called Average Consensus based Distributed Supported Vector Machine (AC-DSVM), is proposed. To decrease the communication overhead of global average consensus, an improved distributed training algorithm, named Once Average Consensus based Distributed Supported Vector Machine (1-AC-DSVM), is presented, which is only based on once global average consensus. Simulation results show that compared with existing algorithms, AC-DSVM has slightly higher iterations and data traffic, but can converge to the centralized training results; 1-AC-DSVM not only has better convergence, but also has remarkable advantage in convergence speed and data traffic. -
計量
- 文章訪問數(shù): 1888
- HTML全文瀏覽量: 172
- PDF下載量: 524
- 被引次數(shù): 0