CORC  > 清华大学
可自适应分组的超球多任务学习算法
毛文涛 ; 王海成 ; 刘尚旺 ; MAO Wentao ; WANG Haicheng ; LIU Shangwang
2016-03-30 ; 2016-03-30
关键词多任务学习 极限学习机 自适应分组 混合0-1规划 多目标优化 multi-task learning Extreme Learning Machine(ELM) adaptive grouping mixed 0-1 programming multiobjective optimization TP181
其他题名Hyper-spherical multi-task learning algorithm with adaptive grouping
中文摘要针对现有回归多任务学习中各任务独立评估风险、缺乏统一约束条件的缺点,提出了一种具有自适应分组能力的超球多任务学习算法。该算法以极限学习机(ELM)为基础形式,首先引入超球损失函数对所有任务的风险进行统一评估,并采用迭代再权最小二乘法求解;其次,考虑到任务之间关联度存在差异,基于相关性强的任务其权重向量也较相似的假设,构建带分组结构的正则项,使得同组内的任务独立进行训练,最终将优化目标转为混合0-1规划问题,并采用多目标优化方法自动确定模型参数和最优分组结构。基于仿真数据和圆柱壳振动信号数据的测试结果表明,该算法可有效识别出任务中的分组结构,同时与现有算法相比,可明显提高回归模型的泛化能力。; To solve the problem in most of conventional multi-task learning algorithms which evaluate risk independently for single task and lack uniform constraint across all tasks, a new hyper-spherical multi-task learning algorithm with adaptive grouping was proposed in this paper. Based on Extreme Learning Machine( ELM) as basic framework, this algorithm introduced hyper-spherical loss function to evaluate the risks of all tasks uniformly, and got decision model via iterative reweighted least squares solution. Furthermore, considering the existence of relatedness between tasks, this paper also constructed regularizer with grouping structure based on the assumption that related tasks had more similar weight vector,which would make the tasks in same group be trained independently. Finally, the optimization object was transformed into a mixed 0-1 programming problem, and a multi-objective method was utilized to identify optimal grouping structure and get model parameters. The simulation results on toy data and cylindrical vibration signal data show that the proposed algorithm outperforms state-of-the-art methods in terms of generalization performance and the ability of identifying inner structure in tasks.
语种中文 ; 中文
内容类型期刊论文
源URL[http://ir.lib.tsinghua.edu.cn/ir/item.do?handle=123456789/143198]  
专题清华大学
推荐引用方式
GB/T 7714
毛文涛,王海成,刘尚旺,等. 可自适应分组的超球多任务学习算法[J],2016, 2016.
APA 毛文涛,王海成,刘尚旺,MAO Wentao,WANG Haicheng,&LIU Shangwang.(2016).可自适应分组的超球多任务学习算法..
MLA 毛文涛,et al."可自适应分组的超球多任务学习算法".(2016).
个性服务
查看访问统计
相关权益政策
暂无数据
收藏/分享
所有评论 (0)
暂无评论
 

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。


©版权所有 ©2017 CSpace - Powered by CSpace