An Embedded Feature Selection Method for Imbalanced Data Classification

来源 :自动化学报(英文版) | 被引量 : 0次 | 上传用户:zqg860808
下载到本地 , 更方便阅读
声明 : 本文档内容版权归属内容提供方 , 如果您对本文有版权争议 , 可与客服联系进行内容授权或下架
论文部分内容阅读
Imbalanced data is one type of datasets that are frequently found in real-world applications,e.g.,fraud detection and cancer diagnosis.For this type of datasets,improving the accuracy to identify their minority class is a critically important issue.Feature selection is one method to address this issue.An effective feature selection method can choose a subset of features that favor in the accurate determination of the minority class.A decision tree is a classifier that can be built up by using different splitting criteria.Its advantage is the ease of detecting which feature is used as a splitting node.Thus,it is possible to use a decision tree splitting criterion as a feature selection method.In this paper,an embedded feature selection method using our proposed weighted Gini index (WGI) is proposed.Its comparison results with Chi2,F-statistic and Gini index feature selection methods show that F-statistic and Chi2 reach the best performance when only a few features are selected.As the number of selected features increases,our proposed method has the highest probability of achieving the best performance.The area under a receiver operating characteristic curve (ROC AUC) and F-measure are used as evaluation criteria.Experimental results with two datasets show that ROC AUC performance can be high,even if only a few features are selected and used,and only changes slightly as more and more features are selected.However,the performance of F-measure achieves excellent performance only if 20% or more of features are chosen.The results are helpful for practitioners to select a proper feature selection method when facing a practical problem.
其他文献
A microgrid is hard to control due to its reduced inertia and increased uncertainties.To overcome the challenges of microgrid control,advanced controllers need
集成了闪存的微控制器正开始涌入市场.2004年11月,NEC电子公司宣布了“全闪存微控制器”,这意味着NEC公司生产的所有微控制器都将集成闪存.从那时起,该公司一直在朝这个目标
资源型城市因资源丰富而高速发展,也因资源枯竭而发展滞后或者进行产业转型,资源型城市产业转型是目前为止仍然未解决的世界性难题。西方工业化国家的资源型城市产业转型历经了
脑脊液(CSF)中极少出现嗜碱性细胞。本文报告第一例嗜碱性细胞性脑膜炎。患者为3(1/2)岁女孩。淋巴结活检证实为非淋巴网细胞瘤,肝及骨髓均受累。经强的松、环磷酰胺及长春
期刊
Despite rapid developments in visual image-based road detection,robustly identifying road areas in visual images remains challenging due to issues like illumina
期刊
从2015年提出“数字化技术”概念起,西门子已经帮助各种类型、不同规模的工业企业实现数字化转型.其数字化企业解决方案能够帮助客户实现更灵活、高效的生产和更好的产品质量
期刊
近年来,急性非淋巴细胞白血病(ANLL)的完全缓解率(CR率)有所提高。Freireich等(1976)报告应用DAOP方案(59例)CR率是70%:Gale等(1977)应用TAD方案(28例)CR率是79%。国内自1973
2008年席卷全球的金融危机最早始于美国,2007年4月美国第二大次级抵押贷款机构向法院申请破产保护,金融危机的苗头在美国初现,2008年9月伴随着雷曼兄弟公司破产,危机迅速波及欧洲