Front Matter
Front Matter
Editorial Board
David Hutchison
Lancaster University, UK
Takeo Kanade
Carnegie Mellon University, Pittsburgh, PA, USA
Josef Kittler
University of Surrey, Guildford, UK
Jon M. Kleinberg
Cornell University, Ithaca, NY, USA
Friedemann Mattern
ETH Zurich, Switzerland
John C. Mitchell
Stanford University, CA, USA
Moni Naor
Weizmann Institute of Science, Rehovot, Israel
Oscar Nierstrasz
University of Bern, Switzerland
C. Pandu Rangan
Indian Institute of Technology, Madras, India
Bernhard Steffen
University of Dortmund, Germany
Madhu Sudan
Massachusetts Institute of Technology, MA, USA
Demetri Terzopoulos
New York University, NY, USA
Doug Tygar
University of California, Berkeley, CA, USA
Moshe Y. Vardi
Rice University, Houston, TX, USA
Gerhard Weikum
Max-Planck Institute of Computer Science, Saarbruecken, Germany
Jun Wang Xiaofeng Liao Zhang Yi (Eds.)
Advances in
Neural Networks –
ISNN 2005
Second International Symposium on Neural Networks
Chongqing, China, May 30 - June 1, 2005
Proceedings, Part II
13
Volume Editors
Jun Wang
The Chinese University of Hong Kong
Department of Automation and Computer-Aided Engineering
Shatin, New Territories, Hong Kong
E-mail: [email protected]
Xiaofeng Liao
Chongqing University, School of Computer Science and Engineering
Chongqing, 400044, China
E-mail: [email protected]
Zhang Yi
University of Electronic Science and Technology of China
School of Computer Science and Engineering
Chengdu, Sichuan, China
E-mail: [email protected]
CR Subject Classification (1998): F.1, F.2, D.1, G.2, I.2, C.2, I.4-5, J.1-4
ISSN 0302-9743
ISBN-10 3-540-25913-9 Springer Berlin Heidelberg New York
ISBN-13 978-3-540-25913-8 Springer Berlin Heidelberg New York
This work is subject to copyright. All rights are reserved, whether the whole or part of the material is
concerned, specifically the rights of translation, reprinting, re-use of illustrations, recitation, broadcasting,
reproduction on microfilms or in any other way, and storage in data banks. Duplication of this publication
or parts thereof is permitted only under the provisions of the German Copyright Law of September 9, 1965,
in its current version, and permission for use must always be obtained from Springer. Violations are liable
to prosecution under the German Copyright Law.
Springer is a part of Springer Science+Business Media
springeronline.com
© Springer-Verlag Berlin Heidelberg 2005
Printed in Germany
Typesetting: Camera-ready by author, data conversion by Olgun Computergrafik
Printed on acid-free paper SPIN: 11427445 06/3142 543210
Preface
This book and its sister volumes constitute the proceedings of the 2nd International
Symposium on Neural Networks (ISNN 2005). ISNN 2005 was held in the beautiful
mountain city Chongqing by the upper Yangtze River in southwestern China during
May 30–June 1, 2005, as a sequel of ISNN 2004 successfully held in Dalian, China.
ISNN emerged as a leading conference on neural computation in the region with in-
creasing global recognition and impact. ISNN 2005 received 1425 submissions from
authors on five continents (Asia, Europe, North America, South America, and Ocea-
nia), 33 countries and regions (Mainland China, Hong Kong, Macao, Taiwan, South
Korea, Japan, Singapore, Thailand, India, Nepal, Iran, Qatar, United Arab Emirates,
Turkey, Lithuania, Hungary, Poland, Austria, Switzerland, Germany, France, Sweden,
Norway, Spain, Portugal, UK, USA, Canada, Venezuela, Brazil, Chile, Australia, and
New Zealand). Based on rigorous reviews, 483 high-quality papers were selected by
the Program Committee for presentation at ISNN 2005 and publication in the proceed-
ings, with an acceptance rate of less than 34%. In addition to the numerous contributed
papers, 10 distinguished scholars were invited to give plenary speeches and tutorials at
ISNN 2005.
The papers are organized into many topical sections under 20 coherent categories
(theoretical analysis, model design, learning methods, optimization methods, kernel
methods, component analysis, pattern analysis, signal processing, image processing,
financial analysis, system modeling, control systems, robotic systems, telecommunica-
tion networks, incidence detection, fault diagnosis, power systems, biomedical applica-
tions, and industrial applications, and other applications) spanning all major facets of
neural network research and applications. ISNN 2005 provided an international forum
for the participants to disseminate new research findings and discuss the state of the
art. It also created a pleasant opportunity for the participants to interact and exchange
information on emerging areas and future challenges of neural network research.
Many people made significant efforts to ensure the success of this event. The
ISNN 2005 organizers are grateful to Chongqing University, Southwest Normal Univer-
sity, Chongqing University of Posts and Telecommunications, Southwest Agricultural
University, and Chongqing Education College for their sponsorship; grateful to the Na-
tional Natural Science Foundation of China for the financial support; and to the Asia
Pacific Neural Network Assembly, the European Neural Network Society, the IEEE
Computational Intelligence Society, and the IEEE Circuits and Systems Society for
their technical co-sponsorship. The organizers would like to thank the members of the
Advisory Committee for their spiritual support, the members of the Program Committee
for reviewing the papers, and the members of the Publication Committee for checking
the papers. The organizers would particularly like to thank the publisher, Springer, for
their cooperation in publishing the proceedings as three volumes of the Lecture Notes
VI Preface
in Computer Science series. Last but not least, the organizers would like to thank all
the authors for contributing their papers to ISNN 2005. Their enthusiastic contributions
and participation were essential parts of the symposium with which the organizers were
proud to be involved.
ISNN 2005 was organized and sponsored by Chongqing University, Southwest Normal
University, Chongqing University of Posts and Telecommunications, Southwest Agri-
cultural University, and Chongqing Education College in cooperation with the Chinese
University of Hong Kong. It was technically cosponsored by the Asia Pacific Neural
Network Assembly, the European Neural Network Society, the IEEE Circuits and Sys-
tems Society, and the IEEE Computational Intelligence Society. It was financially sup-
ported by the National Natural Science Foundation of China and K.C. Wong Education
Foundation of Hong Kong.
General Chair
Jun Wang, Hong Kong, China
Organizing Chairs
Guoyin Wang, Chongqing, China Simon X. Yang, Guelph, Canada
Finance Chairs
Guangyuan Liu, Chongqing, China Qingyu Xiong, Chongqing, China
Yu Wu, Chongqing, China
Publication Co-chairs
Yi Chai, Chongqing, China Hujun Yin, Manchester, UK
Jianwei Zhang, Hamburg, Germany
Publicity Co-chairs
Min Han, Dalian, China Fengchun Tian, Chongqing, China
Registration Chairs
Yi Chai, Chongqing, China Shaojiang Deng, Chongqing, China
7 Pattern Analysis
Nighttime Pedestrian Detection with a Normal Camera Using SVM Classifier . . . 189
Qiming Tian, Hui Sun, Yupin Luo, and Dongcheng Hu
Neural Network Based Online Feature Selection for Vehicle Tracking . . . . . . . . . . 226
Tie Liu, Nanning Zheng, and Hong Cheng
A Mechanism for Extracting Optical Virtual Contours of Discrete Dot Stimuli . . . 321
Eunhwa Jeong and Keongho Hong
8 System Modeling
Nonlinear System Modeling Using Wavelet Networks . . . . . . . . . . . . . . . . . . . . . . 411
Seda Postalcioglu and Yasar Becerikli
Robust Modeling for Nonlinear Dynamic Systems
Using a Neurofuzzy Approach with Iterative Optimization . . . . . . . . . . . . . . . . . . . 418
Shirong Liu, Simon X. Yang, and Jinshou Yu
Modelling of Chaotic Systems with Recurrent Least Squares Support Vector
Machines Combined with Stationary Wavelet Transform . . . . . . . . . . . . . . . . . . . . 424
Jiancheng Sun, Lun Yu, Guang Yang, and Congde Lu
Adding Value to System Dynamics Modeling
by Using Artificial Neural Network . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 430
Changrui Ren, Yueting Chai, and Yi Liu
XVI Table of Contents, Part II
9 Signal Processing
Sequential Extraction Algorithm for BSS Without Error Accumulation . . . . . . . . . 466
Qiang Liu and Tianping Chen
A Learning Framework for Blind Source Separation
Using Generalized Eigenvalues . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 472
Hailin Liu and Yiuming Cheung
Post-nonlinear Blind Source Separation Using Neural Networks
with Sandwiched Structure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 478
Chunhou Zheng, Deshuang Huang, Zhanli Sun, and Li Shang
A Novel Approach for Underdetermined Blind Sources Separation
in Frequency Domain . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 484
Ming Xiao, Shengli Xie, and Yuli Fu
A Neural Network Blind Separation Method Based on Special Frequency Bins . . . 490
Anqing Zhang, Xuxiu Zhang, Tianshuang Qiu, and Xinhua Zhang
Application of Blind Source Separation to Time Delay Estimation
in Interference Environments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 496
Gaoming Huang, Luxi Yang, and Zhenya He
10 Image Processing
A New Scheme for Blind Decomposition of Mixed Pixels
Based on Non-negative Matrix Factorization . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 651
Hao Zhou, Bin Wang, and Liming Zhang
Representing Image Matrices: Eigenimages Versus Eigenvectors . . . . . . . . . . . . . . 659
Daoqiang Zhang, Songcan Chen, and Jun Liu
A SIMD Neural Network Processor for Image Processing . . . . . . . . . . . . . . . . . . . 665
Dongsun Kim, Hyunsik Kim, Hongsik Kim, Gunhee Han, and Duckjin Chung
MRF-MBNN: A Novel Neural Network Architecture for Image Processing . . . . . 673
Nian Cai, Jie Yang, Kuanghu Hu, and Haitao Xiong
Using LM Artificial Neural Networks and η-Closest-Pixels
for Impulsive Noise Suppression from Highly Corrupted Images . . . . . . . . . . . . . . 679
Pınar Çivicioğlu
Table of Contents, Part II XIX
Two Novel Image Filters Based on Canonical Piecewise Linear Networks . . . . . . . 685
Xusheng Sun, Shuning Wang, and Yuehong Wang
The SAR Image Compression with Projection Pursuit Neural Networks . . . . . . . . 730
Jian Ji, Zheng Tian, Wei Lin, and Yanwei Ju
Multifocus Image Fusion Using Spatial Features and Support Vector Machine . . . 753
Shutao Li and Yaonan Wang
Neural Network Based Fairing of Digitized Curves and Its Application . . . . . . . . . 854
Jianhua Hou, Zongying Ou, and Mingen Guo
11 Financial Analysis
Effectiveness of Different Target Coding Schemes on Networks
in Financial Engineering . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 873
Kidong Lee, Junghee Park, and Sangjae Lee
Select the Size of Training Set for Financial Forecasting with Neural Networks . . 879
Wei Huang, Yoshiteru Nakamori, Shouyang Wang, and Hui Zhang
Estimating the Yield Curve Using Calibrated Radial Basis Function Networks . . . 885
Gyusik Han, Daewon Lee, and Jaewook Lee
Fast ICA for Online Cashflow Analysis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 891
Shangming Yang and Zhang Yi
Impacts of Internet Stock News on Stock Markets Based on Neural Networks . . . . 897
Xun Liang
Coherent Risk Measure Using Feedfoward Neural Networks . . . . . . . . . . . . . . . . . 904
Hyoseok Lee, Jaewook Lee, Younggui Yoon, and Sooyoung Kim
Application of Evidence Theory and Neural Network in Warning System
of Financial Risk . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 910
Qingyu Xiong, Yinlin Huang, Shan Liang, Weiren Shi, Songsong Tan,
and Yinhua Lin
Novel Questionnaire-Responded Transaction Approach
with SVM for Credit Card Fraud Detection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 916
Rongchang Chen, Tungshou Chen, Yuer Chien, and Yuru Yang
Learning of Neural Networks for Fraud Detection
Based on a Partial Area Under Curve . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 922
Lae-Jeong Park
Customer Churning Prediction Using Support Vector Machines
in Online Auto Insurance Service . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 928
Yeon Hur and Sehun Lim
12 Control Systems
Sliding Mode Control for Cross Beam Simulation System via Neural Network . . . 150
Hongchao Zhao, Qingjiu Xu, Wenjin Gu, and Tingxue Xu
13 Robotic Systems
A Neural Network Based on Biological Vision Learning
and Its Application on Robot . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 198
Ying Gao, Xiaodan Lu, and Liming Zhang
Discrete-Time Adaptive Controller Design for Robotic Manipulators
via Neuro-fuzzy Dynamic Inversion . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 204
Fuchun Sun, Yuangang Tang, Lee Li, and Zhonghang Yin
General Underactuated Cooperating Manipulators
and Their Control by Neural Network . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 210
S. Murat Yeşiloğlu and Hakan Temeltaş
Intelligent Fuzzy Q-Learning Control of Humanoid Robots . . . . . . . . . . . . . . . . . . 216
Meng Joo Er and Yi Zhou
Performance Analysis of Neural Network-Based Uncalibrated
Hand-Eye Coordination . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 222
Jianbo Su
Formation Control for a Multiple Robotic System
Using Adaptive Neural Network . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 228
Yangmin Li and Xin Chen
Tip Tracking of a Flexible-Link Manipulator
with Radial Basis Function and Fuzzy System . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 234
Yuangang Tang, Fuchun Sun, and Zengqi Sun
XXVI Table of Contents, Part III
14 Telecommunication Networks
Application of Different Basis and Neural Network Turbo Decoding Algorithm
in Multicarrier Modulation System over Time-Variant Channels . . . . . . . . . . . . . . . 303
Yupeng Jia, Dongfeng Yuan, Haixia Zhang, and Xinying Gao
Blind Detection of Orthogonal Space-Time Block Coding
Based on ICA Schemes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 309
Ju Liu, Bo Gu, Hongji Xu, and Jianping Qiao
Table of Contents, Part III XXVII
Fuzzy Neural Network for VBR MPEG Video Traffic Prediction . . . . . . . . . . . . . . 403
Xiaoying Liu, Xiaodong Liu, Xiaokang Lin, and Qionghai Dai
15 Incidence Detection
Building an Intrusion Detection System
Based on Support Vector Machine and Genetic Algorithm . . . . . . . . . . . . . . . . . . . 409
Rongchang Chen, Jeanne Chen, Tungshou Chen, Chunhung Hsieh,
Teyu Chen, and Kaiyang Wu
Fusions of GA and SVM for Anomaly Detection in Intrusion Detection System . . 415
Dong Seong Kim, Ha-Nam Nguyen, Syng-Yup Ohn, and Jong Sou Park
Intrusion Detection Based on MLP Neural Networks and K-Means Algorithm . . . 434
Hongying Zheng, Lin Ni, and Di Xiao
Feature Selection and Intrusion Detection Using Hybrid Flexible Neural Tree . . . . 439
Yuehui Chen, Ajith Abraham, and Ju Yang
A Self-organizing Map Method for Optical Fiber Fault Detection and Location . . 470
Yi Chai, Wenzhou Dai, Maoyun Guo, Shangfu Li, and Zhifen Zhang
Table of Contents, Part III XXIX
16 Fault Diagnosis
Multi-class Probability SVM Fusion Using Fuzzy Integral for Fault Diagnosis . . . 501
Zhonghui Hu, Yunze Cai, Xing He, Ye Li, and Xiaoming Xu
A Rapid Response Intelligent Diagnosis Network
Using Radial Basis Function Network . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 508
Guangrui Wen, Liangsheng Qu, and Xining Zhang
An Integrated Approach to Fault Diagnosis
Based on Variable Precision Rough Set and Neural Networks . . . . . . . . . . . . . . . . . 514
Qingmin Zhou and Chenbo Yin
Hybrid PSO Based Wavelet Neural Networks for Intelligent Fault Diagnosis . . . . . 521
Qianjin Guo, Haibin Yu, and Aidong Xu
Global-Based Structure Damage Detection
Using LVQ Neural Network and Bispectrum Analysis . . . . . . . . . . . . . . . . . . . . . . 531
Guangming Dong, Jin Chen, Xuanyang Lei, Zuogui Ning,
Dongsheng Wang, and Xiongxiang Wang
Fault Detection for Plasma Etching Processes Using RBF Neural Networks . . . . . 538
Yaw-Jen Chang
Detecting Sensor Faults for a Chemical Reactor Rig
via Adaptive Neural Network Model . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 544
Ding-Li Yu and Dingwen Yu
Optimal Actuator Fault Detection via MLP Neural Network for PDFs . . . . . . . . . . 550
Lei Guo, Yumin Zhang, Chengliang Liu, Hong Wang, and Chunbo Feng
XXX Table of Contents, Part III
17 Power Systems
Ship Power Load Prediction Based on RST and RBF Neural Networks . . . . . . . . . 648
Jianmei Xiao, Tengfei Zhang, and Xihuai Wang
18 Biomedical Applications
19 Industrial Applications
Neural Grey Box Model for Power Estimation in Semiautogenous Mill . . . . . . . . . 833
Tito Valenzuela, Karina Carvajal, Gonzalo Acuña,
Max Chacón, and Luis Magne
20 Other Applications
Improving Accuracy of Perceptron Predictor Through Correlating Data Values
in SMT Processors . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 955
Liqiang He and Zhiyong Liu
A Genetic-Algorithm-Based Neural Network Approach
for Short-Term Traffic Flow Forecasting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 965
Mingzhe Liu, Ruili Wang, Jiansheng Wu, and Ray Kemp
Table of Contents, Part III XXXV
Self-organizing Map Analysis of Conceptual and Semantic Relations for Noun . . 977
Minghu Jiang, Chengqing Zong, and Beixing Deng
1 Theoretical Analysis
Exponential Stability Analysis of Neural Networks with Multiple Time Delays . . 142
Huaguang Zhang, Zhanshan Wang, and Derong Liu
Robust Stability for Delayed Neural Networks with Nonlinear Perturbation . . . . 203
Li Xie, Tianming Liu, Jilin Liu, Weikang Gu, and Stephen Wong
2 Model Design
3 Learning Methods
The Bounds on the Rate of Uniform Convergence for Learning Machine . . . . . . . 538
Bin Zou, Luoqing Li, and Jie Xu
A New Modified Hybrid Learning Algorithm for Feedforward Neural Networks . 572
Fei Han, Deshuang Huang, Yiuming Cheung, and Guangbin Huang
A Simple Rule Extraction Method Using a Compact RBF Neural Network . . . . . 682
Lipo Wang and Xiuju Fu
4 Optimization Methods
Transient Chaotic Discrete Neural Network for Flexible Job-Shop Scheduling . . 762
Xinli Xu, Qiu Guan, Wanliang Wang, and Shengyong Chen
Integration of Artificial Neural Networks and Genetic Algorithm
for Job-Shop Scheduling Problem . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 770
Fuqing Zhao, Yi Hong, Dongmei Yu, Xuhui Chen, and Yahong Yang
An Effective Algorithm Based on GENET Neural Network Model
for Job Shop Scheduling with Release Dates and Due Dates . . . . . . . . . . . . . . . . . 776
Xin Feng, Hofung Leung, and Lixin Tang
Fuzzy Due Dates Job Shop Scheduling Problem Based on Neural Network . . . . . 782
Yuan Xie, Jianying Xie, and Jie Li
Heuristic Combined Artificial Neural Networks to Schedule Hybrid Flow Shop
with Sequence Dependent Setup Times . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 788
Lixin Tang and Yanyan Zhang
A Neural Network Based Heuristic
for Resource-Constrained Project Scheduling . . . . . . . . . . . . . . . . . . . . . . . . . . . . 794
Yongyi Shou
Functional-Link Net Based Multiobjective Fuzzy Optimization . . . . . . . . . . . . . . 800
Ping Wang, Hongzhong Huang, Ming J. Zuo, Weidong Wu,
and Chunsheng Liu
Optimizing the Distributed Network Monitoring Model
with Bounded Bandwidth and Delay Constraints by Neural Networks . . . . . . . . . 805
Xianghui Liu, Jianping Yin, Zhiping Cai, Xicheng Lu, and Shiming Chen
Stochastic Nash Equilibrium with a Numerical Solution Method . . . . . . . . . . . . . 811
Jinwu Gao and Yankui Liu
5 Kernel Methods
Generalized Foley-Sammon Transform with Kernels . . . . . . . . . . . . . . . . . . . . . . 817
Zhenzhou Chen and Lei Li
Sparse Kernel Fisher Discriminant Analysis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 824
Hongjie Xing, Yujiu Yang, Yong Wang, and Baogang Hu
Scaling the Kernel Function to Improve Performance
of the Support Vector Machine . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 831
Peter Williams, Sheng Li, Jianfeng Feng, and Si Wu
Online Support Vector Machines with Vectors Sieving Method . . . . . . . . . . . . . . 837
Liangzhi Gan, Zonghai Sun, and Youxian Sun
Table of Contents, Part I XLVII
Least Squares Support Vector Machine Based on Continuous Wavelet Kernel . . . 843
Xiangjun Wen, Yunze Cai, and Xiaoming Xu
Multiple Parameter Selection for LS-SVM Using Smooth Leave-One-Out Error . 851
Liefeng Bo, Ling Wang, and Licheng Jiao
A Hierarchical and Parallel Method for Training Support Vector Machines . . . . . 881
Yimin Wen and Baoliang Lu
Task Decomposition Using Geometric Relation for Min-Max Modular SVMs . . . 887
Kaian Wang, Hai Zhao, and Baoliang Lu
6 Component Analysis