Tensors for Data Processing. Theory, Methods, and Applications Yipeng Liu - Read the ebook online or download it to own the full content
Tensors for Data Processing. Theory, Methods, and Applications Yipeng Liu - Read the ebook online or download it to own the full content
https://ebookmass.com/product/tensors-for-data-processing-1st-edition-
yipeng-liu/
https://ebookmass.com/product/spatial-analysis-using-big-data-methods-
and-urban-applications-yamagata/
https://ebookmass.com/product/magnetic-communications-theory-and-
techniques-liu/
https://ebookmass.com/product/processing-for-android-create-mobile-
sensor-aware-and-xr-applications-using-processing-2nd-edition-colubri/
https://ebookmass.com/product/big-data-in-astronomy-scientific-data-
processing-for-advanced-radio-telescopes-1st-edition-linghe-kong-
editor/
https://ebookmass.com/product/oil-palm-biomass-for-composite-panels-
fundamentals-processing-and-applications-s-m-sapuan/
Edited by
Yipeng Liu
School of Information and Communication Engineering
University of Electronic Science and Technology
of China (UESTC)
Chengdu, China
Academic Press is an imprint of Elsevier
125 London Wall, London EC2Y 5AS, United Kingdom
525 B Street, Suite 1650, San Diego, CA 92101, United States
50 Hampshire Street, 5th Floor, Cambridge, MA 02139, United States
The Boulevard, Langford Lane, Kidlington, Oxford OX5 1GB, United Kingdom
Copyright © 2022 Elsevier Inc. All rights reserved.
ISBN: 978-0-12-824447-0
v
vi Contents
9.4.4
Compressing the convolutional layer via TT/TR
decompositions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 327
9.4.5 Compressing neural networks via transform-based
decomposition . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 330
9.5 Experiments and future directions . . . . . . . . . . . . . . . . . . . . . 333
9.5.1 Performance evaluations using the MNIST dataset . . . 333
9.5.2 Performance evaluations using the CIFAR10 dataset . 336
9.5.3 Future research directions . . . . . . . . . . . . . . . . . . . . . 337
References . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 338
CHAPTER 10 Coupled tensor decompositions for data fusion . . . . 341
Christos Chatzichristos, Simon Van Eyndhoven,
Eleftherios Kofidis, and Sabine Van Huffel
10.1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 341
10.2 What is data fusion? . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 342
10.2.1 Context and definition . . . . . . . . . . . . . . . . . . . . . . . . 342
10.2.2 Challenges of data fusion . . . . . . . . . . . . . . . . . . . . . . 343
10.2.3 Types of fusion and data fusion strategies . . . . . . . . . . 347
10.3 Decompositions in data fusion . . . . . . . . . . . . . . . . . . . . . . . . 348
10.3.1 Matrix decompositions and statistical models . . . . . . . 350
10.3.2 Tensor decompositions . . . . . . . . . . . . . . . . . . . . . . . 351
10.3.3 Coupled tensor decompositions . . . . . . . . . . . . . . . . . 352
10.4 Applications of tensor-based data fusion . . . . . . . . . . . . . . . . 355
10.4.1 Biomedical applications . . . . . . . . . . . . . . . . . . . . . . . 355
10.4.2 Image fusion . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 357
10.5 Fusion of EEG and fMRI: a case study . . . . . . . . . . . . . . . . . . 358
10.6 Data fusion demos . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 361
10.6.1 SDF demo – approximate coupling . . . . . . . . . . . . . . 361
10.7 Conclusion and prospects . . . . . . . . . . . . . . . . . . . . . . . . . . . . 363
Acknowledgments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 364
References . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 364
CHAPTER 11 Tensor methods for low-level vision . . . . . . . . . . . . . . 371
Tatsuya Yokota, Cesar F. Caiafa, and Qibin Zhao
11.1 Low-level vision and signal reconstruction . . . . . . . . . . . . . . . 371
11.1.1 Observation models . . . . . . . . . . . . . . . . . . . . . . . . . . 372
11.1.2 Inverse problems . . . . . . . . . . . . . . . . . . . . . . . . . . . . 374
11.2 Methods using raw tensor structure . . . . . . . . . . . . . . . . . . . . 378
11.2.1 Penalty-based tensor reconstruction . . . . . . . . . . . . . . 379
11.2.2 Tensor decomposition and reconstruction . . . . . . . . . . 393
11.3 Methods using tensorization . . . . . . . . . . . . . . . . . . . . . . . . . . 409
11.3.1 Higher-order tensorization . . . . . . . . . . . . . . . . . . . . . 411
11.3.2 Delay embedding/Hankelization . . . . . . . . . . . . . . . . 413
11.4 Examples of low-level vision applications . . . . . . . . . . . . . . . 415
Contents xi
Kim Batselier
Delft Center for Systems and Control, Delft University of Technology, Delft,
The Netherlands
Yingyue Bi
School of Information and Communication Engineering, University of Electronic
Science and Technology of China (UESTC), Chengdu, China
Jérémie Boulanger
CRIStAL, Université de Lille, Villeneuve d’Ascq, France
Rémy Boyer
CRIStAL, Université de Lille, Villeneuve d’Ascq, France
Cesar F. Caiafa
Instituto Argentino de Radioastronomía – CCT La Plata, CONICET / CIC-PBA /
UNLP, Villa Elisa, Argentina
RIKEN Center for Advanced Intelligence Project, Tokyo, Japan
Jocelyn Chanussot
LJK, CNRS, Grenoble INP, Inria, Université Grenoble, Alpes, Grenoble, France
Christos Chatzichristos
KU Leuven, Department of Electrical Engineering (ESAT), STADIUS Center for
Dynamical Systems, Signal Processing and Data Analytics, Leuven, Belgium
Cong Chen
Department of Electrical and Electronic Engineering, The University of Hong
Kong, Pokfulam Road, Hong Kong
Nadav Cohen
School of Computer Science, Hebrew University of Jerusalem, Jerusalem, Israel
Xudong Cui
School of Mathematics, Tianjin University, Tianjin, China
André L.F. de Almeida
Department of Teleinformatics Engineering, Federal University of Fortaleza,
Fortaleza, Brazil
Aybüke Erol
Circuits and Systems, Department of Microelectronics, Delft University of
Technology, Delft, The Netherlands
xiii
xiv List of contributors
Yiming Fang
Department of Computer Science, Columbia University, New York, NY,
United States
Gérard Favier
Laboratoire I3S, Université Côte d’Azur, CNRS, Sophia Antipolis, France
Borbála Hunyadi
Circuits and Systems, Department of Microelectronics, Delft University of
Technology, Delft, The Netherlands
Pratik Jawanpuria
Microsoft, Hyderabad, India
Tai-Xiang Jiang
School of Economic Information Engineering, Southwestern University of
Finance and Economics, Chengdu, Sichuan, China
Paris A. Karakasis
School of Electrical and Computer Engineering, Technical University of Crete,
Chania, Greece
Ouafae Karmouda
CRIStAL, Université de Lille, Villeneuve d’Ascq, France
Hiroyuki Kasai
Waseda University, Tokyo, Japan
Eleftherios Kofidis
Dept. of Statistics and Insurance Science, University of Piraeus, Piraeus, Greece
Christos Kolomvakis
School of Electrical and Computer Engineering, Technical University of Crete,
Chania, Greece
Yoav Levine
School of Computer Science, Hebrew University of Jerusalem, Jerusalem, Israel
Zechu Li
Department of Computer Science, Columbia University, New York, NY,
United States
Athanasios P. Liavas
School of Electrical and Computer Engineering, Technical University of Crete,
Chania, Greece
List of contributors xv
Zhouchen Lin
Key Lab. of Machine Perception, School of EECS, Peking University, Beijing,
China
Xiao-Yang Liu
Department of Computer Science and Engineering, Shanghai Jiao Tong
University, Shanghai, China
Department of Electrical Engineering, Columbia University, New York, NY,
United States
Yipeng Liu
School of Information and Communication Engineering, University of Electronic
Science and Technology of China (UESTC), Chengdu, China
Zhen Long
School of Information and Communication Engineering, University of Electronic
Science and Technology of China (UESTC), Chengdu, China
George Lourakis
Neurocom, S.A, Athens, Greece
Canyi Lu
Carnegie Mellon University, Pittsburgh, PA, United States
Liangfu Lu
School of Mathematics, Tianjin University, Tianjin, China
Yingcong Lu
School of Information and Communication Engineering, University of Electronic
Science and Technology of China (UESTC), Chengdu, China
George Lykoudis
Neurocom, S.A, Athens, Greece
Bamdev Mishra
Microsoft, Hyderabad, India
Michael K. Ng
Department of Mathematics, The University of Hong Kong, Pokfulam,
Hong Kong
Ioannis Marios Papagiannakos
School of Electrical and Computer Engineering, Technical University of Crete,
Chania, Greece
Bo Ren
Key Laboratory of Intelligent Perception and Image Understanding of Ministry of
Education of China, Xidian University, Xi’an, China
xvi List of contributors
Or Sharir
School of Computer Science, Hebrew University of Jerusalem, Jerusalem, Israel
Amnon Shashua
School of Computer Science, Hebrew University of Jerusalem, Jerusalem, Israel
Ioanna Siaminou
School of Electrical and Computer Engineering, Technical University of Crete,
Chania, Greece
Christos Tsalidis
Neurocom, S.A, Athens, Greece
Simon Van Eyndhoven
KU Leuven, Department of Electrical Engineering (ESAT), STADIUS Center for
Dynamical Systems, Signal Processing and Data Analytics, Leuven, Belgium
icometrix, Leuven, Belgium
Sabine Van Huffel
KU Leuven, Department of Electrical Engineering (ESAT), STADIUS Center for
Dynamical Systems, Signal Processing and Data Analytics, Leuven, Belgium
Anwar Walid
Nokia Bell Labs, Murray Hill, NJ, United States
Fei Wen
Department of Electronic Engineering, Shanghai Jiao Tong University, Shanghai,
China
Noam Wies
School of Computer Science, Hebrew University of Jerusalem, Jerusalem, Israel
Ngai Wong
Department of Electrical and Electronic Engineering, The University of Hong
Kong, Pokfulam Road, Hong Kong
Zebin Wu
School of Computer Science and Engineering, Nanjing University of Science
and Technology, Nanjing, China
Yang Xu
School of Computer Science and Engineering, Nanjing University of Science
and Technology, Nanjing, China
Liuqing Yang
Department of Computer Science, Columbia University, New York, NY,
United States
List of contributors xvii
Fei Ye
School of Computer Science and Engineering, Nanjing University of Science
and Technology, Nanjing, China
Tatsuya Yokota
Nagoya Institute of Technology, Aichi, Japan
RIKEN Center for Advanced Intelligence Project, Tokyo, Japan
Zhonghao Zhang
School of Information and Communication Engineering, University of Electronic
Science and Technology of China (UESTC), Chengdu, China
Qibin Zhao
RIKEN Center for Advanced Intelligence Project, Tokyo, Japan
Guangdong University of Technology, Guangzhou, China
Xi-Le Zhao
School of Mathematical Sciences/Research Center for Image and Vision
Computing, University of Electronic Science and Technology of China, Chengdu,
Sichuan, China
Pan Zhou
SEA AI Lab, Singapore, Singapore
Ce Zhu
School of Information and Communication Engineering, University of Electronic
Science and Technology of China (UESTC), Chengdu, China
Yassine Zniyed
Université de Toulon, Aix-Marseille Université, CNRS, LIS, Toulon, France
This page intentionally left blank
Preface
This book provides an overview of tensors for data processing, covering computing
theories, processing methods, and engineering applications. The tensor extensions
of a series of classical multidimensional data processing techniques are discussed
in this book. Many thanks go to all the contributors. Students can read this book to
get an overall understanding, researchers can update their knowledge on the recent
research advances in the field, and engineers can refer to implementations on various
applications.
The first chapter is an introduction to tensor decomposition. In the following, the
book provides variants of tensor decompositions with their efficient and effective so-
lutions, including some parallel algorithms, Riemannian algorithms, and generalized
thresholding algorithms. Some tensor-based machine learning methods are summa-
rized in detail, including tensor completion, tensor principal component analysis,
support tensor machine, tensor-based kernel learning, tensor-based deep learning, etc.
To demonstrate that tensors can effectively and systematically enhance performance
in practical engineering problems, this book gives implemental details of many ap-
plications, such as signal recovery, recommender systems, climate forecasting, image
clustering, image classification, network compression, data fusion, image enhance-
ment, neuroimaging, and remote sensing.
I sincerely hope this book can serve to introduce tensors to more data scientists
and engineers. As a natural representation of multidimensional data, tensors can be
used to substantially avoid the information loss in matrix representations of multiway
data, and tensor operators can model more connections than their matrix counterparts.
The related advances in applied mathematics allow us to move from matrices to ten-
sors for data processing. This book is promising to motivate novel tensor theories and
new data processing methods, and to stimulate the development of a wide range of
practical applications.
Yipeng Liu
Chengdu, China
Aug. 10, 2021
xix
Visit https://ebookmass.com today to explore
a vast collection of ebooks across various
genres, available in popular formats like
PDF, EPUB, and MOBI, fully compatible with
all devices. Enjoy a seamless reading
experience and effortlessly download high-
quality materials in just a few simple steps.
Plus, don’t miss out on exciting offers that
let you access a wealth of knowledge at the
best prices!
Other documents randomly have
different content
you see a driver with a yellow plaid cap. We are
relying on you not to have anybody with you, or in
watching,—if you do, we shall know it, and the
whole deal is off. You will not hear from us again. If
you attempt anything,—anything at all but the most
perfect good faith and honesty in your course, you
will be more than sorry. In a word, you will then
bring about the sudden death of the man you love.
There is no more to be said on that score. Get into
the taxi and when it stops, near another taxi, make
a quick change. Have the money with you in a
small compact parcel. The second taxi will take you
along a certain road. When it meets a certain car, it
will slow down and you will hand the parcel to the
man who leans out of that car for it. That is all.
Good-bye.
She was uncertain what to do. Her impulse was to lay 208
the whole matter before Whiting or Coleman Coe, and
follow their advice.
The more she thought it over, the more she was inclined
to manage the whole affair alone. She could do it,—and
she was not afraid. It was all to be done in broad
daylight, there was no danger if she herself acted in
good faith. And if she brought any one else into it, there
was grave danger, not only to herself but to Kimball.
She looked curiously at the card that had come in the
letter.
She would get Kimball back! That was all she knew or
cared about!
Elsie kept her eyes open and her mind clear. She grew
impatient for the end of her trip, but she preserved her
poise and her balance.
“Here’s the car, miss,” the taxi driver said suddenly, and
she saw a red roadster approaching swiftly.
From the red car a man leaned out. He had a small 212
mask on that concealed most of his features, but Elsie
caught a gleam of many gold filled teeth in his lower
jaw. Into his outstretched hand, conveniently near, Elsie
placed the packet, from her hand-bag. She felt a shock
of disappointment that she did not receive Kimball in
return, right then and there, but she had no time to
speak. In a flash, the driver on the cab she was in,
sprang from his seat, jumped into the red car, and like a
streak the roadster disappeared.
The benignant looking lady was not all that could be 213
hoped for in the way of cordiality, but when Elsie
explained that the taxicab had refused to go and the
chauffeur had gone for help and that she was in great
haste to get to the city the lady agreed to take her.
Remarking, however, that for a girl who wanted to get
to New York in haste, her cab was turned astonishingly
in the opposite direction!
Alone again, Elsie flew for a taxicab and went straight 214
home. She glanced at the mail, arrived since her
departure, but was not surprised to find no letter in the
writing of her new correspondent. He had said he would
not write again, and she did not think he would.
216
CHAPTER XIV
AN EASY MARK
And, yet, she didn’t blame herself utterly, for she had
felt so sure that only by following instructions implicitly,
could she accomplish her end.
Still, he might come home yet; the day might bring him
or news of him.
By the time Coe came in the evening, Elsie had decided 217
to tell him the whole story, assuming that since the
money was paid, it was now no breach of trust.
Coley Coe stared at her as she unfolded the surprising
tale.
“You see the first taxicab was a real one. They engaged 218
the driver to do just what he did do. The second was a
fake one,—their own car and one of their own men.
Then when the time came, the car was abandoned,—
and so were you. They knew you’d get a lift back to the
city,—and they didn’t care whether you did or not! In
one way, I can’t blame you, Miss Powell, for I see you
didn’t dare tell me. Yet, you might have known they’d
not release their prisoner.”
“Such as what?”
“And you don’t think they mean to give him back after I
did my part?”
“Well?”
“Well, that proves they were written by some one who
never could by the remotest chance be suspected.
Somebody so outside suspicion that they’re willing to
send his regular handwriting.”
“Proving?”
“It’s a big thing to think of, Miss Powell! You can’t get
out of that obligation, you know. And while the receipt
of your aunt’s money would make it easy for you to pay
it, yet if you are not married by your birthday—”
“What?” Elsie’s face went white, and her eyes were 223
filled with horror at the sudden realization of the truth
of Coe’s statement.
“Oh, come now, don’t talk about killing. And that would
be a cowardly thing, for your people would be hounded,
—whether legally or not.”
“No; the taxi driver, the second one was a decent 224
looking man, of medium build, with a grave, rather
stern face. He was dark, I think,—with brownish hair. I
saw his back mostly, and didn’t notice his face at all. I
thought of him merely as a means to an end, and when
the red car came along, I thought only of giving up the
money. And the man in the red car wore a mask,—just
a small one, but it covered his eyes and nose and came
down partly over his mouth. But I noticed several gold
filled teeth in the lower jaw. Unusually bright they
were.”
“Why?”
“Why, don’t you see it! The arch villain,—I feel sure
there’s one principal and two or more subordinates,—
the chief devil, we’ll say, has a means of access to that
room. It was he who was responsible for all the
Poltergeist performances, he who pulled bedclothes off
Webb, and later, off yours truly,—he who made a ghost
appear,—”
“How?”
“Oh, lots of ways for that. I’ll tell you some other time. I 225
must skittle, now. Go to sleep and dream of Webb’s
return. But,—and this is very serious, Miss Powell,—if I
don’t succeed in getting him back,—if the villains are
scared off or any such matter, you must make up your
mind to marry somebody else. For I should hate to see
you in the clutches of that wretch of a Loan Broker!
You’ve no idea what it would mean!”
But rest, she did not; in fact she was such a victim of
unrest, worry and anguish, that morning found her in a
high fever and grave danger of nervous collapse.
“I’m not really ill, you know,” she said, and the nurse
agreed.
Thus, it chanced, now and then, one chair or the other 228
forged ahead, by reason of the traffic or danger of a
collision.
And one time, when Elsie’s chair was pushed ahead of
Miss Loring’s it did not fall back beside the nurse’s chair
as promptly as usual.
Elsie looked around for the nurse, but failed to see her.
“No, ma’am,” smiled the big man who pushed her, and
she settled back into her seat, thinking deeply.
She flew to the door, but she could not open it. She was 230
trapped,—and she had walked into a trap, unresistingly,
in broad daylight!
She was alone in the room for what seemed hours but
was not more than twenty minutes when the door was
flung open and in rushed,—not the man with the gold
teeth, whom she had rather expected to see,—but Fenn
Whiting.
“Why, I met Miss Loring and she said she had lost you,
and I chased madly about asking everybody questions,
and I finally traced you here! Who brought you? What
does it mean?”
“Yes, I can talk! I’m all right,” and Elsie stopped crying; 231
“I’m only mad! Why, Fenn, somebody trapped me into
this room!”
“Just that!” and Elsie told how the chair-pusher had led
her to the house, and urged her up in the elevator and
into the room, and then had locked her in.
“Why, the door isn’t locked,” Whiting exclaimed, “I
walked right in!”
Elsie bit her lip. She had promised Coe to reveal no 232
slightest word regarding her experiences with the
kidnappers of Webb, and now she had given a hint!
233
CHAPTER XV
IN UNIFORM
“No,” and Fenn strode across the room, locked the door
and pocketed the key. “No, you shall not go until I have
your promise,—and an unbreakable one this time. In
fact, Elsie, I want you to marry me right now and here.
I’ll arrange all details,—I have arranged most of them.
Just consent, dearest, and then you’ll be mine to love
and care for and to protect from those villains you
speak of.”
“No, I’m not, but you’ll be, if you keep up this nervous
tension you’re living under. Be guided by me, Elsie,
darling; marry me out of hand, and we’ll go away to
some beautiful, quiet spot, and all care shall be lifted
from your dear shoulders.”
“It will seem just as lovely when I’m with you. Let me
try, dear; give me a chance to make good! I’m not over
conceited, but I’m sure I can make you happy. If you
choose to marry me in time to get the money, we can
do wonderful things! Take wonderful trips, see beautiful
places,—but beautiful to me, only because you are with
me!”
There was a deep thrill in his tones that moved Elsie by 236
its genuine passion and devotion. She looked into his
grey eyes,—their steely glint softened now, and read
there a great unconquerable love for herself. Should she
cast this aside for a chance, an uncertainty? She must
get the money for her people,—she had decided on
that,—and she felt it her duty to sacrifice herself for
them. But, when she tried to say yes to Whiting’s pleas,
the word would not come.
“Hush, Elsie, don’t sob so. Listen, dear; the time for that
sort of thing is past. There are only seven days now to
your birthday; you can’t wait till the last minute to
decide. And if Webb had been coming back he would
have been here before this. He will never come back,—
I’m sure of it!”
“No! I’ll not do that! You’ve played fast and loose with
me long enough! I’ve stood for it because I love you so,
and I want you so. But I won’t be that sort of a cat’s-
paw! You’ll say right now you’ll marry me, or I’ll drop
out of it all, and you can marry anybody you choose to
get your precious legacy!”
“These are my rooms. You are locked in here with me, 238
alone. How long must you stay here before you decide
it’s wiser to be my wife than—”
A little bewildered the girl then ran her car on down, 241
without stop.
She went straight back to the hotel where she and the
nurse had been staying. Here the desk clerk told her
that the nurse had packed up everything and had
returned to New York.
All she had carried with her, in her handbag, she had
given to the girl in the elevator, thinking she would go
back to the hotel where she had her check book.
But that was gone with her trunks. Even the unpaid
cabman was already clamouring for his fare!
“Why did Miss Loring say she left?” she asked the clerk.
“She said you had sent her word you had already gone 243
home, and she was to follow at once,” he returned,
glancing at her severely. “She packed quickly and
caught the first train she could get.”
“She paid the bill?”
But the desk clerk didn’t seem to care for this plan at
all. He paid the cabman, who was becoming a nuisance,
but he declined to advance money to such an erratic
person as the lady before him seemed to be.
But she was at her wits’ end. It was after four in the
afternoon and a hotel who wouldn’t lend a few dollars,
would doubtless object to her re-registering there, with
no money, and in most eccentric costume.
Our website is not just a platform for buying books, but a bridge
connecting readers to the timeless values of culture and wisdom. With
an elegant, user-friendly interface and an intelligent search system,
we are committed to providing a quick and convenient shopping
experience. Additionally, our special promotions and home delivery
services ensure that you save time and fully enjoy the joy of reading.
ebookmass.com