ESANN 2021 - Proceedings

Inhoud

---

Federated Learning – Methods, Applications and Beyond

Federated Learning - Methods, Applications and beyond

M. Heusinger, C. Raab, F. Rossi, F.-M. Schleif ...................................................... p. 1

Privacy-Preserving Kernel Computation For Vertically Partitioned Data

M. Polato, A. Gallinaro, F. Aiolli .......................................................................... p. 11

Decay Momentum for Improving Federated Learning

M. Fernandes, C. Silva, J. Arrais, A. Cardoso, B. Ribeiro .................................... p. 17

Continual Learning at the Edge: Real-Time Training on Smartphone Devices

L. Pellegrini, V. Lomonaco, G. Graffieti, D. Maltoni ............................................ p. 23

Federated Learning Vector Quantization

J. Brinkrolf, B. Hammer ........................................................................................ p. 29

Evaluation metrics, and concept drift

Judging competitions and benchmarks: a candidate election approach

A. Pavao, I. Guyon, M. Vaccaro ............................................................................ p. 35

Concept Drift Segmentation via Kolmogorov-Trees

F. Hinder, B. Hammer ........................................................................................... p. 41

Investigating Intensity and Transversal Drift in Hyperspectral Imaging Data

V. Vaquet, P. Menz, U. Seiffert, B. Hammer .......................................................... p. 47

Predicting employee attrition with a more effective use of historical events

A.-R. Korichi, H. Kheddouci, D. West ................................................................... p. 53

Enhash: A Fast Streaming Algorithm For Concept Drift Detection

A. Jindal, P. Gupta, D. Sengupta, J. Jayadeva ...................................................... p. 59

Lifelong Learning from Event-based Data

V. Gryshchuk, C. Weber, C. K. Loo, S. Wermter ................................................... p. 65

Sample efficient localization and stage prediction with autoencoders

S. Hoch, S. Lange, J. Keuper ................................................................................. p. 71

Transfer learning in Bayesian optimization for the calibration of a beam line in proton therapy

V. Hamaide, F. Glineur ......................................................................................... p. 77

Domain Adversarial Tangent Learning Towards Interpretable Domain Adaptation

C. Raab, S. Saralajew, F.-M. Schleif ..................................................................... p. 83

Deep learning for graphs

Deep learning for graphs

D. Bacciu, F. M. Bianchi, B. Paassen, C. Alippi ................................................... p. 89

Dynamic Graph Echo State Networks

D. Tortorella, A. Micheli ....................................................................................... p. 99

Improving Graph Variational Autoencoders with Multi-Hop Simple Convolutions

E. J. Freitas do Nascimento, A. Souza, D. Mesquita ........................................... p. 105

Application of Graph Convolutions in a Lightweight Model for Skeletal Human Motion Forecasting

L. Hermes, B. Hammer, M. Schilling ................................................................... p. 111

Tangent Graph Convolutional Network

L. Pasa, N. Navarin, A. Sperduti ......................................................................... p. 117

Transformers for Molecular Graph Generation

T. Cofala, O. Kramer ........................................................................................... p. 123

Inductive learning for product assortment graph completion

M. Trincavelli, H. Dukic, G. Deligiorgis, P. Sepe, D. Bacciu ............................. p. 129

Deep learning and image processing

Evolutionary Deep Multi-Task Learning

O. Kramer ............................................................................................................ p. 135

Semantic Prediction: Which One Should Come First, Recognition or Prediction?

H. Farazi, J. Nogga, S. Behnke ............................................................................ p. 141

Deep Graph Convolutional Networks for Wind Speed Prediction

T. Stańczyk, S. Mehrkanoon ................................................................................. p. 147

Benign overfitting of fully connected Deep Nets:A Sobolev space viewpoint

S. Chretien, E. Caron-Parte ................................................................................ p. 153

Correlated Weights Neural Layer with external control

S. Golak ............................................................................................................... p. 159

Comprehensive Analysis of the Screening of COVID-19 Approaches in Chest X-ray Images from Portable Devices

D. Iglesias, J. de Moura, J. Novo, M. Ortega ...................................................... p. 165

Data-Efficient Training of High-Resolution Images in Medical Domain

S. Kunde, A. Pandit, K. Mahajan, M. Sharma, R. Singhal, L. Vig ....................... p. 171

CAS-Net: A Novel Coronary Artery Segmentation Neural Network

R. Hamdi, A. Kerkeni, M. H. Bedoui, A. Ben Abdallah ....................................... p. 177

Improved and Generalized Vine Line Detection on Aerial Images Using Asymmetrical Neural Networks and ML Subclassifiers

J. Treboux, R. Ingold, D. Genoud ........................................................................ p. 189

Cross-modal verification for 3D object detection

H. ZHANG, A. Rogozan, A. Bensrhair ................................................................. p. 195

Fourier-based Video Prediction through Relational Object Motion

M. Mosbach, S. Behnke........................................................................................ p. 201

Object Detection on Thermal Images: Performance of YOLOv4 Trained on Small Datasets

M. Chaverot, M. Carré, M. Jourlin, A. Bensrhair, R. Grisel ............................... p. 207

Temperature as a Regularizer for Semantic Segmentation

C. Kim, W.-S. Lee ................................................................................................ p. 213

Machine Learning for Measuring and Analyzing Online Social Communications

Machine Learning for Measuring and Analyzing Online Social Communications

C. Bronk, A. Lendasse, P. Lindner, D. S. Wallach, B. Hammer .......................... p. 219

Toxicity Detection in Online Comments with Limited Data: A Comparative Analysis

M. Lübbering, M. Pielka, K. Das, M. Gebauer, R. Ramamurthy, C. Bauckhage,

R. Sifa .................................................................................................................. p. 227

Emotional Intensity Level Analysis of Speech Emotional Intensity Estimation

M. Kawase, M. Nakayama ................................................................................... p. 233

Natural language processing

Weightless Neural Networks for text classification using tf-idf

A. Sorgente, M. De Gregorio, G. Vettigli ............................................................ p. 239

End-to-end Keyword Spotting using Xception-1d

I. Vallés-Pérez, J. Gómez-Sanchis, M. Martinez-Sober, J. Vila-Francés,

A.-J. Serrano López, E. Soria Olivas ................................................................... p. 245

Unsupervised Word Representations Learning with Bilinear Convolutional Network on Characters

T. Luka, L. Soulier, D. Picard .............................................................................. p. 251

TSR-DSAW: Table Structure Recognition via Deep Spatial Association of Words

A. Jain, S. Paliwal, M. Sharma, L. Vig ................................................................ p. 257

Sparse mixture of von Mises-Fisher distribution

F. Barbaro, F. Rossi ............................................................................................ p. 263

Towards Robust Auxiliary Tasks for Language Adaptation

G. Rocha, H. Lopes Cardoso ............................................................................... p. 269

Recurrent learning, and reinforcement learning

Continual Learning with Echo State Networks

A. Cossu, D. Bacciu, A. Carta, C. Gallicchio, V. Lomonaco ............................... p. 275

RecLVQ: Recurrent Learning Vector Quantization

J. Ravichandran, T. Villmann, M. Kaden ............................................................ p. 281

Improvement on Generative Adversarial Network for Targeted Drug Design

B. P. Santos, M. Abbasi, T. Pereira, B. Ribeiro, J. Arrais ................................... p. 287

Reservoir Computing by Discretizing ODEs

C. Gallicchio ........................................................................................................ p. 293

Constraint optimization for Echo State Networks applied to satellite image forecasting

J. J. Steil, Y. Lieder .............................................................................................. p. 299

Deep Echo State Networks for Functional Ambulation Categories Estimation

L. Pedrelli, E. Bergamini, M. Tramontano, G. Vannozzi, A. Mannini ................. p. 305

An Algorithmic Approach to Establish a Lower Bound for the Size of Semiring Neural Networks

M. Böhm, T. Schmid ............................................................................................. p. 311

Echo-state neural networks forecasting steelworks off-gases for their dispatching in CH4 and CH3OH syntheses reactors

I. Matino, S. Dettori, V. Colla, K. Rechberger, N. Kieberger .............................. p. 317

Deep Learning Model for Context-Dependent Survival Analysis

R. Langhendries, J. Lacaille ................................................................................ p. 323

Behavior Constraining in Weight Space for Offline Reinforcement Learning

P. Swazinna, S. Udluft, D. Hein, T. Runkler ........................................................ p. 329

Multiobjective Reinforcement Learning in Optimized Drug Design

M. Abbasi, T. Pereira, B. P. Santos, B. Ribeiro, J. Arrais ................................... p. 335

Density Independent Self-organized Support for Q-Value Function Interpolation in Reinforcement Learning

A. Calba, A. Dutech, J. Fix .................................................................................. p. 341

Complex Data: Learning Trustworthily, Automatically, and with Guarantees

Complex Data: Learning Trustworthily, Automatically, and with Guarantees

L. Oneto, N. Navarin, B. Biggio, F. Errica, A. Micheli, F. Scarselli,

M. Bianchini, A. Sperduti .................................................................................... p. 347

The Benefits of Adversarial Defence in Generalisation

L. Oneto, S. Ridella, D. Anguita .......................................................................... p. 357

Slope: A First-order Approach for Measuring Gradient Obfuscation

M. Pintor, L. Demetrio, G. Manca, B. Biggio, F. Roli ......................................... p. 363

Robust Malware Classification via Deep Graph Networks on Call Graph Topologies

F. Errica, G. Iadarola, F. Martinelli, F. Mercaldo, A. Micheli ........................... p. 369

Boundary-Based Fairness Constraints in Decision Trees and Random Forests

G. Nanfack, V. Delchevalerie, B. Frénay ............................................................ p. 375

Model selection

NNBMSS: a Novel and Fast Method for Model Structure Selection

A. Lendasse, K. Khan, E. Ratner ........................................................................ p. 381

Pruning Neural Networks with Supermasks

V. Rolfs, M. Kerzel, S. Wermter ........................................................................... p. 387

Compact Neural Architecture Search for Local Climate Zones Classification

R. Traore, A. Camero, X. Zhu .............................................................................. p. 393

Unsupervised learning

Anomalous Cluster Detection in Large Networks with Diffusion-Percolation Testing

C. Larroche, J. Mazel, S. Clémençon .................................................................. p. 399

Calliope - A Polyphonic Music Transformer

A. Valenti, S. Berti, D. Bacciu ............................................................................. p. 405

Dynamic clustering and modeling of temporal data subject to common regressive effects

L. Bonfils, A. Same, L. Oukhellou ........................................................................ p. 411

Stochastic quartet approach for fast multidimensional scaling

P. Lambert, C. de Bodt, M. Verleysen, J. Lee ...................................................... p. 417

Federated Learning approach for SpectralClustering

E. Hernández-Pereira, O. Fontenla-Romero, B. Guijarro-Berdiñas,

B. Pérez Sánchez .................................................................................................. p. 423

Validating static call graph-based malware signatures using community detection methods

A. Mester, Z. Bodó ............................................................................................... p. 429

Impact of data subsamplings in Fast Multi-Scale Neighbor Embedding.

P. Lambert, J. Lee, M. Verleysen, C. de Bodt ...................................................... p. 435

Semi-supervised learning with Bayesian Confidence Propagation Neural Network

N. B. Ravichandran, A. Lansner, P. Herman ....................................................... p. 441

Combining Attack Success Rate and DetectionRate for effective Universal Adversarial Attacks

V. Poggioni, A. E. Baia, A. Milani ....................................................................... p. 447µ

Machine learning and data mining for urban mobility intelligence

Machine learning and data mining for urban mobility intelligence

E. Come, L. Oukhellou, A. Same, L. Sun.............................................................. p. 453

Multivariate Time Series Multi-Coclustering. Application to Advanced Driving Assistance System Validation

E. Goffinet, M. Lebbah, H. Azzag, L. Giraldi, A. Coutant ................................... p. 463

Unsupervised Real-time Anomaly Detection for Multivariate Mobile Phone Traffic Series

E. Akopyan, A. Furno, N.-E. El Faouzi, E. Gaume .............................................. p. 469

In-Station Train Movements Prediction: from Shallow to Deep Multi Scale Models

G. Boleto, L. Oneto, M. Cardellini, M. Maratea, M. Vallati, R. Canepa,

D. Anguita ............................................................................................................ p. 475

Deep Neural Networks for Classification of Riding Patterns: with a focus on explainability

M. leyli abadi, A. boubezoul ................................................................................ p. 481

A Lightweight Approach for Origin-Destination Matrix Anonymization

B. Matet, E. Come, A. Furno, L. Bonnetain, L. Oukhellou, N.-E. El Faouzi ....... p. 487

Supervised learning

Supervised learning of convex piecewise linear approximations of optimization problems

L. Duchesne, Q. Louveaux, L. Wehenkel ............................................................. p. 493

Real-time On-edge Classification: an Application to Domestic Acoustic Event Recognition

L. Vuegen, P. Karsmakers ................................................................................... p. 499

Functional Gradient Descent for n-Tuple Regression

R. Katopodis, P. Lima, F. França ........................................................................ p. 505

Estimating uncertainty in radiation oncology dose prediction with dropout and bootstrap in U-Net models

J. Lee, A. Vanginderdeuren, M. Huet-Dastarac, A. M. Barragan Montero ........ p. 511

Hierarchical Planning in Multilayered State-Action Networks

M. Brucklacher, H. A. Mallot, T. Baumann ......................................................... p. 517

Distribution Preserving Multiple Hypotheses Prediction for Uncertainty Modeling

T. Leemann, M. Sackmann, J. Thielecke, U. Hofmann ........................................ p. 523

Orientation Adaptive Minimal Learning Machine for Directions of Atomic Forces

A. Pihlajamäki, J. Linja, J. Hämäläinen, P. Nieminen, S. Malola,

T. Kärkkäinen, H. Häkkinen ................................................................................ p. 529

Estimating Formulas for Model Performance Under Noisy Labels Using Symbolic Regression

F. S. Khoo, D. Zhu, M. A. Hedderich, D. Klakow ................................................ p. 535

A Multi-ELM Model for Incomplete Data

B. Chi, A. Lendasse, E. Ratner, R. Hu ................................................................. p. 541

Interpretable Models in Machine Learning and Explainable Artificial Intelligence

The Coming of Age of Interpretable and Explainable Machine Learning Models

P. Lisboa, S. Saralajew, A. Vellido, T. Villmann ................................................. p. 547

AGLVQ - Making Generalized Vector Quantization Algorithms Aware of Context

T. Graeber, S. Vetter, S. Saralajew, M. Unterreiner, D. Schramm ...................... p. 557

A Parameterless t-SNE for Faithful Cluster Embeddings from Prototype-based Learning and CONN Similarity

J. Taylor, E. Merényi ........................................................................................... p. 563

Handling Correlations in Random Forests: which Impacts on Variable Importance and Model Interpretability?

M. Chavent, J. Lacaille, A. Mourer, M. Olteanu ................................................. p. 569

The partial response SVM

B. Walters, S. Ortega-Martorell, I. Olier, P. Lisboa ........................................... p. 575

The LVQ-based Counter Propagation Network -- an Interpretable Information Bottleneck Approach

M. Kaden, R. Schubert, M. Mohannazadeh Bakhtiari, L. Schwarz,

T. Villmann .......................................................................................................... p. 581

Geometric Probing of Word Vectors

M. Babazhanova, M. Tezekbayev, Z. Assylbekov .................................................p. 587

Context-specific sampling method for contextual explanations

M. Madhikermi, A. Malhi, K. Främling ............................................................... p. 593

SmoothLRP: Smoothing LRP by Averaging over Stochastic Input Variations

A. Raulf, S. Däubener, B. Hack, A. Mosig, A. Fischer ......................................... p. 599

A Baseline for Shapley Values in MLPs: from Missingness to Neutrality

C. Izzo, A. Lipani, R. Okhrati, F. Medda ............................................................. p. 605

Time series and signal processing

Quantifying Resemblance of Synthetic Medical Time-Series

K. Bhanot, S. Dash, J. Pedersen, I. Guyon, K. Bennett ....................................... p. 611

Differentially Private Time Series Generation

H. Arnout, J. Bronner, T. Runkler ....................................................................... p. 617

Fusion of estimations from two modalities using the Viterbi's algorithm: application to fetal heart rate monitoring

R. Souriau, J. Fontecave-Jallon, B. Rivet ............................................................ p. 623

Convolutional Neural Network Architecture for Classification of Aircraft Engines Flight Time Series

D. Bay, C. Bisot ................................................................................................... p. 629

Multi-perspective embedding for non-metric time series classification

M. Münch, S. Heilig, F.-M. Schleif ...................................................................... p. 635

IF: Iterative Fractional Optimization

S. Chatterjee, S. Das, S. Pequito .......................................................................... p. 641

Classification

A Relational Model for One-Shot Classification

A. Polis, A. Ilin..................................................................................................... p. 647

Instance-Based Multi-Label Classification via Multi-Target Distance Regression

J. Hämäläinen, P. Nieminen, T. Kärkkäinen ....................................................... p. 653

A bag of nodes primer on weightless graph classification

R. Barbosa, D. Carvalho, P. Lima, F. França ..................................................... p. 659

Gradient representations in ReLU networks as similarity functions

B. Daróczy, D. Rácz ............................................................................................. p. 665

Author index ................................................................................................ p. 671

Committees ................................................................................................... p. 675

---