A Second Look at the Performance
of Neural Networks for Keystroke Dynamics Using a Publicly Available Dataset
TEST IMPLEMENTATION GUIDE
The purpose of this
document is to guide the reader how to repeat the test that we have performed
in the study with the title “A Second Look at the Performance of Neural
Networks for Keystroke Dynamics Using a Publicly Available Dataset”. In the
following sections, we provide information on how to run the test procedure and
the files and functions included in the package.
The implementation environment
We made all our
implementation in MATLAB (version 7.6.0) mathematical programming environment.
The dataset
We used the dataset that
was collected by Killourhy and Maxion and is available at http://www.cs.cmu.edu/~keystroke/#sec2.
But we needed to make a slight modification. We have to erase the first column,
which is only informative, because it includes alphabetic characters, which are
hard to place in a matrix in MATLAB. The actual dataset that we used is
available via this link.
The source package
The source package is
available via this link. It is compressed in ZIP
format, so you need an archiver to extract it. The source package includes the
main files, distance measurement files and some utilities we used. In order to
measure equal error rates we used the receiver operating characteristics
implementation available at: http://svnext.it-sudparis.eu/svnview2-eph/ref_syst/Tools/PerformanceEvaluation/src/EER_DET_conf.m
with slight modification on it.
Running the test procedure
After downloading the
source package, to run the test procedure:
1. Open MATLAB environment.
2. Navigate to the source code directory
3. Run the script with the name “test_learners”
The script runs the
tests for all the training algorithms, makes analysis of variance and plots the
box diagram.
Contact
You can reach the
authors via e-mail for any questions:
bicakci (at)
metu.edu.tr
e159566 (at)
metu.edu.tr
A few notes:
Please note that this
implementation is part of our more general study on Keystroke Dynamics.
Therefore it may contain additional variables and functions not strictly
related with the mentioned study.
We are not highly
professional at MATLAB programming language. Therefore the implementation may
not be in the most elegant way. We are open to suggestions.