The Bridge - Issue 2, 2018 - 14

Feature
Figure 3: The credit-card dataset is not separable when
considering age, pay0, and pay1. A three-hidden node
network trained on two inputs from the credit card
dataset. Red X's indicate clients who defaulted and black
dots those who did not. The red values are slightly offset
to avoid overlap. The decision surface is shown in blue.
The side to the right of decision surface represents clients
predicted to default (the side with higher pay0 values).
Two experiments are shown with different inputs: (a)
pay0 vs pay2 and (b) age vs pay0

model accuracy with a large dataset but decreased
the accuracy with a considerably smaller dataset.

(a)

(a)

(b)

(b)

Evaluating the optimum dropout rate
of different datasets
Figure 4(a) shows the accuracy of a model trained on
the credit card default dataset that contains 18,500
samples. Figure 4(b) corresponds to a model trained
on a breast cancer dataset that contains 450 samples.
Both of the models were trained using two hidden
layers consisting of 100 nodes and 50 nodes. As can
be seen, an increased dropout rate improved the

THE BRIDGE

Figure 4: Impact of dropout rate on a large and a small
dataset (a) The credit card dataset containing 18,500
samples in the training set (b) The cancer dataset
containing 450 samples in the training set.

To attempt to replicate the small training size effect
seen in Figure 4(b) on the credit card default
dataset, models were trained using 450 credit card
clients across different dropout rates. Figure 5(a)
shows the model accuracies that were determined
with the previously used testing set of 1000
samples. As can be seen, the accuracy increases
to an approximate maximum when any amount of
dropout is present. In an attempt to keep parameters
consistent between datasets, the 450 credit card
training set was also paired with a testing set of 230
samples, which is the testing set size used in the
breast cancer dataset. Five trials of this configuration



Table of Contents for the Digital Edition of The Bridge - Issue 2, 2018

Contents
The Bridge - Issue 2, 2018 - Cover1
The Bridge - Issue 2, 2018 - Cover2
The Bridge - Issue 2, 2018 - Contents
The Bridge - Issue 2, 2018 - 4
The Bridge - Issue 2, 2018 - 5
The Bridge - Issue 2, 2018 - 6
The Bridge - Issue 2, 2018 - 7
The Bridge - Issue 2, 2018 - 8
The Bridge - Issue 2, 2018 - 9
The Bridge - Issue 2, 2018 - 10
The Bridge - Issue 2, 2018 - 11
The Bridge - Issue 2, 2018 - 12
The Bridge - Issue 2, 2018 - 13
The Bridge - Issue 2, 2018 - 14
The Bridge - Issue 2, 2018 - 15
The Bridge - Issue 2, 2018 - 16
The Bridge - Issue 2, 2018 - 17
The Bridge - Issue 2, 2018 - 18
The Bridge - Issue 2, 2018 - 19
The Bridge - Issue 2, 2018 - 20
The Bridge - Issue 2, 2018 - 21
The Bridge - Issue 2, 2018 - 22
The Bridge - Issue 2, 2018 - 23
The Bridge - Issue 2, 2018 - 24
The Bridge - Issue 2, 2018 - 25
The Bridge - Issue 2, 2018 - 26
The Bridge - Issue 2, 2018 - 27
The Bridge - Issue 2, 2018 - 28
The Bridge - Issue 2, 2018 - 29
The Bridge - Issue 2, 2018 - 30
The Bridge - Issue 2, 2018 - 31
The Bridge - Issue 2, 2018 - 32
The Bridge - Issue 2, 2018 - 33
The Bridge - Issue 2, 2018 - 34
The Bridge - Issue 2, 2018 - 35
The Bridge - Issue 2, 2018 - 36
The Bridge - Issue 2, 2018 - 37
The Bridge - Issue 2, 2018 - 38
The Bridge - Issue 2, 2018 - 39
The Bridge - Issue 2, 2018 - 40
The Bridge - Issue 2, 2018 - 41
The Bridge - Issue 2, 2018 - 42
The Bridge - Issue 2, 2018 - 43
The Bridge - Issue 2, 2018 - 44
https://www.nxtbook.com/nxtbooks/ieee/bridge_issue2_2022
https://www.nxtbook.com/nxtbooks/ieee/bridge_issue1_2022
https://www.nxtbook.com/nxtbooks/ieee/bridge_issue3_2021
https://www.nxtbook.com/nxtbooks/ieee/bridge_issue2_2021
https://www.nxtbook.com/nxtbooks/ieee/bridge_issue1_2021
https://www.nxtbook.com/nxtbooks/ieee/bridge_2020_issue3
https://www.nxtbook.com/nxtbooks/ieee/bridge_2020_issue2
https://www.nxtbook.com/nxtbooks/ieee/bridge_2020_issue1
https://www.nxtbook.com/nxtbooks/ieee/bridge_2019_issue3
https://www.nxtbook.com/nxtbooks/ieee/bridge_2019_issue2
https://www.nxtbook.com/nxtbooks/ieee/bridge_2019_issue1
https://www.nxtbook.com/nxtbooks/ieee/bridge_2018_issue3
https://www.nxtbook.com/nxtbooks/ieee/bridge_2018_issue2
https://www.nxtbook.com/nxtbooks/ieee/bridge_2018_issue1
https://www.nxtbookmedia.com