Experimenting with Random Forests on UCI ML Data Sets

[ machine-learning  random-forests  easi  ]

For certain types of data, random forests work the best. Maybe more accurately, I should say a tree-based modeling approach works best – because sometimes the RF is beat out by gradient boosted trees, and so on. That said, I’ve been kind of obsessively vetting random forests as of late, so this is in that vein.

There are certain properties of RFs that I’m currently investigating, and – who knows! – might even publish on. To get a fair picture of such properties, I need to investigate them in a variety of data sets – and perhaps even note differences between classification and regression problems. Having said that, going through the entirety of the UCI ML repository can be daunting. There is also the fact that these interests are related to goings-on at work, and so my priority should be to look at wearables- or healthcare-related data sets. But even with this restriction, there is so much to choose from! Also, there are non-wearable, non-health data sets that are very regularly used and referenced, which hold an important familiarity when it comes to comparisons, benchmarking, and better understanding what might be happening.

In this post, I want to simply list data sets I’m interested in looking at. It will help me better organize my thoughts and serve as a nice reference as I work on this stuff over the next several months. I try to list some characteristics of the data sets too, since these can sometimes help direct whether or not the data set is interesting for a particular use case. For example, I’m very interested in comparing various measures of feature importance, and how feature importance depends on things like mTry or nTree; in this case, data sets with 4 features are less interesting than those with 40 or 400 features. Similarly, it is not necessarily interesting to look at a data set with only a few hundred records – but sometimes it is!

Classification Data Sets

Health- and/or Bio-Related Data Sets

Parkinson’s

Directly relevant to work stuff.

Autism

Directly relevant to work stuff.

Heart

Somewhat relevant to work stuff.

Diabetes

Not a disease we focus on much at work.

Cancer

Somewhat related to work stuff (e.g., brain cancer, ability to mine through genetics data, etc).

Misc

Wearable / Activity Recognition / Home Sensor Data Sets

This whole section is SUPER relevant to work stuff.

  • EMG Physical Action Data Set
    • 8 real-valued features
    • 20- or 2-class outcome (i.e., predict specific action, or just whether action was aggressive)
    • 10k records
    • Missing Values: No
  • Vicon (3D Tracker) Physical Action Data Set
    • 27 real-valued features
    • 20- or 2-class outcome (i.e., predict specific action, or just whether action was aggressive)
    • 3000 records
  • OPPORTUNITY Activity Recognition
    • 242 real-valued features
    • 2551 records
    • Multi-class outcomes (dependent on what you choose to classify)
    • Missing Values: Yes
  • PAMAP2 Physical Activity Monitoring
    • 52 real-valued features (or one can use the sensory time series data to construct more features, or alternatives)
    • 3,850,505 records
    • Multi-class outcome
  • Human Activity Recognition Using Smartphones
    • Description: “Human Activity Recognition database built from the recordings of 30 subjects performing activities of daily living (ADL) while carrying a waist-mounted smartphone with embedded inertial sensors.”
    • 561 features
    • 10,299 records
    • Multi-class outcomes (e.g., predict the activity; maybe even try to predict the patient)
  • Wearable Computing: Classification of Body Postures and Movements (PUC-Rio)
    • Description: “A dataset with 5 classes (sitting-down, standing-up, standing, walking, and sitting) collected on 8 hours of activities of 4 healthy subjects. We also established a baseline performance index.”
    • 18 features (real, integer)
    • 165,632 records
    • Note: seems like sequential/timeSeries data (need to create own features, or use as-is (?))
  • Daily and Sports Activities
    • Description: “The dataset comprises motion sensor data of 19 daily and sports activities each performed by 8 subjects in their own style for 5 minutes. Five Xsens MTx units are used on the torso, arms, and legs.”
    • 5,625 features
    • 9,120 records
    • 19 classes
  • EEG Eye State
    • Description: “The data set consists of 14 EEG values and a value indicating the eye state.”
    • 15 features
    • 14,980 records
  • Activities of Daily Living (ADLs) Recognition Using Binary Sensors
    • Description: “This dataset comprises information regarding the ADLs performed by two users on a daily basis in their own homes.”
    • 2747 records
    • Type of outcome and number of features dependent on design choices
    • More Info: “This dataset comprises information regarding the ADLs performed by two users on a daily basis in their own homes. This dataset is composed by two instances of data, each one corresponding to a different user and summing up to 35 days of fully labelled data. Each instance of the dataset is described by three text files, namely: description, sensors events (features), activities of the daily living (labels). Sensor events were recorded using a wireless sensor network and data were labelled manually.”
  • Weight Lifting Exercises monitored with Inertial Measurement Units
    • Description: “Six young health subjects were asked to perform 5 variations of the biceps curl weight lifting exercise. One of the variations is the one predicted by the health professional.”
  • EMG dataset in Lower Limb
    • Description: “3 different exercises: sitting, standing and walking in the muscles: biceps femoris, vastus medialis, rectus femoris and semitendinosus addition to goniometry in the exercises.”
  • Dataset for ADL Recognition with Wrist-worn Accelerometer
    • Description: “Recordings of 16 volunteers performing 14 Activities of Daily Living (ADL) while carrying a single wrist-worn tri-axial accelerometer.”
  • User Identification From Walking Activity
    • Description: “The dataset collects data from an Android smartphone positioned in the chest pocket from 22 participants walking in the wild over a predefined path.”
  • Activity Recognition from Single Chest-Mounted Accelerometer
    • Description: “The dataset collects data from a wearable accelerometer mounted on the chest. The dataset is intended for Activity Recognition research purposes.”
  • Gesture Phase Segmentation
    • Description: “The dataset is composed by features extracted from 7 videos with people gesticulating, aiming at studying Gesture Phase Segmentation. It contains 50 attributes divided into two files for each video.”
  • REALDISP Activity Recognition
    • Description: “The REALDISP dataset is devised to evaluate techniques dealing with the effects of sensor displacement in wearable activity recognition as well as to benchmark general activity recognition algorithms.”
  • sEMG for Basic Hand movements
    • Description: “The ‘sEMG for Basic Hand movements’ includes 2 databases of surface electromyographic signals of 6 hand movements using Delsys’ EMG System. Healthy subjects conducted six daily life grasps.”
  • MHEALTH Dataset
    • Description: “The MHEALTH (Mobile Health) dataset is devised to benchmark techniques dealing with human behavior analysis based on multimodal body sensing.”
  • Gas sensors for home activity monitoring
    • Description: “100 recordings of a sensor array under different conditions in a home setting: background, wine and banana presentations. The array includes 8 MOX gas sensors, and humidity and temperature sensors.”
  • Smartphone Dataset for Human Activity Recognition (HAR) in Ambient Assisted Living (AAL)
    • Description: “This data is an addition to an existing dataset on UCI. We collected more data to improve the accuracy of our human activity recognition algorithms applied in the domain of Ambient Assisted Living.”
  • Activity Recognition system based on Multisensor data fusion (AReM)
    • Description: “This dataset contains temporal data from a Wireless Sensor Network worn by an actor performing the activities: bending, cycling, lying down, sitting, standing, walking.”
  • MoCap Hand Postures
    • Description: “5 types of hand postures from 12 users were recorded using unlabeled markers attached to fingers of a glove in a motion capture environment. Due to resolution and occlusion, missing values are common.”
  • Motion Capture Hand Postures
    • Description: “5 types of hand postures from 12 users were recorded using unlabeled markers on fingers of a glove in a motion capture environment. Due to resolution and occlusion, missing values are common.”
  • Wireless Indoor Localization
    • Description: “Collected in indoor space by observing signal strengths of seven WiFi signals visible on a smartphone. The decision variable is one of the four rooms.”
  • Activity recognition with healthy older people using a batteryless wearable sensor
    • Description: “Sequential motion data from 14 healthy older people aged 66 to 86 years old using a batteryless, wearable sensor on top of their clothing for the recognition of activities in clinical environments.”
  • BLE RSSI Dataset for Indoor localization and Navigation
  • EEG Steady-State Visual Evoked Potential Signals
    • Description: “This database consists on 30 subjects performing Brain Computer Interface for Steady State Visual Evoked Potentials (BCI-SSVEP).”
  • WESAD (Wearable Stress and Affect Detection)
    • Description: “WESAD (Wearable Stress and Affect Detection) contains data of 15 subjects during a stress-affect lab study, while wearing physiological and motion sensors.”
  • BAUM-1
    • Description: “BAUM-1 dataset contains 1184 multimodal facial video clips collected from 31 subjects. The 1184 video clips contain spontaneous facial expressions and speech of 13 emotional and mental states.”
  • BAUM-2
    • Description: “A multilingual audio-visual affective face database consisting of 1047 video clips of 286 subjects.”
  • EMG data for gestures
    • Description: “These are files of raw EMG data recorded by MYO Thalmic bracelet.”

Miscellaneous Data Sets

None of this is really directly related to work stuff, but most of these data sets tend to be easier to play with and experiment on. Many of them are fairly well recognized from appearing in many papers, online courses, and blogs, etc.

Written on September 25, 2019