Recognizing Handshapes using Small Datasets
Advances in convolutional neural networks have made possible significant improvements in the state-of-the-art in image classification. However, their success on a particular field rests on the possibility of obtaining labeled data to train networks. Handshape recognition from images, an important s...
Guardado en:
| Autores principales: | , , , , , |
|---|---|
| Formato: | Objeto de conferencia |
| Lenguaje: | Inglés |
| Publicado: |
2019
|
| Materias: | |
| Acceso en línea: | http://sedici.unlp.edu.ar/handle/10915/90457 |
| Aporte de: |
| id |
I19-R120-10915-90457 |
|---|---|
| record_format |
dspace |
| institution |
Universidad Nacional de La Plata |
| institution_str |
I-19 |
| repository_str |
R-120 |
| collection |
SEDICI (UNLP) |
| language |
Inglés |
| topic |
Ciencias Informáticas Sign Language Hand Shape Recognition Convolutional Neural Networks Densenet Prototypical Networks Small Datasets |
| spellingShingle |
Ciencias Informáticas Sign Language Hand Shape Recognition Convolutional Neural Networks Densenet Prototypical Networks Small Datasets Cornejo Fandos, Ulises Jeremias Ríos, Gastón Gustavo Ronchetti, Franco Quiroga, Facundo Hasperué, Waldo Lanzarini, Laura Cristina Recognizing Handshapes using Small Datasets |
| topic_facet |
Ciencias Informáticas Sign Language Hand Shape Recognition Convolutional Neural Networks Densenet Prototypical Networks Small Datasets |
| description |
Advances in convolutional neural networks have made possible significant improvements in the state-of-the-art in image classification.
However, their success on a particular field rests on the possibility of obtaining labeled data to train networks. Handshape recognition from images, an important subtask of both gesture and sign language recognition, suffers from such a lack of data. Furthermore, hands are highly deformable objects and therefore handshape classification models require larger datasets.
We analyze both state of the art models for image classification, as well as data augmentation schemes and specific models to tackle problems with small datasets. In particular, we perform experiments with Wide- DenseNet, a state of the art convolutional architecture and Prototypical Networks, a state of the art few-shot learning meta model. In both cases, we also quantify the impact of data augmentation on accuracy.
Our results show that on small and simple data sets such as CIARP, all models and variations of achieve perfect accuracy, and therefore the utility of the data is highly doubtful, despite its having 6000 samples.
On the other hand, in small but complex datasets such as LSA16 (800 samples), specialized methods such as Prototypical Networks do have an advantage over other methods. On RWTH, another complex and small dataset with close to 4000 samples, a traditional and state-of-the-art method such as Wide-DenseNet surpasses all other models. Also, data augmentation consistently increases accuracy for Wide-DenseNet, but not fo Prototypical Networks. |
| format |
Objeto de conferencia Objeto de conferencia |
| author |
Cornejo Fandos, Ulises Jeremias Ríos, Gastón Gustavo Ronchetti, Franco Quiroga, Facundo Hasperué, Waldo Lanzarini, Laura Cristina |
| author_facet |
Cornejo Fandos, Ulises Jeremias Ríos, Gastón Gustavo Ronchetti, Franco Quiroga, Facundo Hasperué, Waldo Lanzarini, Laura Cristina |
| author_sort |
Cornejo Fandos, Ulises Jeremias |
| title |
Recognizing Handshapes using Small Datasets |
| title_short |
Recognizing Handshapes using Small Datasets |
| title_full |
Recognizing Handshapes using Small Datasets |
| title_fullStr |
Recognizing Handshapes using Small Datasets |
| title_full_unstemmed |
Recognizing Handshapes using Small Datasets |
| title_sort |
recognizing handshapes using small datasets |
| publishDate |
2019 |
| url |
http://sedici.unlp.edu.ar/handle/10915/90457 |
| work_keys_str_mv |
AT cornejofandosulisesjeremias recognizinghandshapesusingsmalldatasets AT riosgastongustavo recognizinghandshapesusingsmalldatasets AT ronchettifranco recognizinghandshapesusingsmalldatasets AT quirogafacundo recognizinghandshapesusingsmalldatasets AT hasperuewaldo recognizinghandshapesusingsmalldatasets AT lanzarinilauracristina recognizinghandshapesusingsmalldatasets |
| bdutipo_str |
Repositorios |
| _version_ |
1764820490054008833 |