TY - CONF T1 - A Sensory-Motor Language for Human Activity Understanding T2 - 2006 6th IEEE-RAS International Conference on Humanoid Robots Y1 - 2006 A1 - Guerra-Filho,G. A1 - Aloimonos, J. KW - Actuators KW - associative learning KW - atomic segments KW - computational linguistics KW - Computer science KW - Computer vision KW - Educational institutions KW - grammars KW - human activity language KW - human activity understanding KW - human movement syntax KW - Humanoid robots KW - HUMANS KW - joint angles KW - kinetemes KW - kinetological system KW - Laboratories KW - learning (artificial intelligence) KW - List key index terms here KW - Morphology KW - motor information KW - No mare than 5 KW - parallel learning KW - Reproducibility of results KW - Robot kinematics KW - Robot programming KW - robot vision KW - sensory-motor language KW - sequential language learning KW - symbolic nonarbitrary representation KW - visual information AB - We have empirically discovered that the space of human actions has a linguistic framework. This is a sensory-motor space consisting of the evolution of the joint angles of the human body in movement. The space of human activity has its own phonemes, morphemes, and sentences. We present a human activity language (HAL) for symbolic non-arbitrary representation of visual and motor information. In phonology, we define atomic segments (kinetemes) that are used to compose human activity. We introduce the concept of a kinetological system and propose five basic properties for such a system: compactness, view-invariance, reproducibility, selectivity, and reconstructivity. In morphology, we extend sequential language learning to incorporate associative learning with our parallel learning approach. Parallel learning is effective in identifying the kinetemes and active joints in a particular action. In syntax, we suggest four lexical categories for our human activity language (noun, verb, adjective, and adverb). These categories are combined into sentences through syntax for human movement JA - 2006 6th IEEE-RAS International Conference on Humanoid Robots PB - IEEE SN - 1-4244-0200-X M3 - 10.1109/ICHR.2006.321365 ER -