We present a novel framework for the automatic discovery and recognition of motion primitives in videos of human activities. Given the 3D pose of a human in a video, human motion primitives are discovered by optimizing the motion flux', a quantity which captures the motion variation of a group of skelet al joints. A normalization of the primitives is proposed in order to make them invariant with respect to a subject anatomical variations and data sampling rate. The discovered primitives are unknown and unlabeled and are unsupervisedly collected into classes via a hierarchical non-parametric Bayes mixture model. Once classes are determined and labeled they are further analyzed for establishing models for recognizing discovered primitives. Each primitive model is defined by a set of learned parameters. Given new video data and given the estimated pose of the subject appearing on the video, the motion is segmented into primitives, which are recognized with a probability given according to the parameters of the learned models. Using our framework we build a publicly available dataset of human motion primitives, using sequences taken from well-known motion capture datasets. We expect that our framework, by providing an objective way for discovering and categorizing human motion, will be a useful tool in numerous research fields including video analysis, human inspired motion generation, learning by demonstration, intuitive human-robot interaction, and human behavior analysis.
where the constants @math , @math and @math has a value close to @math . An equivalent Power law for trajectories in 3D space is introduced by @cite_6 and it is called the curvature-torsion power law and is defined as @math , where @math is the curvature of the trajectory, @math the torsion, @math the spatial movement speed, @math and @math are constants.
@cite_6
2320004782 2008886640 2032375919 1985415289
The two-thirds power law, postulating an inverse local relation between the velocity and cubed root of curvature of planar trajectories, is a long-established simplifying principle of human hand movements. In perception, the motion of a dot along a planar elliptical path appears most uniform for speed profiles closer to those predicted by the power law than to constant Euclidean speed, a kinetic-visual illusion. Mathematically, complying with this law is equivalent to moving at constant planar equi-affine speed, while unconstrained three-dimensional drawing movements generally follow constant spatial equi-affine speed. Here we test the generalization of this illusion to visual perception of spatial motion for a dot moving along five differently shaped paths, using stereoscopic projection. The movements appeared most uniform for speed profiles closer to constant spatial equi-affine speed than to constant Euclidean speed, with path torsion (i.e., local deviation from planarity) directly affecting the speed ... Considerable evidence exists that the velocity of execution of handwriting and drawing movements depends on some global metric properties of the movement (size, linear extent etc.). Recent experiments have demonstrated that the instantaneous velocity also depends on the local curvature of the trajectory, that is, on the differential geometrical properties of the movement. In this paper we investigate further the role of the differential factors. Experiments are described in which drawing movements of simple geometrical forms and scribbles are performed either freely and extemporaneously, or in the presence of external constraints. It is shown that, at any time during the movement, the velocity component related to differential factors only depends on the value of the curvature of the trajectory at the same time (no dynamics). The relation can be described quantitatively as a specific Power Law and applies to all movements considered here, including those which are performed by following the edge of a template. The fact that the velocity of execution increases with the radius of curvature implies a built-in tendency of the motor control system to keep angular velocity relatively constant and qualifies the Isogony Principle proposed previously. The specific exponent of the Power Law suggests a possible interpretation of this empirical relation. Humans interact with their environment through sensory information and motor actions. These interactions may be understood via the underlying geometry of both perception and action. While the motor space is typically considered by default to be Euclidean, persistent behavioral observations point to a different underlying geometric structure. These observed regularities include the “two-thirds power law”, which connects path curvature with velocity, and “local isochrony”, which prescribes the relation between movement time and its extent. Starting with these empirical observations, we have developed a mathematical framework based on differential geometry, Lie group theory and Cartan’s moving frame method for the analysis of human hand trajectories. We also use this method to identify possible motion primitives, i.e., elementary building blocks from which more complicated movements are constructed. We show that a natural geometric description of continuous repetitive hand trajectories is not Euclidean but equi-affine. Specifically, equi-affine velocity is piecewise constant along movement segments, and movement execution time for a given segment is proportional to its equi-affine arc-length. Using this mathematical framework, we then analyze experimentally recorded drawing movements. To examine movement segmentation and classification, the two fundamental equi-affine differential invariants—equi-affine arc-length and curvature are calculated for the recorded movements. We also discuss the possible role of conic sections, i.e., curves with constant equi-affine curvature, as motor primitives and focus in more detail on parabolas, the equi-affine geodesics. Finally, we explore possible schemes for the internal neural coding of motor commands by showing that the equi-affine framework is compatible with the common model of population coding of the hand velocity vector when combined with a simple assumption on its dynamics. We then discuss several alternative explanations for the role that the equi-affine metric may play in internal representations of motion perception and production. We study some Riemannian metrics on the space of regular smooth curves in the plane, viewed as the orbit space of maps from the circle to the plane modulo the group of diffeomorphisms of the circle, acting as reparameterizations. In particular we investigate the L^2 inner product with respect to 1 plus curvature squared times arclength as the measure along a curve, applied to normal vector field to the curve. The curvature squared term acts as a sort of geometric Tikhonov regularization because, without it, the geodesic distance between any 2 distinct curves is 0, while in our case the distance is always positive. We give some lower bounds for the distance function, derive the geodesic equation and the sectional curvature, solve the geodesic equation with simple endpoints numerically, and pose some open questions. The space has an interesting split personality: among large smooth curves, all its sectional curvatures are positive or 0, while for curves with high curvature or perturbations of high frequency, the curvatures are negative.