The following archive available for download contains face shape annotations – along with the corresponding images – for the seven signers who appear in the RWTH-PHOENIX corpus. The archive contains one directory per signer, each of which contains an “images” subdirectory and a “points” subdirectory. All image files are 300×260 PNG images. All face shape annotation files are ASCII files with the filename extension ”.pts”.

Download RWTH-PHOENIX face shape annotations here!

In total 369 images from the RWTH-PHOENIX corpus have been manually annotated with the face shape.

For each image the face shape annotation consists of the ordered list of the positions of 38 facial landmarks. Each facial landmark – or face shape point – has two coordinates in the coordinate system originating at the top-left corner of the image, with the x-axis pointing right and the y-axis pointing down. The actual structure of a ”.pts” file is as follows:

version: 1
n_points: 38
{
  x_1  y_1
  x_2  y_2
  ...
  x_38 y_38
}

A possible interpretation of the shape points as face parts is as follows (using zero-based indexing in the list of points of a ”.pts” file):

Note: The original images from the RWTH-PHOENIX corpus do not have square pixels and come in 210×260 image resolution. Therefore the annotated data provided here should be scaled appropriately if the goal is to use them to build models that are relevant to the entire corpus. Scaling both our images and our shape annotations by a factor 210/300 in the horizontal direction only (x-coordinates) will do the trick!

License

This work was partially funded by the European Community's Seventh Framework Programme FP7/2007-2013 (Specific Programme Cooperation, Theme 3, Information and Communication Technologies) under grant agreement no. 231424, SignSpeak.