###################################################################### # Cooking Video Dataset # # This dataset was compiled for category-level object recognition # using hand-labeled multi-modal information # ###################################################################### SETUP: The easiest way to see the labeled information is using ViPER: Video Performance Evaluation Resource See website for how to install and use: http://viper-toolkit.sourceforge.net You can also use this software to easily modify labels or add labels of your own. Otherwise, you can look at xml labeled info directly (files end with extension .xgtf, but can be treated as .xml) PLACE CookingDataset directory in same folder as viper-gt.jar!! Currently, the information labeled consists of: * Object Categories (bounding boxes and object labels) * Activity information * Speech information (words representing object categories) * Sound information * Person information (primarily bounding box around face, not all videos) Labeling was done on three dataset sources: Rachel Ray TV Cooking Dataset, LACE (University of Rocherster) Dataset, and Gia De Laurentiis TV Cooking Dataset. Each of the datasets had a slightly different set of values for each of the label categories. We list these values below: Rachel Ray ---------- OBJECT CATEGORIES bowl knife oiljar spice winebottle cuttingboard plate grill pan spoon ACTIVITIES twist smash shake dropadd cut mix pour squeeze pickup putdown point scoop SPEECH bowl knife oiljar spice winebottle cuttingboard plate grill pan spoon SOUND sizzle chop mix pour ************************************************** LACE ----- GO BACK TO 0586 OBJECT CATEGORIES cupboard fridge bowl knife cup cereal spoon cuttingboard jug plate ACTIVITIES eat drink bring return open close pour mix SPEECH bowl knife cup cereal spoon cuttingboard jug fridge plate cupboard SOUND pourL (pour liquid) pourS (pour solid) mix *********************************************** Gia De Laurentiis ------------------ OBJECT CATEGORIES bowl knife oiljar spice winebottle cuttingboard plate grill pan spoon ACTIVITIES twist smash shake dropadd cut mix pour squeeze pickup putdown point scoop SPEECH bowl knife oiljar spice winebottle cuttingboard plate grill pan spoon SOUND sizzle chop mix pour