annotation with redfox

18
Annotation Tutorial Using the Redfox annotator, you will be determining whether products have been tagged correctly or incorrectly by our automated classifier.

Upload: benjamin-bengfort

Post on 13-May-2015

158 views

Category:

Software


3 download

DESCRIPTION

Tutorial for using the Redfox annotation system at Cobrain Labs.

TRANSCRIPT

Page 1: Annotation with Redfox

Annotation TutorialUsing the Redfox annotator, you will be determining whether

products have been tagged correctly or incorrectly by our automated classifier.

Page 2: Annotation with Redfox

Go to https://redfox.cobrainlabs.com and click on ‘Login with Google’.

Click to log in with Google

Page 3: Annotation with Redfox

Product Name

Product Image

Product Description & Keywords

Once logged in, you should see the first product you have to annotate. Review The product name, description, keywords and product image.

Page 4: Annotation with Redfox

Now review the Age & Gender, Category and Sub-category data. If these items match the displayed product, then select ‘Right’. If not, select ‘Wrong’. In the example, below, the Metadata correctly identifies the product as being for an Adult Male, the category is correctly marked as a ‘Top’ and the ‘Subcategory’ is correctly marked as ‘Shirt’. Therefore, this item has been classified correctly and so should be marked ‘Right’.

Note that our automated classifier only considers the ‘Product Name’ when determining the Metadata, Category and Subcategory. If there is incongruity between the Product Name, Description and Image, consider only the Product Name when deciding whether the classification is Right or Wrong.

Age & Gender

Category & Subcategory

This item is classified correctly

Page 5: Annotation with Redfox

In the example below, this shoe is correctly marked as for an Adult Male but the category and subcategory are incorrectly marked as ‘Accessories’ and ‘Ties’ respectively. This item classification would be marked ‘Wrong’.

Incorrectly marked as ‘Accessory’ and as ‘Ties’

This item is NOT classified correctly

Page 6: Annotation with Redfox

If any of the classification data items is incorrect, then the product classification should be marked ‘Wrong’. In this example, the product is correctly identified as for adult females and is correctly categorized as a shoe. However, the subcategory is incorrectly marked as ‘Boots’. Even though only one of the classification items is wrong, this should be marked ‘Wrong’.

Incorrectly marked as a ‘boot’

This item is NOT classified correctly

Page 7: Annotation with Redfox

If you accidentally select the incorrect option, then you can click on ‘Prev’ to go to the previous item.

Note that your history is only maintained per session and only contains the previous 32 items. It will be erased if you log out and log in again.

If you are not sure whether the classification is right or wrong, just click on ‘Unsure’ to skip to the next item.

Page 8: Annotation with Redfox

You can view your progress in your profile page, which can be accessed by clicking on the drop down with your name in it, then selecting “View Profile”.

Here you will see your overall annotation statistics as well as your current annotation rate.

Page 9: Annotation with Redfox

Category DescriptionsThe following pages include descriptions of the different categories and subcategories used by the classifier. Do an image search of

the category/subcategory if you are not sure what it looks like

Page 10: Annotation with Redfox

Tops Any piece of light clothing worn on the part of the body above the waist

Polos An informal style of cotton shirt, with short sleeves, a collar, and some buttons at the neck

Sweatshirts A piece of informal clothing with long sleeves, usually made of thick cotton, worn on the upper part of the body

Sweaters A piece of clothing with long sleeves that is usually made from wool, worn on the upper part of the body

Shirts A piece of clothing worn, especially by men, on the upper part of the body, made of light cloth like cotton and usually having a collar and buttons at the front

Tees or Tanks A simple piece of clothing, usually with short or no sleeves and no collar, that covers the top part of the body

Top level Category

Subcategories

Page 11: Annotation with Redfox

Bottoms Any piece of clothing worn on the part of the body below the waist

Capris Close-fitting calf-length tapered trousers, usually worn by women and girls

Jeans Hard-wearing trousers made of denim or other cotton fabric, for informal wear

Leggings Tight-fitting stretch pants worn by women and children

Pants An outer garment covering the body from the waist to the ankles, with a separate part for each leg. (Trousers not under garments)

Shorts Short pants that reach only to the thighs or knees

Skirts A woman's outer garment fastened around the waist and hanging down around the legs

Page 12: Annotation with Redfox

Dresses A one-piece garment for a woman or girl that covers the body and extends down over the legs

Career (Dresses) A dress that is appropriate for business use

Casual (Dresses) A dress that emphasizes comfort and personal expression over presentation and uniformity

Formal (Dresses) A dress suitable for formal social events, such as a wedding, formal garden party or dinner

Evening (Dresses) A dress to wear on formal occasions in the evening

Page 13: Annotation with Redfox

Suits Clothes that usually consists of a jacket and a skirt or pair of pants that are made out of the same material

(Suit) Jackets An outer garment extending either to the waist or the hips, typically having sleeves and a fastening down the front

Suits A complete set of clothes that usually consists of a jacket and a skirt or pair of pants that are made out of the same material

Vests A close-fitting waist-length garment, typically having no sleeves or collar and buttoning down the front

Page 14: Annotation with Redfox

Activewear Clothing designed to be worn for sports, exercise, and outdoor activities

(Athletic) Equipment Equipment needed to participate in a particular sport

(Athletic) Jackets A thin outer coat designed to resist wind chill and light rain, usually of light construction and made of some type of synthetic material

(Athletic) Pants or Tights Warm trousers with an elasticized or drawstring waist, worn when exercising or as leisurewear

(Athletic) Shirts A shirt with short or long sleeves designed for comfort and to perform sports, exercise, and outdoor activities

(Athletic) Shorts Knee-length short trousers made of a stretch fabric, designed to be worn by athletes

(Athletic) Bras A bra that provides additional support to female breasts during physical exercise

(Athletic) Suits An item of clothing designed to be worn by people engaging in a water-based activity or water sports, such as swimming

Page 15: Annotation with Redfox

Outerwear Clothing worn over other clothes, esp. for the outdoors

Coats An outer garment worn outdoors, having sleeves and typically extending below the hips

Leather (Coat) An outer garment made of leather

Overcoats A long warm coat worn over other clothin

Rain (Coat) A long coat made from waterproofed or water-resistant fabric

Trench (Coat) A loose, belted, double-breasted raincoat in a military style

Winter (Coat) A heavy coat worn over clothes in the winter

Page 16: Annotation with Redfox

Underwear Clothing worn under other clothes, typically next to the skin

Sleepwear or Loungewear

Casual, comfortable clothing suitable for wearing at home

Boxers Men's loose underpants similar in shape to the shorts worn by boxers

Boxer-Briefs A type of men's undergarment which are long in the leg, like boxer shorts but tighter-fitting, like briefs; a hybrid between the two main types of male underpants

Bras An undergarment worn by women to support the breasts

Briefs Close-fitting legless underpants that are cut so as to cover the body to the waist, in contrast to a bikini

Hosiery Stockings, socks, and tights collectively

Lingerie Women's underwear and nightclothes

Panties Legless underpants worn by women and girls

Socks A garment for the foot and lower part of the leg, typically knitted from wool, cotton, or nylon

Underwear Clothing worn under other clothes, typically next to the skin

Page 17: Annotation with Redfox

Shoes A covering for the foot, typically made of leather, with a sturdy sole and not reaching above the ankle

Athletic (Shoes) A soft shoe with a rubber sole worn for sports or casual occasions

Boots A sturdy item of footwear covering the foot, the ankle, and sometimes the leg below the knee

Casual (Shoes) Footwear that emphasizes comfort and personal expression

Dress (Shoes) Shoe to be worn at smart casual or more formal events. A dress shoe is typically contrasted to an athletic shoe

Heels High-heeled shoes typically worn by women

Sandals A light shoe with either an openwork upper or straps attaching the sole to the foot

Slippers A comfortable slip-on shoe that is worn indoors

Page 18: Annotation with Redfox

Accessories A small article or item of clothing carried or worn to complement a garment or outfit

Bags A container made of flexible material with an opening at the top, used for carrying things

Belts A strip of leather or other material worn around the waist or across the chest, esp. in order to support clothes

Eyewear Things worn on the eyes, such as spectacles and contact lenses

Gloves A covering for the hand worn for protection against cold or dirt and typically having separate parts for each finger and the thumb

Hats A shaped covering for the head worn for warmth, as a fashion item, or as part of a uniform

Jewelry Personal ornaments, such as necklaces, rings, or bracelets, that are typically made from or contain jewels and precious metal

Scarves A length or square of fabric worn around the neck or head

Watches A small timepiece worn typically on a strap on one's wrist

Wallets A pocket-sized, flat, folding holder for money and plastic cards

Ties A strip of material worn around the collar and tied in a knot at the front with the ends hanging down, typically forming part of a man's business or formal outfit; a necktie

Other Miscellaneous accessories that do not fit into other categories