The list is in progress.. Your suggestions are most welcome, and if you have any additions or corrections email me.

Description	Link	Information
COCO – Common Objects in Context	http://cocodataset.org/#home	COCO is a large-scale object detection, segmentation, and captioning dataset. COCO has several features: Object segmentation Recognition in context Superpixel stuff segmentation 330K images (>200K labeled) 1.5 million object instances 80 object categories 91 stuff categories 5 captions per image 250,000 people with keypoints