分享一个弱监督语义分割 state-or-art 资源列表，包括相关论文和资源，还有作者的笔记等，供大家参考，如果有什么补充或建议也欢迎发邮件给作者（[email protected]）~

• 作者：JackieZhangdx
• 项目地址：https://github.com/JackieZhangdx/WeakSupervisedSegmentationList

更多Awsome Github资源请关注：【Awsome】GitHub 资源汇总

Last update 2019/4

• [✔] Paper list
  • [✔] instance
  • [✔] box
  • [✔] one-shot
  • [✔] others
• [✔] Resources

some unsupervised segment proposal methods and datasets here.

CVPR 2018 Tutorial : WSL web&ppt, Part1 ,Part2

Typical weak supervised segmentation problems

No Supervision Difficulty Domain Core issues 1 Bounding box middle annotated classes transfer learning 2 One-shot segment middle similar objects one-shot learning 3 Image/video label hard annotated classes transfer learning 4 Others n/a n/a n/a

1.Bounding box supervision

• Box-driven Class-wise Region Masking and Filling Rate Guided Loss for Weakly Supervised Semantic Segmentation, CVPR 2019

• Learning to Segment Every Thing, CVPR 2018

  Learning weight transfer from well-annotated subset, transfer class-specific weights(output layers) from detection and classification branch, based on Mask-RCNN

• Pseudo Mask Augmented Object Detection, CVPR 2018

  State-of-art weakly supervised instance segmentation with bounding box annotation. EM optimizes pseudo mask and segmentation parameter like Boxsup. Graphcut on superpixel is employed to refine pseudo mask.

• Simple Does It: Weakly Supervised Instance and Semantic Segmentation, CVPR 2017 [web] [ref-code][supp]

  Grabcut+(HED bounday) and MCG , train foreground segmentation network directly with generated mask semantic segmentaion, sensitive to env(quality) of training images.

• Weakly- and Semi-Supervised Learning of a DCNN for Semantic Image Segmentation, ICCV 2015

  Based on CRF refine, EM seems not work

• BoxSup: Exploiting Bounding Boxes to Supervise Convolutional Networks for Semantic Segmentation, ICCV 2015

  Iteratively update parameters and region proposal labels, proposals are selected by network output masks

• Deepcut: Object segmentation from bounding box annotations using convolutional neural networks, TMI 2017

• Adversarial Learning for Semi-Supervised Semantic Segmentation, BMVC 2018, [code]

2.One-Shot segmentation supervision

DAVIS Challenge: https://davischallenge.org/

: Davis17/18(Semi-supervised Video segmentation task), Davis16 is video salient object segmentation without the first frame annotations.

• Fast and Accurate Online Video Object Segmentation via Tracking Parts, CVPR 2018(Spotlight) [code]

  state-of-art, 82.4%/1.8s 77.9%/0.6s

• OSVOS: One-Shot Video Object Segmentation, CVPR 2017 [web][code]

  milestone, fine-tuning parent network with the first frame mask, 79.8%/10s

3.Image/video label supervision

• Weakly-Supervised Semantic Segmentation by Iteratively Mining Common Object Features, CVPR 2018

  Superpixel-> RegionNet(RoI classfier)-> Saliency refine, iteratively update with PixelNet(FCN)

• Revisiting Dilated Convolution: A Simple Approach for Weakly- and SemiSupervised Semantic Segmentation, CVPR 2018(Spotlight)

• Weakly-Supervised Semantic Segmentation Network With Deep Seeded Region Growing, CVPR 2018 [web][code]

• Adversarial Complementary Learning for Weakly Supervised Object Localization, CVPR 2018

• Learning Pixel-level Semantic Affinity with Image-level Supervision for Weakly Supervised Semantic Segmentation, CVPR 2018

• Multi-Evidence Filtering and Fusion for Multi-Label Classification, Object Detection and Semantic Segmentation Based on Weakly Supervised Learning, CVPR 2018

• Weakly Supervised Semantic Segmentation using Web-Crawled Videos, CVPR 2017(Spotlight) [web]

• Object Region Mining with Adversarial Erasing: A Simple Classification to Semantic Segmentation Approach, CVPR 2017

• WILDCAT: Weakly Supervised Learning of Deep ConvNets for Image Classification, Pointwise Localization and Segmentation, CVPR 2017 [web][code]

• Learning random-walk label propagation for weakly-supervised semantic segmentation, CVPR 2017(Oral)

• Combining Bottom-Up, Top-Down, and Smoothness Cues for Weakly Supervised Image Segmentation, CVPR 2017

• Weakly Supervised Semantic Segmentation Using Superpixel Pooling Network, AAAI 2017

• Learning from Weak and Noisy Labels for Semantic Segmentation, PAMI 2017

• Learning to Segment Human by Watching YouTube, PAMI 2017

• Seed, Expand, Constrain: Three Principles for Weakly-Supervised Image Segmentation, ECCV 2016 [code]

• Backtracking ScSPM Image Classifier for Weakly Supervised Top-down Saliency, CVPR 2016, TIP 2018 Version

• Constrained Convolutional Neural Networks for Weakly Supervised Segmentation, ICCV 2015 [code]

• From Image-level to Pixel-level Labeling with Convolutional Networks, CVPR 2015

Resource

Propagate method Papers Global Max Pooling(GMP) Is object localization for free? - Weakly-supervised learning with convolutional neural networks,CVPR 2015 Global Average Pooling(GAP) Learning Deep Features for Discriminative Localization CVPR 2016 Log-sum-exponential Pooling(LSE) ProNet: Learning to Propose Object-specific Boxes for Cascaded Neural Networks,CVPR 2016 Global Weighted Rank Pooling(GWRP) SEC ECCV 2016 Global rank Max-Min Pooling(GRP) WILDCAT, CVPR 2017

3.2 Weakly supervised Detection / Localization(TODO)

4.Other supervision

Points

Scribbles

5.Close Related or unpublished work

推荐阅读
【资源】语义分割 paper 以及 code 汇总
图片语义分割深度学习算法要点回顾
有关语义分割的奇技淫巧有哪些：分享一些实用的纯工程 tricks

微信公众号: 极市平台（ID: extrememart ）
每天推送最新CV干货