Computer Vision at Pinterest
Pinterest is an inherently visual product. In fact, it is probably the only visual product at the scale of hundreds of millions of users. The visual format of Pinterest allows the users to process a much larger volume of information, especially in visual domains as fashion, beauty, home decor. This allows for discovery and exploration and differentiates Pinterest from other platforms where users see individual answers.Pinterest has launched best-in-class visual discovery and recommendation products that use visual input as the user query. We just launched Pinterest Lens to enable people to discover recommendations for objects they see in the real world using their camera. Last year we launched object detection, and we’re just getting started with experimentation with additional mediums like video. We currently serve 250M+ visual searches each month, and have detected over a billion visual objects in our images, but there are still many challenging problems be solved in fine grained recognition, object-to-object visual search, and large-scale visual search infrastructure. The future for visual discovery at Pinterest is to use the unique visual dataset that is available though user curation and interaction and build the first ever Taste AI and Style AI that will understand images with their individual objects, styles and relate those to the taste of the users as derived from Pinterest interactions. Such systems will create brand new user experiences in this domain and make Pinterest a central point for visual exploration
- Visual Discovery at Pinterest.
Andrew Zhai, Dmitry Kislyuk, Yushi Jing, Michael Feng, Eric Tzeng, Jeff Donahue, Yue Li Du, Trevor Darrell.
ACM International Conference on World Wide Web (WWW), 2017.
- Human Curation and Convnets: Powering Item-to-Item Recommendations on Pinterest
Dmitry Kislyuk, Yuchen Liu, David Liu, Eric Tzeng, Yushi Jing.
- Visual Search at Pinterest.
Yushi Jing, David Liu, Dmitry Kislyuk, Andrew Zhai, Jiajing Xu, Jeff Donahue, Sarah Tavel.
ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD), 2015.
- Building Pinterest Lens: a real world visual discovery system
- Introducing automatic object detection to visual search
- Andrew Zhai
- Dmitry Kislyuk
- Eric Tzeng
- Michael Feng
- Trevor Darrell