Nuxeo Platform Adds Integration with Google Cloud Vision API for Automated Image Recognition

Mar 24, 2016


BEST PRACTICES SERIES

Nuxeo, developers of the Nuxeo Platform, which enables organizations to manage complex digital content at massive scale, announced an integration with the Google Cloud Vision API, a new service providing information and insights automatically detected within images. The plugin is now available to download directly from the Nuxeo Marketplace, which offers optional packages to easily add new features to the Nuxeo Platform. The Google Cloud Vision API enables developers to understand the content of an image by encapsulating powerful machine learning models in an easy to use REST API. Complete details are available at cloud.google.com/vision.

Using this plugin, the Nuxeo Platform exposes a set of configurable image analysis features that can be applied upon file import, within a given workflow/business process, and/or on demand after a specific user action. In addition to processing any image attached to content objects, the Nuxeo Platform also applies the capabilities to video, using images extracted from the video storyboard. Image features detected by the Google Cloud Vision service are available for use with Nuxeo process automation and business logic, and can also be stored as metadata and tags on the content object, including:

  • Image labeling based on detection of common objects, landmarks, and/or brand logos
  • Faces, if any, detected in the image, including simple sentiment recognition (e.g., "joy," "sorrow")
  • Text found within the image, extracted via OCR
  • Safe search detection of different types of  inappropriate content
  • Other general image attributes, such as the dominant color

Additionally, the Nuxeo plugin, named Nuxeo Vision, enables developers to specify business logic for customized operations with the Google Cloud Vision service, such as invoking workflows based on the presence of automatically added image metadata. It has been developed to immediately support the Google Cloud Vision service, as well as other image recognition engines in the future.

(nuxeo.com)