Analyze Images with Microsoft Cognitive Services

Examples

• (Example) How to Get the Access Token Credentials from Microsoft Cognitive Services

Prerequisites

• Access Token for Microsoft Cognitive Services.
• AgilePoint NX OnDemand (public cloud), or AgilePoint NX PrivateCloud or AgilePoint NX OnPremises v7.0 or higher.

Good to Know

• In most text fields, you can use process data variables as an alternative to literal data values.
• You can configure whether this activity waits for other activities before it runs.

  For more information, refer to How Do I Configure an Activity to Wait for Other Incoming Activities?

• Some information about third-party integrations is outside the scope of the AgilePoint NX Product Documentation, and it is the responsibility of the vendors who create and maintain these technologies to provide this information. This includes specific business uses cases and examples; explanations for third-party concepts; details about the data models and input and output data formats for third-party technologies; and various types of IDs, URL patterns, connection string formats, and other technical information that is specific to the third-party technologies. For more information, refer to Where Can I Find Information and Examples for Third-Party Integrations?

How to Start

1. On the Application Explorer screen, do one of these:
   • Open a Process.
   • Create a Process.
2. Do one of these:
   • Add an activity:
     1. In the Process Builder, in the Activity Library, open the Cognitive Services tab.
     2. On the Cognitive Services tab, drag the Analyze Image activity onto your process.
   • Change an activity:
     1. In your process, double-click your activity.
3. Click Analyze Image Configuration .

Procedure

1. Complete the fields on the General Configuration screen.

   For more information, refer to Configure General Options for a System Activity.

2. Click Source Configuration .
3. On the Source Repository screen, select the source location for your file.
4. Click Analyze Image Configuration .
5. On the Analyze Image Configuration screen, in the Cognitive Services field, select your Microsoft Cognitive Services access token. The selected access token must have the Cognitive Service Type configured for for the Computer Vision API.

   To create a new access token, click Add Token . For more information, refer to Access Token for Microsoft Cognitive Services.

6. To connect response data from Microsoft Cognitive Services to your process, do one of these.
   • To connect the response to your process schema, complete this field as necessary:

     Field Name

     Definition

     Map Response to AgilePoint Schema

     Function: Specifies the connection from the Microsoft Cognitive Services API response parameter to your schema. Accepted Values: Click the Schema Mapping button to open the Schema Mapper. Use this screen to connect the response to the data model for your process. Default Value: None Limitations: Some information about third-party integrations is outside the scope of the AgilePoint NX Product Documentation, and it is the responsibility of the vendors who create and maintain these technologies to provide this information. This includes specific business uses cases and examples; explanations for third-party concepts; details about the data models and input and output data formats for third-party technologies; and various types of IDs, URL patterns, connection string formats, and other technical information that is specific to the third-party technologies. For more information, refer to Where Can I Find Information and Examples for Third-Party Integrations?

   • To connect the response to a process data variable, complete this field as necessary:

     Field Name

     Definition

     Store the Response in Custom Attribute

     Function: Specifies the process data variable that stores the responses from the Microsoft Analyze Image service. Accepted Values: A process data variable that accepts a text string in JSON format that contains the information from the analyzed image. Default Value: None Accepts Process Data Variables: Yes Example: [{"categories":[{"name":"outdoor_road","score":0.7421875}],"description":{"tags":["road","yellow","people"],"captions":[{"text":"a person riding a motorcycle on the side of a road ","dominantColors":["Grey"],"accentColor":"A1712A","isBWImg":false},…..}]