Reference of the JSON Interactive Ink eXchange format (JIIX) version 3.

Content

JIIX is an exchange format to export, share and re-import the internal semantics of the Interactive Ink model.

As such, it is designed to host information about:

• Content - strokes, glyphs and graphical primitives
• Semantic interpretation of the content, including lists
• Style information - decorations, color, width, font, etc.

When exporting JIIX from iink SDK, depending on the use case, you may sometimes want to only retrieve part of this information. This is managed at configuration level, via the following keys:

• export.jiix.bounding-box - Export item bounding boxes
• export.jiix.strokes - Export ink strokes
• export.jiix.glyphs - Export converted glyphs
• export.jiix.primitives - Export shape primitives (lines, circles, etc.)
• export.jiix.style - Export detailed styling information (color, width, font, etc.)
• export.jiix.text.chars - Export detailed information about the characters in the text interpretation
• export.jiix.text.words - Export detailed information about the words in the text interpretation

• export.jiix.ids - Export items ids.

• export.jiix.ranges - Export ink strokes ranges when using a Raw Content Recognizer.
• export.jiix.shape.candidates - Export shape candidates when using a Shape Recognizer.
• export.jiix.text.spans - Export detailed recognition information per line in the text interpretation.

For more information about these parameters, including default values, refer to the configuration reference.

Versioning

The version of the format that the current document conforms to is given by the version property of the root of the JSON document (as the root of the document corresponds to the root block of the exposed content block hierarchy, the version property belongs to this root block).

For example, if the root block is a “Text” block, we will have something like:

{
 "version": "3",
 "type": "Text",
 "bounding-box": { ... },
 "label": "Hello world!",
 "words": [ ... ],
 "id": "MainBlock"
}

Unit system

Units are not explicitly provided in a JIIX document.

For system coordinates, they shall be understood as model units, that is to say millimeters. The actual rendering of a JIIX document on the screen will then depend on the dpi and any other parameter (zoom, offset) used to configure the renderer.

The angles are specified in radians.

Structure

Block hierarchy

JIIX documents are organized as a hierarchy of JSON objects (called “Blocks” in this page) that mirrors the block hierarchy of a content part. Each object has a specific type string property identifying it as a text block, a diagram block, a math node, etc. and defining the block semantics.

For example, a simple diagram may aggregate a text label and a rectangular node:

{
 "type": "Diagram",
 "elements": [ {
   "type": "Text",
   ...
  }, {
   "type": "Node",
   "kind": "rectangle",
   ...
  } ],
 ...
}

This semantics, in turn defines how sub-blocks are aggregated. For example :

• A Diagram block will host an array of “Diagram Item” blocks under its elements property.
• A Math block will host an array of “Math Node” blocks under its expressions property.
• A generic Container block will host its sub-blocks under a children property.
• …

Properties common to blocks

Whatever their types, all blocks share the following common properties:

For example, a simple text block can be represented as:

{
 "type": "Text",
 "id": "MainBlock",
 "bounding-box": {
  "x": 20.43125,
  "y": 31.272942,
  "width": 9.9375,
  "height": 8.9725456
 },
 ...
}

Other potential properties depend on the type of the block. Refer to the “blocks” section for more details.

Block content description

Block content is described using items, which represent what is actually visible when rendering the model.

Items

Items are used to describe the content of blocks in terms of ink, glyphs or shape primitives.

Like blocks, items share common properties:

Stroke item

A stroke item represents a standalone portion of ink, that is to say the trajectory of a writing tool between a pointer down and the corresponding pointer up.

It has the following specific properties:

Example:

{
     "timestamp": "2024-10-04 14:21:48.681000",
     "X": [ 90.5946655, 90.5946655, 90.5946655, 91.300972, 91.9794159, 92.351181, 92.351181 ],
     "Y": [ 72.6014557, 72.6014557, 72.6014557, 72.6664429, 72.6107101, 72.4155731, 72.4155731 ],
     "F": [ 0.683028102, 0.683028102, 0.336507946, 0.0451770462, 0.0451770462, 0.0393162407, 0.0393162407 ],
     "PT": [ 0.576388836, 0.576388836, 0.576388836, 0.576388836, 0.576388836, 0.576388836, 0.576388836 ],
     "PO": [ -1.18705797, -1.18705797, -1.18705797, -1.18705797, -1.18705797, -1.18705797, -1.18705797 ],
     "T": [ 0, 0, 17, 25, 29, 34, 38 ],
     "type": "stroke",
     "id": "0000010001000d00ff00"
    }

Line item

A line item represents a converted line primitive, for instance the edge of a polygon.

It has the following specific properties:

Example:

{
  "type": "line",
  "timestamp": "2021-09-07 09:04:39.162000",
  "x1": 24.8770332,
  "y1": 19.7303886,
  "x2": 66.5452576,
  "y2": 19.7303886,
  "startDecoration": "none",
  "endDecoration": "none",
  "id": "0000010001000300ff00"
  }

Arc item

An arc item represents a converted arc primitive, for instance a curved connector in a diagram or a portion of an ellipse.

It has the following specific properties:

Example:

{
  "type": "arc",
  "timestamp": "2021-09-06 13:56:41.110000",
  "cx": 167.432373,
  "cy": 105.229813,
  "rx": 30.8068428,
  "ry": 7.45266199,
  "phi": 0,
  "startAngle": 0,
  "sweepAngle": 6.28318548,
  "startDecoration": "none",
  "endDecoration": "none",
  "id": "0000300001008900ff00"
  }

Glyph item

A glyph item represents a converted typeset character.

It has the following specific properties:

Example:

{
  "type": "glyph",
  "timestamp": "2021-09-06 13:55:37.298000",
  "label": "2",
  "bounding-box": {
  "x": 39.1022644,
  "y": 27.6022339,
  "width": 1.92954254,
  "height": 4.09965172
  }

Text interpretation

Text interpreted by iink SDK is represented by word, lines and character objects as part of a Text block.

Word object

A word object represents the recognition of a word made by the MyScript engine. Note that to get such interpretation in JIIX export, your need to set the export.jiix.text.words configuration option to true.

It has the following properties:

Examples:

• Example corresponding to the word hello:

{
  "label": "hello",
  "candidates": [ "hello", "hells", "hellor", "helle", "kello" ],
  "first-char": 0,
  "last-char": 4,
  "bounding-box": {... },
  "items": [ ... ]
}

• Linefeed example, corresponding to the word \n:

{
   "label": "\n",
   "reflow-label": " "
}

Character object

A character object represents the recognition of a character made by the MyScript engine. Note that to get such interpretation in JIIX export, your need to set the export.jiix.text.chars configuration option to true.

It has the following properties:

Example:

{
  "label": "h",
  "candidates": [ "h", "k", "b", "H" ],
  "word": 0,
  "grid": [ {
    "x": 18.875834,
    "y": 31.736748
   }, {
    "x": 25.118258,
    "y": 31.736748
   }, {
    "x": 25.118258,
    "y": 44.957951
   }, {
    "x": 18.875834,
    "y": 44.957951
   } ],
  "bounding-box": { ... },
  "items": [ ... ]
 }

Lines object

A lines object represents the information about lines analyzed by the MyScript engine. It is present in the JIIX file when the export.jiix.text.spans or when the export.jiix.text.lines configuration option is set to true.

The export.jiix.text.lines allows to get the geometric information of the line:

The export.jiix.text.spans allows to get the line recognition information: The line is considered as a collection separated into several span elements, each span being associated with a specific content type. Thus each line consists in a label containing the recognition result associated with it and a spans object that is an array of spans. A span object has the following properties:

Example:

   "lines": [ {
     "first-char": 0,
     "last-char": 7,
     "baseline-y": 15.1058693,
     "x-height": 14.7235212,
     "label": "hello $2 + 3$",
     "spans": [ {
       "type": "Text",
       "bounding-box": {
        "x": -65.5972595,
        "y": -22.9333344,
        "width": 102.510544,
        "height": 41.6666679
       },
       "label": "hello"
      }, {
       "type": "Math",
       "bounding-box": {
        "x": 64.0636673,
        "y": -8.46666718,
        "width": 71.9609299,
        "height": 30.9333344
       },
       "label": "2 + 3"
      } ]
    }]

Style

The JIIX format can contain styling information. These encompass:

• CSS properties that you explicitly assign to the pen (dynamic styles)
• Style classes that you assign to the pen (pen style classes)
• Classes and styles automatically set by iink SDK when decorations are detected.

If you are exporting content, you need to set the export.jiix.style configuration key to true to get style information.

Item span styling

Blocks like Drawing and text/math/non-text raw content items can be seen as an ordered collection of strokes. Such a collection can be styled via the definition of “item spans”, each span associating a specific style to a range of items.

Item spans have the following properties:

For example, if we write 2 strokes with pen style class set to “greenThickPen” then 2 more strokes with no pen style class but pen style set to “color : #FF324233”, we obtain something like:

{
  "first-item": 0,
  "last-item": 1,
  "class": "greenThickPen"
}

and

{
 "first-item": 2,
 "last-item": 3,
 "style": "color: #FF324233"
}

Note that an item may be contain both class and style indications, or none of them if default styling applies.

Text span styling

Text blocks can be seen as an ordered collection of characters. Such a collection can be styled via the definition of “character spans”, each span associating a specific style to a range of characters.

Item spans have the following properties:

For example, text underlined by a gesture may get the following style:

{
 "first-char": 0,
 "last-char": 12,
 "class": "text-emphasis1",
 "style": "color: #000000FF; -myscript-text-decoration-color: #000000FF; -myscript-text-decoration-background-color: #FFED2666"
}

Nodes styling

Blocks like math and diagram nodes, as well as diagram connectors are independently styled.

They can directly have the following properties:

For example, a math node can be styled as follows:

{
 "type": "number",
 "id": "math/170",
 "label": "3",
 "value": 3,
 "items": [ ... ],
 "bounding-box": { ... },
 "class": "greenThickPen"
}

Blocks

This section lists all available blocks of the hierarchy, their properties and particularities, if any.

Container block

A block of type Container groups children blocks together.

It has the following specific property:

For example, in the JIIX export of a “Text Document” part composed of two paragraphs of text, each paragraph will correspond to a text block and both will be grouped as the children of a same container block:

{
 "type": "Container",
 "id": "MainBlock",
 "bounding-box": { ... },
 "children": [ {
   "type": "Text",
   ...
  }, {
   "type": "Text",
   ...
  } ],
 ...
}

Diagram block

A block of type Diagram groups together the different internal blocks of an individual diagram.

It has the following specific property:

For example, a diagram may be composed of a Text label and of a diagram Node corresponding to a rectangle:

{
 "type": "Diagram",
 "id": "4",
 "bounding-box": { ... },
 "elements": [ {
   "type": "Text",
   ...
  }, {
   "type": "Node",
   "kind": "rectangle",
   ...
  } ],
 ...
}

Diagram item blocks

Diagram item blocks collectively form a family of blocks of different types describing the semantic structure of a diagram: connectors, text blocks, geometric shapes, etc. There is no actual “Diagram Item” type.

These blocks share the following common properties:

Diagram nodes and connectors (i.e. with type node, edge or polyedge) will get the following styling properties:

Style is only present in then JIIX export when export.jiix.style is configured to true.

Example:

{
 "id": "diagram/3/242",
 "type": "Node",
 "parent": 12,
 "bounding-box": { ... },
 "items": [ ... ],
 ... specific properties ...
}

➤ Diagram and Raw Content Node block

An item of type Node is associated with a particular shape, an optional label, and may host child items. This is modeled by the following properties:

Depending on its “kind”, the item will have specific properties:

• If "kind": "rectangle"
  • x - X coordinate of the upper-left corner of the rectangle.
  • y - X coordinate of the upper-left corner of the rectangle.
  • width - Width of the rectangle.
  • height - Height of the rectangle.
  • orientation - x-axis rotation angle of the selection box of the rectangle (when shape rotation is active).
• If "kind": "rhombus"
  • points - Array containing the 4 {x, y} points describing the rhombus.
  • orientation - x-axis rotation angle of the selection box of the rhombus (when shape rotation is active).
• If "kind": "polygon"
  • points - Array of {x, y} points describing the polygon.
  • orientation - x-axis rotation angle of the selection box of the polygon (when shape rotation is active).
• If "kind": "circle"
  • cx - X coordinate of the circle center.
  • cy - Y coordinate of the circle center.
  • r - Radius of the circle.
  • orientation - x-axis rotation angle of the selection box of the circle (when shape rotation is active).
• If "kind": "ellipse" : an axis aligned ellipse.
  • cx - X coordinate of the ellipse center.
  • cy - Y coordinate of the ellipse center.
  • rx - X radius of the ellipse.
  • ry - Y radius of the ellipse.
  • orientation - x-axis rotation angle of the selection box of the ellipse (when shape rotation is active).
• If "kind": "doodle"
  • No specific property describes a doodle.
  • Note: As doodles are not converted, items will never contain shape primitives.

For example, the following node represents a rectangle in a diagram, associated with a text label:

   "type": "Node",
   "kind": "rectangle",
   "orientation": -0.0148907145,
   "label-element": "diagram/22",
   "children": [ "diagram/22" ],
   "id": "diagram/13",
   "bounding-box": {
    "x": 61.7742119,
    "y": 51.8420029,
    "width": 82.0821991,
    "height": 36.4551468
   }

➤ Diagram Edge block

A diagram item of type Edge connects other diagram items.

Example of a “straight” edge:

{
  "type": "Edge",
  "kind": "line",
  "connected": [ "diagram/12", "diagram/47" ],
  "ports": [ 0, 0.521515965 ],
  "id": "diagram/85",
  "bounding-box": {... },
  "x1": 81.9797897,
  "y1": 49.3274384,
  "x2": 146.199982,
  "y2": 55.2804871,
  "p2Decoration": "arrow-head"
}

Note that as a “line” connector, the edge includes x1, y1, x2 and y2 properties, defined the exact same way than in the case of line items.

Example of a “curved” edge:

{
  "type": "Edge",
  "kind": "arc",
  "connected": [ "diagram/10", "diagram/53" ],
  "ports": [ 0, 1 ],
  "id": "diagram/105",
  "bounding-box": { ... },
  "items": [ ...  ],
  "cx": 120.779442,
  "cy": 74.4197159,
  "rx": 32.6964035,
  "ry": 32.6964035,
  "phi": 0.00504867753,
  "startAngle": -1.82163024,
  "sweepAngle": 3.53351736,
  "endDecoration": "arrow-head"
  }

Note that as an “arc” connector, the edge includes cx, cy, rx, ry, phi, startAngle and sweepAngle properties, defined the exact same way than in the case of arc items.

➤ Diagram Polyedge block

A diagram item of type Polyedge connects other diagram items via several other edges. It is associated with the following properties:

Example of a polyedge gathering three edges together:

{
 "type": "Edge",
 "kind": "polyedge",
 "id": "diagram/65",
 "connected": [ "diagram/37" ],
 "edges": [ {
   "type": "Edge",
   "kind": "line",
   ...
  }, {
   "type": "Edge",
   "kind": "line",
   ...
  }, {
   "type": "Edge",
   "kind": "line",
   ...
  } ]
}

➤ Diagram Text block

A diagram item of type Text combines the properties of a diagram item and those of a Text Block. It is styled using text spans.

Drawing block

A drawing block gathers raw digital ink.

It can have the following specific properties:

Example:

{
 "type": "Drawing",
 "id": "7",
 "bounding-box": { ... },
 "items": [ ... ],
 "spans": [ ... ],
 "image": { ... }
}

Math block

A block of type Math is associated with the following property:

{
 "type": "Math",
 "id": "4",
 "bounding-box": { ... },
 "expressions": [ ... ]
}

Math Node block

A math node block describes a portion of a mathematical expression. Depending on the math node type, a math node may contain other math nodes, in the operands property.

Example:

{
 "type": "+",
 "id": "math/34",
 "items": [ ... ],
 "bounding-box": { ... },
 "operands": [ ... ]
}

➤ Fence Math block

Math nodes of type fence have the following specific properties:

➤ Matrix Math block

Math nodes of type matrix have the following specific properties:

➤ System Math block

Math nodes of type system have the following specific property:

Text Block

A block of type Text has the following specific properties:

Example:

{
 "type": "Text",
 "id": "7",
 "bounding-box": { ... },
 "label": "hello",
 "words": [ ... ],
 "chars": [ ... ],
 "spans": [ ... ]
}

Raw Content block

A Raw Content block corresponds to the output of raw digital ink analysis. It is meant to express the ink classification according to the [raw-content.classification.types][conf-raw-content] array, and the ink interpretation according to the [raw-content.recognition.types][conf-raw-content] array, as text, math and shape recognition results expressed as a hierarchy of items.

A block of type Raw Content has the following specific property:

Example of output:

{
 "type": "Raw Content",
 "bounding-box": { ... },
 "elements": [ {
   "type": "Node",
   "kind": "rectangle", ...
  }, {
   "type": "Text",
   "label": "hello", ...
  }, {
   "type": "Math",
   "expressions": ...
  }, {
   "type": "Raw Content",
   "kind": "non-text", ...
  } ],
 "id": "MainBlock",
 "version": "3"
}

➤ Raw Content Text item block

When a Raw Content Text item block contains inline math, the math is represented as an external Math item block. In addition to Text item blocks common properties, it also contains the following properties:

• The labels for the words, lines and spans have inlined math label delimited by $ where appropriate. The label for characters representing a Math item is an empty string.
• A word corresponding to inline math has a refs which gives the list of id of its corresponding Math items, and a reflow-label which is its label where \n has been replaced by space.

➤ Raw Content external Math item

In addition to Math item blocks common properties, a Raw Content external Math item contains a reference to its Text parent:

Example of output for a Raw Content with a Text block containing inline math:

{
{
 "type": "Raw Content",
 "elements": [ {
   "children": [ "raw-content/793", "raw-content/825" ],
   "id": "raw-content/511",
   "children-pos": [ 11, 13 ],
   "type": "Text",
   "label": "Operations $2+3$\n$7+12$ are additions",
   "words": [ {
     "label": "Operations",
     "candidates": [ "Operations", "operations", "Operatiions", "Dperations", "Operatios" ],
     "first-char": 0,
     "last-char": 9
    }, {
     "label": " $2+3$\n$7+12$ ",
     "refs": [ "raw-content/793", "raw-content/825" ],
     "first-char": 10,
     "last-char": 14,
     "reflow-label": " $2+3$ $7+12$ "
    }, {
     "label": "are",
     "candidates": [ "are", "we", "ae", "We", "Are" ],
     "first-char": 15,
     "last-char": 17
    }, {
     "label": " ",
     "first-char": 18,
     "last-char": 18
    }, {
     "label": "additions",
     "candidates": [ "additions", "aaditions", "auditions", "audition", "addition" ],
     "first-char": 19,
     "last-char": 27
    } ],
   "chars": [ ... ],
   "lines": [ ... ]
 }, {
   "parent": "raw-content/511",
   "id": "raw-content/825",
   "type": "Math",
   "expressions": [ ... ]
  }, {
   "parent": "raw-content/511",
   "id": "raw-content/793",
   "type": "Math",
   "expressions": [ ... ]
  } ],
 "id": "MainBlock",
 "version": "3"
}

Raw Content item block

In addition to common block properties, raw content item blocks also have the following specific properties:

Example:

{
 "type": "Raw Content",
 "kind": "text",
 "id": "raw-content/13",
 "bounding-box": { ... },
 "items": [ ... ]
}

Styling of a raw content item block is similar to Drawing for text and non-text blocks without the recognition enabled, otherwise it is similar as that of Diagram item blocks.

Math node complete overview

Recognizer blocks

Gesture block

A Gesture block corresponds to the output of Gesture Recognizer analysis.

In addition to common block properties, a Gesture block also has the following specific property:

Example:

{
  "version": "3",
  "type": "Gesture",
  "gestures": [ ... ]
}

gesture item block

In addition to common block properties, gestures item blocks also have the following specific properties:

Example:

"gestures": [ {
  "type": "surround",
  "strokes": [ {
    "id": "ps6",
    "bounding-box": {
     "x": 13.5319223,
     "y": 34.0388916,
     "width": 24.574482,
     "height": 16.1788025
    }
   } ],
  "bounding-box": {
   "x": 13.5319223,
   "y": 34.0388916,
   "width": 24.574482,
   "height": 16.1788025
  }
 } ]

Shape block

A Shape block corresponds to the output of Shape Recognizer analysis.

In addition to common block properties, a Shape block also has the following specific property:

Example:

{
  "version": "3",
  "type": "Shape",
  "elements": [ ... ]
}

Shape element

Shape elements contain the following properties:

Example:

{
 "bounding-box": { ... },
 "shape": { ... },
 "candidates": [ {...} ],
 "items": [ {...} ]
}

Shape item

Shape items contain the following properties:

Example:

  "shape": {
   "kind": "arrow",
   "primitives": [ {
     "type": "line",
     "x1": 97.8697891,
     "y1": 148.372635,
     "x2": 151.793411,
     "y2": 148.372635,
     "startDecoration": "none",
     "endDecoration": "arrow-head"
    } ]
  }

Shape primitive

Shape primitives content depend on the shape kind:

• line primitive

For triangle, isosceles triangle, right triangle, right isosceles triangle, equilateral triangle, quadrilateral, trapezoid, parallelogram, rhombus, rectangle, square, primitives are an array of line primitives representing their edges and contain the properties:

For line, polyline, double arrow, arrow, polyline arrow and polyline double arrow primitives are line primitives too, that contain the following additional properties:

• arc primitive

For ellipse, circle, arc of ellipse, arc of circle primitives are an arc primitive representing their edge and contain the properties:

For curved arrow and curved double arrowprimitive is an arc too, that contains the following additional properties:

Raw Content Recognizer block

It corresponds to the output of raw digital ink analysis and recognition made by the Raw Content Recognizer.

It is meant to express a classification of ink corresponding to ink interpretation as text, shape, math, decoration, or drawing type depending on recognizer.raw-content.classification value. Results are expressed as a hierarchy of items.

A block of type Raw Content has the common block properties, plus the following specific property:

Example:

{
 "version": "3",
 "id": "MainBlock",
 "type": "Raw Content",
 "bounding-box": {
    ...
 },
 "range": [
  { "from": { "stroke": 0 }, "to": { "stroke": 135 } }
 ],
  "elements": [ ... ]
}

• range

When the export.jiix.ranges configuration is enabled, every object in the JIIX file contains a range which is an array of ink intervals. An ink interval is defined by two ink cursors: from and to corresponding to its stroke indexes. The stroke index is the zero based index of the stroke of the object based on the sequence of pointer events composing the input of the recognizer.

Example:

   "range": [
    { "from": { "stroke": 0 }, "to": { "stroke": 105 } },
    { "from": { "stroke": 128 }, "to": { "stroke": 135 } }
   ],

• Text block object

Text recognition is performed by a new mixed math and text recognizer. So, a text block object may contain mixed math and text.

Text block objects are segmented into lines and each line is segmented into spans. They have a bounding box and the following specific properties:

Example:

{
 "type": "Text",
 "bounding-box": { ... },
 "range": [ ... ],
 "label": "The root of the quadratic equation\n$a x ^{2} + b x + c = 0$\nis given by the quadratic formula\n$x = \\frac{- b \\pm \\sqrt{\\Delta}}{2 a}$ where $\\bigtriangleup$ is the\ndiscriminant",
 "lines": [ ... ]
}

The item of type Line has a bounding box and the following specific properties:

Example:

{
     "type": "Line",
     "bounding-box": { ... },
     "range": [ ... ],
     "label": "$x = \\frac{- b \\pm \\sqrt{\\Delta}}{2 a}$ where $\\bigtriangleup$ is the",
  "spans": [ {
     "type": "Math",
     "bounding-box": { ... },
     "range": [
      { "from": { "stroke": 52 }, "to": { "stroke": 56 } },
      { "from": { "stroke": 128 }, "to": { "stroke": 135 } }
     ],
     "label": "x = \\frac{- b \\pm \\sqrt{\\Delta}}{2 a}"
    }, {
     "type": "Text",
     "bounding-box": { ... },
     "range": [
      { "from": { "stroke": 57 }, "to": { "stroke": 59 } }
     ],
     "label": "where"
    }, {
     "type": "Math",
     "bounding-box": { ... },
     "range": [
      { "from": { "stroke": 60 }, "to": { "stroke": 60 } }
     ],
     "label": "\\bigtriangleup"
    }, {
     "type": "Text",
     "bounding-box": { ... },
     "range": [
      { "from": { "stroke": 61 }, "to": { "stroke": 66 } }
     ],
     "label": "is the"
    } ]
}

• Math block item

Math recognition is done by the “Math” recognizer and therefore only returns recognition results as a LaTeX strings.

Math block objects are segmented into lines and each line is segmented into spans like Text block objects. See the section above for more details about lines and spans.

Example:

{
 "type": "Math",
 "bounding-box": { ... },
 "range": [ ... ],
 "label": "$\\Delta = b ^{2} - 4 a c$",
 "lines": [ ... ]
}

• Shape item block

A block of type Shape is similar to Shape block with optional range objects, when export.jiix.ranges configuration is enabled.

Example:

{
 "type": "Shape",
 "bounding-box": { ... },
 "range": [
  { "from": { "stroke": 106 }, "to": { "stroke": 109 } },
  { "from": { "stroke": 125 }, "to": { "stroke": 127 } }
 ],
 "elements": [
  {
   "bounding-box": { ... },
   "range": [
    { "from": { "stroke": 106 }, "to": { "stroke": 106 } }
   ],
   "shape": {
    "kind": "rectangle",
    "primitives": [ ... ]
   }
  },
  ...
  {
   "bounding-box": { ... },
   "range": [
    { "from": { "stroke": 126 }, "to": { "stroke": 127 } }
   ],
   "shape": {
    "kind": "curved arrow",
    "primitives": [ ... ]
   }
  } ]
}

• Decoration item block

When decorations are detected in the content (requires “decoration” item in the recognizer.raw-content.classification.types array) a Decoration block will appear in the elements of the Main block.

There are 3 types of decoration: “Underline”, “StrikeThrough”, and “Grouping”: A “Grouping” is a decoration that looks like text parentheses (, ), {, }, [, ], or | but groups other elements and may appear horizontally.

• When “decoration” is missing in the recognizer.raw-content.recognition.types array, the Decoration block contains at most one element for each type without further information.
• When “decoration” is present in the recognizer.raw-content.recognition.types array, the elements array lists each decoration separately with its type and, when type is “Underline” or “StrikeThrough”, the position of the fitted line segment as x1, y1, x2, y2.

Example:

{
 "type": "Decoration",
 "bounding-box": { ... },
 "range": [
  { "from": { "stroke": 174 }, "to": { "stroke": 178 } }
 ],
 "elements": [ {
   "type": "Grouping",
   "bounding-box": { ... },
   "range": [
    { "from": { "stroke": 174 }, "to": { "stroke": 174 } }
   ]
  }, {
   "type": "Grouping",
   "bounding-box": { ... },
   "range": [
    { "from": { "stroke": 175 }, "to": { "stroke": 175 } }
   ]
  }, {
   "type": "StrikeThrough",
   "x1": 20.9924412,
   "y1": 150.043182,
   "x2": 47.2008286,
   "y2": 150.043182,
   "bounding-box": { ... },
   "range": [
    { "from": { "stroke": 178 }, "to": { "stroke": 178 } }
   ]
  }, {
   "type": "Underline",
   "x1": 69.8855133,
   "y1": 74.2817154,
   "x2": 120.709824,
   "y2": 74.2817154,
   "bounding-box": { ... },
   "range": [
    { "from": { "stroke": 176 }, "to": { "stroke": 176 } }
   ]
  }, {
   "type": "Underline",
   "x1": 18.0531464,
   "y1": 88.0613861,
   "x2": 68.8774567,
   "y2": 88.0613861,
   "bounding-box": { ... },
   "range": [
    { "from": { "stroke": 177 }, "to": { "stroke": 177 } }
   ]
  } ]
}

• Drawing item block

A block of type Drawing corresponds to a block of ink that was not classified as one of the other content types. It contains the properties common to all blocks including optional range objects, when export.jiix.ranges configuration is enabled.

Example:

{
 "type": "Drawing",
 "bounding-box": { ... },
 "range": [
  { "from": { "stroke": 113 }, "to": { "stroke": 114 } },
  { "from": { "stroke": 120 }, "to": { "stroke": 120 } }
 ],
}