Extract layout-aware content from image

Supported in: Batch, Faster

Extracts layout-aware content from an image. Returns structured blocks with bounding boxes, text content, and block types. Supports configurable output formats.

Expression categories: Media

Declared arguments

  • Languages to detect: Languages to detect in the image.
    Set<Enum<Afrikaans, Albanian, Amharic, Arabic, Armenian, Assamese, Azerbaijani, Azerbaijani - Cyrilic, Basque, Belarusian, and more ...>>
  • Media reference: The column containing media references to image files in a media set.
    Expression<Media reference>
  • Scripts to detect: Scripts to detect in the image.
    Set<Enum<Arabic, Armenian, Bengali, Canadian Aboriginal, Cherokee, Cyrillic, Devanagari, Ethiopic, Fraktur, Georgian, and more ...>>
  • optional Error handling: Determines the behavior of the pipeline for inputs that fail to process.
    Enum<FAIL, NULL>
  • optional Output format: The format of the extracted text content within blocks.
    Enum<HTML, Markdown, Text, hOCR>

Output type: Array<Struct<block_index, block_id, block_type, content, bounding_box, languages<String>, confidence>>

Examples

Example 1: Base case

Argument values:

  • Languages to detect: {ENG}
  • Media reference: mediaReference
  • Scripts to detect: {}
  • Error handling: FAIL_FAST
  • Output format: TEXT
mediaReferenceOutput
{"mimeType":"image/png","reference":{"type":"mediaSetItem","mediaSetItem":{"mediaSetRid":"ri.mio.main.media-set.a", "mediaItemRid":"ri.mio.main.media-item.a"}}}[ {
 block_id: block-0,
 block_index: 0,
 block_type: Text,
&...