Kofax has been granted a patent for systems, computer program products, and methods for intelligent screen automation. The invention involves determining relationships between textual and non-textual elements in user interface images, building a hierarchy, and outputting the data structure to memory. GlobalData’s report on Kofax gives a 360-degree view of the company including its patenting strategy. Buy the report here.

According to GlobalData’s company profile on Kofax, was a key innovation area identified from patents. Kofax's grant share as of February 2024 was 82%. Grant share is based on the ratio of number of grants to total number of patents.

Intelligent screen automation system for user interfaces

Source: United States Patent and Trademark Office (USPTO). Credit: Kofax Inc

A recently granted patent (Publication Number: US11886799B2) discloses a computer program product designed to determine functional and descriptive elements of application and interface images. The product includes computer-readable program instructions that enable a processor to identify logical relationships between textual and non-textual elements in user interface images. By building a hierarchy based on these elements' coordinate positions, a data structure representing the interface's functionality is formed and outputted to memory. The data structure includes attributes such as element coordinates within the images, facilitating a comprehensive understanding of the interface's structure.

Furthermore, the patented computer program product can identify specific elements within the images, such as table borders, check box elements, rectangular elements, radio button elements, icon elements, and line elements. By applying various criteria and thresholds, the program filters and categorizes these elements to establish logical relationships within the interface. This methodical approach ensures a detailed analysis of the interface components, enabling the creation of a tree structure that accurately represents the hierarchy of textual and non-textual elements. Overall, the patented technology offers a systematic and efficient way to analyze and organize elements within user interface images, enhancing the understanding of interface functionality and design.

To know more about GlobalData’s detailed insights on Kofax, buy the report here.

Premium Insights


The gold standard of business intelligence.

Blending expert knowledge with cutting-edge technology, GlobalData’s unrivalled proprietary data will enable you to decode what’s happening in your market. You can make better informed decisions and gain a future-proof advantage over your competitors.


GlobalData, the leading provider of industry intelligence, provided the underlying data, research, and analysis used to produce this article.

GlobalData Patent Analytics tracks bibliographic data, legal events data, point in time patent ownerships, and backward and forward citations from global patenting offices. Textual analysis and official patent classifications are used to group patents into key thematic areas and link them to specific companies across the world’s largest industries.