The technology industry continues to be a hotbed of patent innovation. Activity is driven by the amalgamation of technological progress, heightened connectivity, and the urgency for businesses to enhance efficiency and competitiveness in an ever-changing marketplace, and growing importance of technologies such as artificial neural networks, convolutional neural networks, and deep q-networks (DQNs). These technologies represent a subset of the tools and techniques used in deep reinforcement learning. In the last three years alone, there have been over 4.1 million patents filed and granted in the technology industry, according to GlobalData’s report on Artificial intelligence in technology: deep reinforcement learningBuy the report here.

However, not all innovations are equal and nor do they follow a constant upward trend. Instead, their evolution takes the form of an S-shaped curve that reflects their typical lifecycle from early emergence to accelerating adoption, before finally stabilizing and reaching maturity.

Identifying where a particular innovation is on this journey, especially those that are in the emerging and accelerating stages, is essential for understanding their current level of adoption and the likely future trajectory and impact they will have.

190+ innovations will shape the technology industry

According to GlobalData’s Technology Foresights, which plots the S-curve for the technology industry using innovation intensity models built on over 1.5 million patents, there are 190+ innovation areas that will shape the future of the industry.

Within the emerging innovation stage, GenAI for design, finite element simulation and deep reinforcement learning are disruptive technologies that are in the early stages of application and should be tracked closely. 3D model simulation, drone controls AI, and circuit designing AI are some of the accelerating innovation areas, where adoption has been steadily increasing.

Innovation S-curve for artificial intelligence in the technology industry

Deep reinforcement learning is a key innovation area in artificial intelligence

Deep reinforcement learning is a field within machine learning that merges reinforcement learning (RL) with deep learning techniques. It leverages deep neural networks to understand and process information from intricate input and output domains. Through deep reinforcement learning algorithms, agents can acquire sophisticated behaviours by directly learning from raw sensory inputs like images or videos. The ultimate objective of deep reinforcement learning is to develop autonomous agents that can effectively interact with their surroundings and optimise their actions based on the rewards they receive.

GlobalData’s analysis also uncovers the companies at the forefront of each innovation area and assesses the potential reach and impact of their patenting activity across different applications and geographies. According to GlobalData, there are 40+ companies, spanning technology vendors, established technology companies, and up-and-coming start-ups engaged in the development and application of deep reinforcement learning.

Key players in deep reinforcement learning – a disruptive innovation in the technology industry

‘Application diversity’ measures the number of applications identified for each patent. It broadly splits companies into either ‘niche’ or ‘diversified’ innovators.

‘Geographic reach’ refers to the number of countries each patent is registered in. It reflects the breadth of geographic application intended, ranging from ‘global’ to ‘local’.

Patent volumes related to deep reinforcement learning

Company Total patents (2010 - 2022) Premium intelligence on the world's largest companies
Royal Bank of Canada 18 Unlock Company Profile
GoerTek 4 Unlock Company Profile
Siemens 8 Unlock Company Profile
Alibaba Group 7 Unlock Company Profile
Rakuten Group 3 Unlock Company Profile
Bank of America 3 Unlock Company Profile
NCsoft 4 Unlock Company Profile
ADOBE 17 Unlock Company Profile
Mitsubishi Electric 12 Unlock Company Profile
Canon 16 Unlock Company Profile
Omron 2 Unlock Company Profile
Telefonaktiebolaget LM Ericsson 12 Unlock Company Profile
Bayerische Motoren Werke 2 Unlock Company Profile
Nippon Telegraph and Telephone 3 Unlock Company Profile
IBM 18 Unlock Company Profile
Denso 4 Unlock Company Profile
NEC 14 Unlock Company Profile
Intel 7 Unlock Company Profile
Ebara 7 Unlock Company Profile
Saltlux 3 Unlock Company Profile
Snap 4 Unlock Company Profile
Pure Storage 6 Unlock Company Profile
Riiid 4 Unlock Company Profile
ROKIT 4 Unlock Company Profile
PlusAI 7 Unlock Company Profile
PlusAI 9 Unlock Company Profile

Source: GlobalData Patent Analytics

IBM and Royal Bank of Canada are among the leading patent filers in deep reinforcement learning. Other prominent patent filers in the space include ADOBE, Canon, and NEC.

By geographic reach, PlusAI leads the pack, followed by Ebara and Pure Storage. In terms of application diversity, ROKIT holds the top position, followed by Pure Storage and Denso

Deep reinforcement learning can handle high-dimensional data, learn complex behaviors, facilitate end-to-end learning, enable transferability and generalization, and drive advancements in various real-world applications, ultimately pushing the boundaries of AI research and development.

To further understand how artificial intelligence is disrupting the technology industry, access GlobalData’s latest thematic research report on Artificial Intelligence (AI).

Data Insights

From

The gold standard of business intelligence.

Blending expert knowledge with cutting-edge technology, GlobalData’s unrivalled proprietary data will enable you to decode what’s happening in your market. You can make better informed decisions and gain a future-proof advantage over your competitors.

GlobalData

GlobalData, the leading provider of industry intelligence, provided the underlying data, research, and analysis used to produce this article.

GlobalData’s Patent Analytics tracks patent filings and grants from official offices around the world. Textual analysis and official patent classifications are used to group patents into key thematic areas and link them to specific companies across the world’s largest industries.