How to Measure Innovation?

"Innovation is devilishly difficult to measure. So how do we do it?

A valuable metric in this area must begin by cutting through a tangle of definitions:

Some see innovation only as industry-disrupting bombshells; others believe it applies to "whatever is new to me."

 

For the Drucker Institute's company rankings, which form the basis of the Management Top 250, we use one standard: Innovation means, as management scholar Peter Drucker put it, "endowing human and material resources with new and greater wealth-producing capacity." Novelty is a side effect of innovation, not its essence.

 

This holds true whether a company revolutionizes how an industry creates value for customers -- like Amazon.com Inc., which tops our innovation category in 2021 -- or simply reduces the bureaucratic burden on knowledge workers.

 

Underlying this broad definition are four principles, also drawn from Mr. Drucker's work, that characterize innovative companies: They create systems for continuous improvement of products, services and internal processes. They exploit their successes. They stop doing things that no longer provide sufficient value. And they "create the different tomorrow that makes obsolete and, to a large extent, replaces even the most successful products of today," in Mr. Drucker's words.

 

By measuring these four criteria through a total of 11 indicators, our rankings are able to capture the variation in innovative performance among organizations. (To account for the differences in how innovation happens across industries, we score every company in this category relative to its industry's average.)

And the variation in performance is vast. From 2017 to 2021, our innovation scores have had a markedly wider range than any other category in our model -- customer satisfaction, employee engagement and development, social responsibility or financial strength. Though the typical range of our scores is 0 to 100 with a mean of 50, innovation is the only area in which companies routinely shatter the upper bound.

In 2019, Amazon posted the highest-ever innovation score in our rankings, with a 212.3. The lowest innovation score for any company since these rankings began is 37.9.

Some analysts use a technique called "winsorization" to reel in extreme outliers that can distort a model's picture of the overall population. But the Drucker Institute has steadfastly avoided winsorization in the innovation category for one reason: It would mask real differences in how well the largest public companies in the U.S. manage this crucial area. At 8-foot-11, the tallest person ever recorded, Robert Wadlow, was to height as Amazon is to innovation -- an off-the-charts achievement that deserves an accurate measurement.

The 11 different innovation indicators help us not only to define and measure corporate innovation but also to discern the differences behind the overall scores in this category.

In 2021, for example, International Business Machines Corp.'s innovation score of 115.6 trails only Amazon (155.0) and Microsoft Corp. (136.2). IBM's best score on an innovation indicator is a stratospheric 141.5 for its number of patent applications. But its patent value score -- based on a measure of the stock market's reaction to approved patent applications -- is almost exactly average, at 50.2.

By contrast, Procter & Gamble Co. -- No. 18 on our innovation list with a score of 78.1 -- is particularly strong in patent value and patent abandonment, with the latter giving a sense of whether a company follows Mr. Drucker's principle of ending what no longer contributes to performance.

 

To get a complete picture for each company's innovation score, we count patent and trademark applications and trademark registers, and use an analysis of how well a company manages innovation across its supply chain. Each is a signal of continuous improvement, the systematic exploitation of successes and attempts to "create the different tomorrow."

 

We assess R&D spending and hiring, as well as hiring in cutting-edge fields such as robotics and artificial intelligence, because they are essential tools for making today's successes obsolete. We look at the sale or release of patents as marks of a culture that embraces organized abandonment.

 

Finally, we consider the market's valuation of a company's patents, whether certain reputable publications deem a company "most innovative" and how consumers rate a company's performance in innovation. This is because no innovation metric can be complete without the voices of the ultimate judges: investors, industry experts and, above all, the customers every business is vying for." [1]

 

It is worthwhile for the Lithuanian government to apply this methodology in order to find out which Lithuanian companies should be supported with state and European Union money. 

1. C-Suite Strategies --- How to Measure Innovation? Here's How We Do It: In the 2021 ranking, Amazon, Microsoft and IBM lead the way. The difference between those at the top and those at the bottom is huge.
First, Zachary. Wall Street Journal, Eastern edition; New York, N.Y. [New York, N.Y]. 13 Dec 2021: R.2.