Krzysztof Klincewicz (Tokyo Institute of Technology; School of Management, Warsaw University) recently published [PDF download] a great first attempt at measuring the levels of innovation in open source projects. "First attempt" because, as Dr. Klincewicz finds, it's very difficult to measure what is, and what isn't, innovative, especially when so much value is attached to that word (and, hence, it is used far more than it should be).
His findings? Using a base of the 500 most actively developed SourceForge projects as his sample (or 3% of overall projects - 81%, or 89,557 registered projects are not active), Klincewicz finds that open source is not very innovative (Only 64 projects, or 12.8% of the sample, were not "direct imitations of existing solutions" (18), and "only 5 out of 500 SourceForge projects could be classified as technological breakthroughs" (20)), but a significant reason for this is the lack of "marketing" within the open source development community. That is, most open source projects (innovative and otherwise) die on the SourceForge "vine" for lack of recognition and outside contribution.
Also, and almost shockingly, 100% of the "radically innovative" projects were started from 1999 - 2001: not a single one has started since then. I guess I have to take back some of my sniping at the Valley. I'm assuming some of the boom-town euphoria of the bubble is what yielded the innovations that Klincewicz finds....
Additional findings:
"...[M]any of [the open source community's] development efforts are focused on improving and complementing the Linux platform. Even though certain applications may exist for Windows users, they need to be "re-invented" in the other operating system environment. These re-inventions are not radical technological breakthroughs, as similar benefits and functionality are already available for alternative platforms." (7-8)
MNA: It turns out that most open source projects either do the same "new" function, or they're merely re-inventions of old technology on a new platform. Innovative in a way? Sure. But not the kind of innovation most of us associate with the denotation of the word. Here's the specific data:

Why do we see this? Are open source developers simply mindless sheep? I don't think so, and neither does Klincewicz. He laments that the high percentage of "me-too" functionality "creates unnecessary competition for scarce resources within the OSS developer community" (19). But he also finds that the highly formalized decision-making processes within open source communities discourages new concepts, as "[i]t is easier to fork the code...than to convince project decision makers to implement certain ideas" (19).
Strikingly, despite this apparent dearth of innovation (at least, on SourceForge - keep in mind that many of the most popular projects migrate from SourceForge to their own hosted forges), "Innovative projects are significantly more popular among developers than "me-too" solutions" (21). (However, given his own data, I'm not sure how he arrives at this conclusion. His conclusion only holds if you add in the SourceForge project itself, which receives a hugely disproportionate number of feature requests, relative to the other innovative projects he identifies - see page 21).
But if you accept his conclusion, it's clear that developers prefer innovation (why work on the mundane?), but it's simply hard to find it on SourceForge (due to the lack of marketing/discovery resources he identifies and which I mentioned above) (See page 25).
Looking deeper into the identified innovative projects, Klincewicz finds that
"40% of breakthroughs came from company-initiated projects, and 50% of technology modifications grew out of academic research, while community-driven initiatives were in turn more focused on platform modifications and marketing innovations" (22).
In other words, much of the new, innovative functionality on SourceForge comes as "feature gifts" from those (companies and academics)
outside the open source development community, as traditionally described/conceived. (22)
Time to wring our hands and give up? No. Instead, I think it's time to redefine the open source community, as well as to be a bit more pragmatic about what open source does well, and what it doesn't. For one thing, as Klincewicz notes, all of this bottoms-up commodification has a significant, positive benefit on innovation generally: it forces proprietary firms to race to innovate ahead of the commodification curve (as Larry Augustin
detailed [PDF] at the first
Open Source Business Conference). Or, as Klincewicz notes, "one could even suggest...that these powerful commoditization mechanisms stimulate more innovation in proprietary than in open software domains" (25; see also Joel West's work).
Assuming this is all true,
it means that the most successful open source companies will be those who can create communities to match their projects. In the past, it has been sufficient to find a good project (e.g., Linux), build a support company around it, and fight like mad for branding. This is, in effect, the
Red Hat story.
But much of the new functionality, the new open source applications (ECM, ERP, CRM, etc.) will not come from the community, as
traditionally defined. It will, almost of necessity, come from companies. Why necessity? Because companies, fueled by VC dollars, can afford the project promotion that Klincewicz finds lacking in the existing open source development community. Again, it's not a question of whether open source
can innovate. It's more a question of how to help others hear about it, such that a vibrant community can grow up around it. This is where money is helpful.
Here's to the future community builders, corporate and otherwise.
(And here's a look at some additional interesting data from Klincewicz's research):