By Martin Brampton, 18 August 2008 14:28
COMMENT
For open source software to achieve its full potential, people's perceptions must change. Yet how can that happen when open source is so woefully neglected by analysts, asks Martin Brampton.
Industry analysts can play a valuable role. But their shortcomings are particularly evident in their coverage of open source software. And, apart from analysts, what viable alternative information sources exist?
The Brampton Factor
Read the unvarnished truth from one of silicon.com's top columnistsÂ…
Is there really a skills crisis?
Licensed to bill - software licences have gone too far
Open source brotherhood closed to co-operation
Do great firms innovate?
Why big government IT projects fail![]()
Despite their critics, analysts at their best can bridge a significant gap between vendors and software users. Vendor marketers who create information for prospective customers are understandably sales-driven and rarely grasp how their products are deployed.
The result tends to be material strong on superlatives and weak on substance. Certain features are emphasised while the processes involved in implementation are largely ignored, even though these may be more significant and costly than the software itself.
Users, on the other hand, have a deep understanding of their own problems but cannot always put it into a wider perspective. They have difficulty seeing the direction technology is taking, a direction influenced by a complex mixture of technical and commercial factors.
This gap leaves an opening for analysts, who should be relatively neutral about the success or failure of products or vendors, to stand back and form a view of the trends.
Provided analysts can also stay close to the practicalities of implementation, they can translate product features and trends into strategies capable of successful deployment. All this helps IT as a whole.
Of course, the limitations of the analysts have become well known. Researching, writing and speaking on IT involve a good deal of hard work, for which analysts want payment. Revenues have always come from vendors as well as users and ideally were more or less balanced to avoid undue influence from either side.
But analysts have not always kept the balance, and services such as free conferences have been provided on the back of payments from vendors.
Over time, it has become increasingly difficult to generate revenue from users, throwing the analysts into the arms of the vendors. Some analysts have gained a reputation for being little more than vendor mouthpieces.
A small number of analysts have adopted what they describe as an open source model for much of their writing, releasing information freely. This approach inevitably involves a reliance on generating some kind of fee-earning work and only a limited number of analysts are able to achieve this combination.
Within the smaller analyst houses there is often a feeling that efforts are inadequately rewarded. And the notion of open source analysis is only loosely connected with open source software.
The general reliance on vendor cash clearly leaves most open source software out in the cold. That lack of coverage is a pity because there is much high-quality software in the sector and it is sometimes developed rapidly as skilled software writers join successful projects.
But open source projects rarely have significant funding to afford commissioning analysts. That lack of coverage compounds a problem with the presentation of open source software.
Unlike commercial software, where claims are grandiose but vague, nearly all open source products are described in detailed technical terms.
In both cases, the putative user is left unable to discern how the product might solve actual problems. The honourable exception to this tendency perhaps includes the successful dual licensed products, such as MySQL, that straddle the open source and commercial worlds.
In principle, this is a clear opportunity for industry analysts, who have the skills to translate the technical representations of open source developers into the practical conceptions that are understood by potential users.
In fact, sophisticated users are painfully aware of the need for analyst coverage of open source. Despite the excellence of much open source software, there is often management prejudice against non-commercial software, and independent commentary is a useful balancing factor.
A few analysts have indeed made an effort in this direction but are finding it a struggle. Large vendors can make life a lot easier for analysts. They have staff dedicated to analyst relations and are able to provide a range of helpful meetings and backup material.
Exclusive column: The Naked CIO
See what this CIO really thinksÂ…
The Naked CIO: Why boards get IT spend so wrong
The Naked CIO: Tech's weasel words
The Naked CIO: Poisoned BlackBerrys
The Naked CIO: Enemies of the state
The Naked CIO: Service level disagreements![]()
Open source projects cannot usually afford these luxuries. Another problem for analysts treading the open source path is that smaller analyst firms find it very difficult to secure substantial advisory business from large user companies.
What alternatives are there for making sense of the already vast and rapidly proliferating world of open source software? A variety of information exchanges are growing up, although many more are started than ever thrive.
An example that is showing more signs of life than most is Ohloh. But because of the sheer number of projects, if exchanges present any comparative information at all, it is normally based on crude automated metrics.
As a result, even someone committed to working largely in the open source sector finds it hard to identify relevant projects to meet a particular need. They are often stumbled upon largely by chance, and evaluation is usually hit and miss, limited by the time available to achieve practical results.
What is ideally needed is a shift in attitude by buyers and especially larger buyers. Every open source project is by no means a success but the open source model is a powerful way to deliver very high quality software.
It is also very efficient, partly because it eliminates many of the most costly overheads of software production and partly because of its ruthless "evolutionary" character that stems from the impact of the main open source licences.
So long as people see open source simply as free software, it has little chance of reaching its full potential. As in many other areas of IT, buyers would serve their own best interests by putting more resources into encouraging the most valuable sources of innovation and development.
And that might include spending a lot more money on good analyst coverage of open source software, funding analysis that steers between the rocks of empty rhetoric and arcane technology to reveal true value.

Comments
There are 3 comments. Join the discussion
1. Richard
Perhaps major potential customers could help sponsor information about open-source projects?
Also, what about UK universities or the "profession"?
The UK government and its OGC seem very passive and very prepared to accept marketing hype from large commercial suppliers - and to spend our money on their commercial offerings.
2. Louis Chua
Don't vendors companies such as IBM, Red Hat, Novell, etc commission analysts?
3. Dennis Byron
You don't sound like one of the open-source fringe bloggers, Martin, but this article reads like you believe their blogoblather.
First, when you make such a claim you should name names. The reputable "analysts" (I assume you mean firms but it is true of the individual analysts I know as well) have been covering open source for decades.
Second, define "fail." Can you be more specific? It appears the analysts just don't say what you would like them to say?
You allege "The general reliance on vendor cash clearly leaves most open source software out in the cold" but it is the lack of market acceptance of those projects that pushes them to the bottom of analysts' inbox, not payoffs. And the same happens to hundreds of software products marketed with non-open-source Ts&Cs. For example, I am currently preparing an article on the fastest growing 100 software companies in the U.S. None are household names among analysts, and I haven't found any yet that use open source Ts&Cs (conclusion pending completion of the research).
However I agree with your complaint that analysts have left a gap in terms of too much feature/function analysis (and market share comparisons) and not enough emphasis on holistic case studies that look at the total software life cycle. But I don't think that is an open source issue; it is true in terms of analyzing the entire software market.