Is screen-scraping making it tough to do business?
By Dan Ilett
Published: 13 June 2006 10:50 GMT
Financial services companies are blocking price comparison websites from publishing their product information because they fear coming bottom of the league tables.
Companies are using IP blocks to prevent websites from grabbing their data and using it to show consumers which company has the cheapest product.
Martha Bennett, vice president at analyst Forrester, told silicon.com: "I know they block them. Companies don't want to be driven into this price competition."
The technique used to grab the data is called 'screen-scraping', which does the donkey work for users by displaying information from several websites in one place.
For example, in order to compare insurance quotes a user has to type in their information just once and the screen-scraper will bring back results from 20 companies.
One price comparison website, moneysupermarket.com, confirmed some brands have taken the decision "not to engage with any aggregators".
A spokesman for moneysupermarket.com said: "Some of them refuse to be compared. They can block the IP. Without a doubt comparison is here to stay. They have to learn to live with that.
"In the early days quite a lot of providers were firmly against it. But people have realised we are going to do it. It can be a little uncomfortable for them. One or two companies have [blocked us]. At one point we though this could be a major problem."
Forrester's Bennett added: "The companies that block don't really stand to gain. You have to say to them 'sorry guys but the industry is changing'. For simpler products consumers are increasingly getting more competitive deals if they know what they after.
"Companies should make sure they make some information available. Consumers might know your brand name but wonder why your name never comes up on a comparison search."
It is surprising to see that there are companies o...
Carel Kriel
Price and service aggregation sites are a real pro...
Ainsley Ward
The companies that block don't seem to realise the...
Colin Thomson
You will be responsible for driving the proactive design to prevent incidents, for auditing implementations to ensure we are secure and for ensuring ...
s design and usability, plus implementing and undertaking a digital marketing strategy including utilising Search Engine Optimisation, Search Engine ...
My client are a creative mobile agency helping brands use the mobile channel to engage with their consumers. iPhone Developer - London, J2ME, Android ...
Agenda Setters 2009
Welcome to the ninth annual Agenda Setters poll – silicon.com's list of the top 50 most influential individuals in the technology and IT industries, from techies and CIOs to entrepreneurs and business leaders. Find out more in our latest special report.
Stories from the web...
Copyright © 2008 CBS Interactive Limited. All rights reserved. Top of page
Tim Ferguson
On a new Voyager, tackling fraud and the intellectual challenge
Interview: Nationwide IT director, Peter Stafford
Nick Heath
David Lister on smart grids and why he left RBS
Interview: National Grid CIO
Andy Jones
Why banks will push ahead with offshoring
Comment: Even if they don't want to
Catherine Stagg-Macey
Legacy IT holding back insurers
Comment: Economic crisis means finance giants must step lively
Julian Goldsmith
The City fund manager with no IT department
Q&A: How asset management is embracing the cloud...
Peter Cochrane
Peter Cochrane's Blog: How tech can solve the banking crisis
Bring on a machine-based economy