Tell me more ×
Answers OnStartups is a question and answer site for entrepreneurs looking to start or run a new business. It's 100% free, no registration required.
up vote 5 down vote favorite
2

There are several services like SpyFu, AdBeat & ispionage which advertise they can provide the keywords, budget, ad copy and other information which competitors use in different ad networks like Google, Bing.. etc. This seems like inside information.

1- How do these services get their information? Do they monitor the ads for extended periods of time and figure stuff out?

2- Are there any open source projects which are based on similar functionality?

share|improve this question

2 Answers

up vote 2 down vote

Most use some sort of bot to scrape results, which monitors a set of keywords and see's what ad's appear. They are very much just a "guessing tool" as unless they have a genuinely massive crawler system with regional presence they are just seeing regional ads for the area the crawler is in. They are also ratcheting up the number of impressions over the period of time they are running, so maybe in some ad system increasing the Cost especially as ad's with low click through rates tend to get lower quality scores resulting in higher clicks, the longer the period of time the more likely they are to get a relative basic picture of competitors. Very much an industry he with the largest database of keywords and searches will have in theory the best chance of being closest in the guessing game.

You may find this article http://www.seoptimise.com/blog/2008/09/4-ways-fool-your-competitors-using-spyfu.html of some use to you. As for open source alternatives, their are plenty of scrapers out their that can be used.

share|improve this answer
Thanks. As for the open source project I wasn't looking for just a scraper (didn't even had in mind it's a scraper) but more of a total system. – Tony_Henrich Feb 5 '11 at 6:47
I would be surprised if their was simply as its not really a unique product, most of these systems are just a scraper and large databases with a tiny bit of math in an exceptionally tiny niche and one where people doing this sort of analysis will either build their own or purchase the services of others. – Tim Nash Feb 5 '11 at 13:31
up vote 0 down vote
  • Prepare a list of words and phrases. Some Natural Language Processing knowledge is required here.
  • Extract from Google what phrases have higher advertising costs.
  • Sort by advertising cost and regularly search Google for most expensive phrases.
  • Scrap search results and fill in database.
  • Make some model that allows to predict exact result based on sparse sample.
  • Predict for all phrases and words.

... or something similar.

Some services collect data directly from Internet users via toolbars that spy on search results.

share|improve this answer
"Some Natural Language Processing knowledge is required" to prepare a list of words and phrases? Can you clarify? – tucson Feb 8 '11 at 19:42
You have to select some phrases to feed you model. Most probably have to analyze word, bigram (trigram) frequency table to select most frequent of them. – Ross Feb 9 '11 at 7:06
Generally you need at lest frequency of search terms. – Ross Feb 9 '11 at 7:11

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.