Tell me more ×
Answers OnStartups is a question and answer site for entrepreneurs looking to start or run a new business. It's 100% free, no registration required.

I am curious on how some of you adopt data-driven approach to your startups.

Recently, i did an experiment with simple AB testing tool like A/Bingo: http://www.bingocardcreator.com/abingo/

Through that, i found that majority of our traffics are search engine's spider.

Example: instead of 100 visitors with 10% conversion rate (10 users), it become 10000 visitors and 0.001%. 9900 "visitors" are spiders.

How do you handle that? Any tools you would recommend?

It would be great if you have any reference to blog post or article that explain in detail on how to adopt data-driven approach to startups.

PS. Have been reading heaps about Dave McClure AARRR, Eric Ries, Andrew Chen, Mix Panel etc. I am looking for "more specific, with real-world scenario" kind of example.

Thank you.

share|improve this question
+1 I'd love to learn more about that too. – Slav Ivanov Nov 15 '09 at 4:00

3 Answers

I think robots.txt works well with "genuine" bots, and evil bots can be handled using htaccess rules.

See robots.txt examples from some top sites -

See this for .htaccess rules - http://www.webmasterworld.com/forum13/687.htm

share|improve this answer
Robots.txt. Isn't that also affect my search ranks in Google? – Hendro Wijaya Nov 16 '09 at 3:18
Yeah, they're likely to go up up up. ;) cuz you will be blocking duplicate and canonical pages. – Arpit Tambi Nov 16 '09 at 5:53

Use a web analytics tool that's Javascript-based -- those aren't triggered by search bots.

Beyond that, you'll have to discard all results from search engines. Maybe Patrick can help make that change to A/Bingo.

P.S. +1 on the robots.txt

share|improve this answer
Thanks. I just know that JS-based analytics aren't triggered by search bots. – Hendro Wijaya Nov 16 '09 at 3:20
up vote 0 down vote accepted

Here's what i found recently about adopting data-driven method. it helps articulate the concept a bit:

share|improve this answer

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.