Yahoo Slurp is a flood machine!

Let me start with a simple question! Why should I pay monthly for a service that is useless? Actually I don’t pay Yahoo to crawl and show my websites into their stupid search engine (this is free) but I must say that I am paying for bandwidth and resources for my dedicated server. Here is the problem! I have two article directories, each one with at least 100000 free articles and it is normal that some web crawlers to crawl my websites, but Yahoo’s crawler is a bit insupportable because of the flood it does. Yahoo Slurp was present on my website every minute, every day, crawling all my articles with an entire class of ips, ips starting with 74.6.*.* and 67.195.*.* .

You have the results bellow, in a printscreen from my awstats. Compare Yahoo to Google, given the fact that Yahoo is not sending any traffic and Google is sending 70% of my traffic.

Yahoo Slurp is crawling and flooding dedicated servers in the same time

  • Yahoo : 81069 Hits | 6.37 GB Bandwidth
  • Google : 18126 Hits | 239.73 MB Bandwidth

The solution for this problem is simple. Ban Yahoo’s ips on your server using htaccess or by using Ip deny manager from your cpanel/plesk administration center.

I added the following code to my .htaccess file to ban Yahoo’s ips:

 order allow,deny
 deny from 67.195.
 deny from 74.6.
 allow from all

You should take this in consideration if you are hosted on a shared plan, because cpu and memory resources are limited and after all Yahoo isn’t so important.

Recent comments on Acosmin dot Com

The Untraceable movie for web developers

It is two o’clock and I finished watching an interesting movie called “Untraceable”. Thought it is not a good movie to watch at night, it was fascinating because it includes some interesting topics like Internet, hacking, FBI which I enjoy, excluding the part with killing people and video streaming the crimes online. Here is a little summary from imdb, you can read more about this movie here:

“FBI agent Jennifer Marsh is tasked with hunting down a seemingly untraceable serial killer who posts live videos of his victims on the Internet. As time runs out, the cat and mouse chase becomes more personal.”

killwithme-movie.jpg

Unfortunately some people enjoy watching on the Internet gore and disturbing content and in my opinion they are lunatics, but that is their problem as long as I don’t meet them on the street :) . The fact is that this movie, “Untraceable”, was promoted and is promoting a website called killwithme.com. In the movie this website is the place where the psycho hacker was broadcasting live his crimes and in the real world, this is the website that promotes the movie (the official website), with an interesting marketing strategy. As you can see bellow in the alexa ranking charts, killwithme.com has two periods of time when it was highly browsed, on 25 January 2008 when ”Untraceable” was released in USA and this period of the month (April) when the movie was released in other countries, on DVD’s or blu-ray rips especially.

killwithme-alexa-rankings.jpg

As you can see the traffic and alexa rank for this website is increasing and a funny thing is that most of the users come from the United Kingdom and not from USA where all the action happened and where the movie was released. Maybe the United Kingdom has more psychos, just joking! :)

It is interesting how a movie like this is able to create buzz, based on the fact that somewhere out there, there is an audience interested in a specific topic, prepared to spread the “news” worldwide. This method is called word of mouth marketing (WOMM) and it is great if you know how to use it. I have an idea and I think I’ll develop a website soon; don’t worry, I am not a killer lol :D .

Overall “Untraceable” is a great movie and I recommend you watch and analyze it, because who knows, maybe you’ll get an idea for a new website and just remember this: you are a web developer, not a killer. :P

Read the rest of this entry »

Creating fresh content for niche blogs – How to be informed all the time

There is an old saying in internet marketing that “Content is king” but bloggers nowadays have a big problem with getting information, so some of them give up writing articles for this particular reason (I am talking about niche blogs). I had the same problem a year ago, but today I can say that there are so many ways to stay informed and you can blog about anything, because you only need a main idea and a few more resources to write a great article for your niche blog. So from my experience here are a few methods to keep up to date with the new information from your niche.

Google news or blogsearch – great tools in combination with any feed reader

Yes, google news because it provides fresh information every hour, day and in combination with a rss feed reader you are ready anytime to write on your blog about anything. All you need is a keyword in which you are interested in (from your niche) and the fresh news will be brought into your reader. I made a little video tutorial so you can see the exact steps for this method though it’s really simple:

This method with only one keyword rss feed can be used also with all the social bookmarking websites like digg, propeller, technorati etc and the good part about it is that you can keep in touch with blogs from your niche.

Article directories provide relevant content for your niche
Read the rest of this entry »

About technorati rank and authority - how to increase your numbers

technorati-rank-increase.gifA month ago I wrote an article about my technorati authority and rank increase from 0 to 85 and 300k to 81k, respectively. Now after releasing two more wordpress themes, my authority has increased to 250 and my rank to 21k, even thought in the last period I was a lazy blogger with only a few posts on this blog.
Now most of you will say that the technorati authority and rank numbers are not so important, but you should take them in consideration. Why? Well here’s why:

Potential sponsores for your blog
Because a lot of potential sponsors first look at your alexa rank, then at your google pagerank and after at your technorati rank and authority; at least that’s how I would do if I was in search of reviews or ad banners for my products or blog.

Technorati drives traffic to your blog
The higher your rank and authority is, the more chances you have to get your blog exposed in technorati searches. This means that you have a chance of getting traffic from them. I remember a year ago I had a celebrity blog (it has a new owner now) and because I had the habit to use technorati tags with common names like Britney Spears, Parish Hilton, I’d received a lot of traffic from them, around 100-200 visits.

More rss readers for your blog
From my experience a lot of the people that come from technorati, convert into rss readers because most of them look for blogs that are in the same niche as them. It is a fact that Technorati.com is the second tool after Google’s blogsearch and I confess that most of the blogs I am reading now via google reader, I’ve discovered them with this tool and I think that bloggers do the same.

So above you have a few of the benefits, now here are a few methods to increase your technorati rank and authority:
Read the rest of this entry »