Top reasons why your webpage may not be indexed by search engines.
Search Engine optimization being important for a website, you define the keywords, provide a Search Engine friendly content, even use submission tools to submit your site but yet your website doesn’t seem to get indexed by these search engines. There might be various reasons why they seem to take forever to index your site.
It is important that you give enough time to get your site indexed. It is sometimes listed on search engine’s submission page the amount of time before it gets indexed. Index time usually ranges from 1 – 8 weeks depending on the type of search engine. Search Engines like AltaVista and Inktomi provide paid option to get listed quickly. You can give up to 4 months time to get indexed. If you are still not indexed then you need to go through your keywords, meta-title, meta description and other aspects of SEO.
There is a possibility that you’ve already been indexed but do not know about it. It is up to you to find out whether you’ve been indexed or not since major search engines do not tell you if you’re listed. It is not possible for you to search for keywords related to your site and expect it to pop up on the first page. You can find out if your site has been indexed with the command: “url: www.yourdomainname” on Google, Yahoo or Live search.
It is a must that you upload the pages to your site before submitting them. Submitting a page that does not exist or submitting with a subtle typo in the URL is an error we might all make at one time or another. There is a greater possibility that many search engines will not notify you if the URL does not exist when you submit them hence it is important you make sure all the pages exist.
Roadmap from Home Page:
There are some search engines that have been known to drop pages that cannot be traveled to/from the home page. The reason behind this is that search engines might decide the page is unnecessary or unimportant if there’s no road from your home page to the page you want indexed. You can think of your site links as a series of roads from one page to another.
There are some search engines that refuse to index websites that do not have any other websites linking to them. There is a possibility that they might index your home page but refuse to index other pages until you achieve at least one or more links from another domain. The best way to solve this problem is by establishing some links and after that you can resubmit your pages as well as the pages that link to you. Hence it is recommended that you have links to your websites making it easier to get indexed and get better rankings.
If you have content inside HTML frames, it can cause problems with submissions because the search engine may index the main content of the page, but not the surrounding menu frame. Visitors find some information but miss the associated menu. It is therefore, for your best if you can create non-framed versions of your pages. Optimizing a non-framed page will often achieve better results.
One of the drawbacks of free websites is that many search engines do not index pages from them because of all the “junk” submissions. It is a better choice to buy your own domain as they are preferred by search engines. The other drawbacks of free website domains include unreliability, forceful display of banner ads etc.
When you design a website it is always suggested to make it search engine friendly which means the search engine spiders should be able to crawl and index your site. These spiders cannot index sites that require any kind of registration, password authentication or filling out forms. For this you need to create static pages that search engines will be able to find and index without performing special action on your site. There are utility programs that help you with this depending on the database system you have.
Guilt through Association:
You can ask your hosting service if your domain name has its own unique IP address assigned to it. If your website shares the same IP as other websites then there is a possibility that your IP has been banned because of something someone else did.
Dynamic pages are often ignored by search engine spiders. Pages generated on the fly from a database usually contain symbols like a question mark (?) or an ampersand (&) which are ignored by many search engines. The simpler the page the better it is for search engines. So avoid using unnecessary fancy scripts and code which can hurt your page rankings.
There are some search engines that have specific number of submissions per day for the same domain. If you exceed their limit, all your submissions could be ignored. Some submission consultants suggest not submitting more than one page a day to an engine for a given website.
Spamming is usually blacklisted by many search engines. Excessive use of keywords, same color text as background are few of the spamming techniques that might result in ignoring or being rejected by search engines.
If your website has pages that are very complex and takes too long to load then it might time out before the spider finishes indexing it. The solution to this is to limit your page size to 50k or less. Visitors with slow internet connection might leave your page before it is fully loaded, hence it is better to limit your page size.
Search engine spiders crawl only certain number of pages of your website. This might range from few dozen or three or four hundred depending upon the engine. Search engines like Google tend to crawl deeper into your site. The best way to get search engines to crawl your pages is to get quality backlinks.
If your site contains redirects or meta refresh tags, they can sometimes cause the engines to have trouble indexing your site. Search engines generally indexed the page that it redirects to but if they think you might be trying to trick them by using cloaking or IP redirection, there is a chance that your site might not get indexed at all.
A reliable hosting service usually guarantees 99.5% up time. The reason for choosing a reliable hosting service is because when your website fails to respond when the search engine spider visits your site, it might not get indexed at all. In the worst scenario even if your site is indexed but when the engine spider visits at the time your site is down, you might be removed from their database.
There might be times when search engines just lose submissions at random through technical errors and bugs. Therefore, it is advisable to resubmit your site once or twice a month for good merit.
It is for your best if you stop submitting your site once it achieves a desirable ranking. The search engines might re-evaluate the page and might reduce the ranking.
APRIL 11, 2008 ISSUE #5