Webmaster tips & trix   contact | privacylink partnersfree website content
Home » Articles » Search engine optimization

» Affiliate programs
» SE optimization
» Miscellaneous
» Newsletters & E-zines
» Promotion
» Web design
» Usability
» Domain names
» Create income
» Web writing
» Hosting
» Guerrilla marketing
» Accessibility
» Web credibility
» Data recovery

» Archive


Special articles

» Google tools/services
» Yahoo! tools/services

Optimizing dynamic pages (Part 2)

Dale Goetsch
Search Innovation
September 15, 2003

The Widget Queen Revisited

You have the world's finest collection of widgets. You created the world's best widget website. You have no traffic.

You checked in the search engines and find that your site does not appear at all, even though all your competitors' sites do. Perhaps the search engine robots cannot get to your pages to index them.

Search Engine Robots

Search engine robots are simple creatures. They can "read" text to add to their databases, and they can follow "normal" links--those links that are coded to look like

<a href="bluewidgets.html">blue widgets</a>

or the slight variation

<a href="bluewidgets.html><img src="bluewidget.gif"></a>

That's it. Search engine robots cannot select items from lists; search engine robots cannot type text into boxes; search engine robots cannot click "submit" buttons. That means that no matter how important our dynamically-generated page of blue widgets is, if the only way to access that page is to select it from a list or click on a button, the robot will never be able to visit it. That, in turn, means that it will never appear in the search engine results.

So how do you get your dynamic information to show up in non-dynamic ways?

The Painful Solution

One of the reasons that dynamic pages exist is because of the difficulty involved in constantly updating -- adding and deleting -- pages from your site, based on which widgets you are offering this season. If you have a separate page for each make and model of widget, each of those pages can be spidered. They can all be reached through links that look like

<a href="bluewidget-1.html">blue widgets style 1</a>
<a href="bluewidget-2.html">blue widgets style 2</a>
<a href="redwidget-1.html">red widgets style 1</a>
<a href="redwidget-2.html">red widgets style 2</a>
<a href="newwidget-1.html">new widgets style 1</a>
<a href="newwidget-2.html">new widgets style 2</a>

The bad news here, of course, is that you now have to create all of those pages. This loses the benefit of drawing the widget information from a database.

A Better Solution

A better solution is to create only a "shell" of each page, and then to dynamically populate the page from our database. By creating a "real" file, you can assign a fixed URL, but still use the database to fill-in the page, using any of various server-side techniques (HTML server-side includes, Perl, Active Server Pages, Java Server Pages, PHP, etc.). A simple page like this might suffice:

<title>Blue Widgets style 1</title>
<!--#exec cgi="myscript.pl?bluewidget-1"-->

Save this page as "bluewidget-1.html" and you're good to go, assuming that "myscript.pl" will actually return the content you want for the body of the page. True, you will have a discrete page for each item in your inventory, but at least you only need to hard-code the bare-bones of that page.

Another Way To Go

There is yet another way to go. This method does not require creating dozens of static pages, or of having to include exotic scripts in your web pages. It also may not work for all search engines!

Some search engine robots just will not follow links that include a "querystring" as part of the URL. You have seen a querystring if you have ever looked at the URL of a page of search results in Google. For example, if you look for "blue widgets" on Google, not only do you get page after page of blue widgets, you also see that these pages have very complicated-looking addresses


In this address, everything after the question mark ("?") is a querystring. This is used to pass additional information to the web server. While some search engines can follow a complicated address like this, many simply will not follow such a link. That means that if you use a URL like


that the robot may not be able to follow it. This is bad.

On the other hand, an increasing number of search engine robots will follow such links. Usually, links like this are created "on the fly" by filling-out forms and clicking a "submit" button, but that doesn't have to be the case. You can grab that address, querystring and all, and put it into a "normal" link, like this

<ahref="http://www.mycompany.com/catalog.html?item=widget&color=blue&model=1">blue widgets style 1</a>

Put several of these on a page and the search engine robot can now visit your dynamic pages from links that require no button-clicking. Remember that not all robots will follow these links, so your mileage may vary.

As long as the link to the page exists in a form that does not require human intervention to get to it (pulldown menus, search results, form submits, etc) then a bot will follow it.

Widgets Out The Door

Using any of these methods will help search engine robots to find the dynamic pages on your site. This means that the important content on those pages is more likely to be included in the search engine databases, and that people will be better able to find you. That, of course, means that the Widget Queen will reign supreme, knowing that widget customers the world over will now be able to find you and buy your widgets.

About the author
Dale Goetsch is the Technical Consultant for Search Innovation Marketing (http://www.searchinnovation.com), a Search Engine Promotion company serving small businesses and non-profits. He has over twelve years experience in software development. Along with programming in Perl, JavaScript, ASP and VB, he is a technical writer and editor, with an emphasis on making technical subjects accessible to non-technical readers.

Copyright © 2002-2004 Search Innovation Marketing. http://www.searchinnovation.com All Rights Reserved.

Latest articles

» Change your mind about an eBay bid?
We have all made choices in life that two seconds later we know we should take back. Especially when there is money involved this can become a problem.

» A simple way to create 7 effective autoresponder messages
Email is the Net's most powerful marketing tool. And autoresponders are the best idea yet for marketing with email.

» 7 ways to drive laser-targeted traffic to your website
Getting people who matter to see one’s website is a difficult undertaking if he tries to consider the fact that there are rivals everywhere waiting to pin him down.

» Website valuation: Why standard website pricing methods will emerge
The market of buying and selling developed websites is becoming more and more liquid each day.

» One way links are better than reciprocal links
You probably know by now that where your website ranks in the search engine rankings dramatically affects how many visitors you have to your site. Did you also know that you can change where your site is ranked by being proactive and getting as many one way links to your site as possible?

» How to make visitors stay at your website
The very first thing which you should provide the visitors with is some free interesting reading material.

» How to make your visitors click your ads
Here is a simple solution; Convert your banner advertisement to look like a text advertisement!

» Offline advertising should be a part of your online strategy
Day by day, online business has become more & more complicated and competitive.

» How to sell traffic
Selling the traffic arriving at your site is a good method to increase profits from your portal.

» Make money from online auctions
Online auctions have the best benefit of a vast platform. Your product is viewed by loads of people & hence there is more possibility of finding a suitable bidder.

» Groupware explained in easy terms
Groupware is a term used frequently to describe collaborative software. Groupware is application software that integrates work on a single project by several concurrent users at separated random workstations.

» Timely back up can save you from disasters
Few things which people often back up are e-mail addresses, bank records, photographs, personal records, software’s, music etc.

» Why should one go for autoresponders
Autoresponders are programs which get automatically executed in particular situations.

» Become your own boss - Start your own online business today
A survey conducted by SBA states that two third of new business survives at least two year and about forty four percent survives at least four year.

» Express your thoughts - Creating your own blog!
What exactly is a blog? Technically speaking it is a journal or a newsletter which is regularly updated and can be used by any one.

» Pop-up ads - To be or not to be?
According to a study conducted by the Bunnyfoot University, “The Efficacy of Pop-ups and the Resulting Effect on Brands” Internet users feel harangues and harassed by pop-up ads.

» Why content is king on the Internet
The advantages that Internet holds over the rest of the other communication mediums should not wasted because of the inability to find a comprehensive plan that will bind all these faculties together.

» 10 niche marketing tips
In our increasingly driven consumer economies, the average customer is bombarded by choices. With increased saturation of the market, companies look towards niche marketing to search new, ever-evolving and sophisticated consumers.

» Using free traffic exchange
These days internet has emerged as both, a market and hub for marketing. Unlike the ‘brick and mortar’ world where large manufacturers manage to squeeze out the market bases of smaller companies, the internet provides haven like the free traffic exchange.

» Ten ways to drive traffic to your website
Developing a web site and then letting it grow is like planting a tree and then nurturing it.

» Marketing through keyword articles
One of the most effective tools of Internet marketing is the use of keyword articles.

» Want to make money online? Market a service to businesses
Don walked across the street from his house to mine to announce he had finally retired. "But I'm not ready for the golf course," he said. "I want to make a living on the Internet. What can I sell?"

» Web site design mistakes - Database parameters in URLs
Creating a web site takes thought, planning and execution. Unfortunately, many designs are dead in the water before they are even published as far as search engine optimization is concerned. Whatever you do, avoid these critical mistakes.

» Alexa Toolbar - The ultimate internet tool
There are numerous tools available on the Internet to assist online businesses. A valuable tool that you should use is the Alexa Toolbar. Even better, this tool is free.

» Web site design mistakes
Some wise human once said "Learn from the mistakes of others. There isn't nearly enough time to make them all yourself." Hence this article. Here are five of the most annoying and common web design mistakes.

» Abandonment - Why visitors don't turn into customers
Every good Internet business understands the value of conversions versus hits received. Far too often, businesses become fixated on the hits they are receiving instead of monitoring their hit to sale conversion rate.

» Creative search engine optimization - A case study
Search engine optimization this and search engine optimization that. You read and hear about it all day, but what about your site?

Tools & services to enhance your online business

» Site Build It!
Over 100,000 small businesses of all kinds outperform larger, well-financed competitors. Read about this all-in-one site-building-hosting-marketing system of tools that delivers results.

» Secrets To Their Success
Take a private tour of two "Mom & Pop" web sites every month that earn $100,000+ a year... and discover the exact step-by-step strategies they have personally used to generate these massive profits.