MySQL 4.1 introduces spatial functionality in MySQL. This article describes some of the uses of spatial extensions in a relational database, how it can be implemented in a relational database, what features are present in MySQL and some simple examples.

Often the spatial functions are called geographic information system (GIS) functions, because GIS applications are the most obvious use-case for the spatial functionality. The spatial functions can be used both to provide a means to organize GIS data together with more traditional types of data and to represent non-GIS data with a spatial attribute.

GIS applications then and now

A GIS (geographic information system) stores and looks up objects which have one or more spatial attributes, such as size and position, and is used to process such objects. A simple example would be a system that stores addresses in a town using geographic coordinates. If this rather static data was then combined with other information, such as the location of a taxi-cab, then this data could be used to find the closest cab to a certain location. Many GIS applications are very specialized, in areas such as the mapping of real-world objects, map creation and meteorology.

Among the many attributes of a general GIS is that the objects may have multiple dimensions, and that complex shapes are supported. Typically two-dimensional objects with nearly unlimited complexity need to be supported.

Another attribute of a general GIS is that it supports combining objects and looking for different types of overlaps, such as looking for points that are contained within a given geometrical object. Lastly, a GIS provides a means of organizing objects in layers, i.e. REGIONs inside DISTRICTs.

A good example of an application where GIS is of importance and which also has real-world implications is in the area of meteorology. When it comes to producing weather maps we see every day on the TV screen, meteorology is a complex science. Very advanced and high-powered IT systems that are concerned with the actual number-crunching are combined with large databases. The issue is not that data is not available, the issue is what data to use and how, and how the different types of data are matched. The data from the number-crunching systems is supplied in the form of large files with multi-dimensional arrays of prognosticated data. The issue now is, how can a specific data object be matched with another, and provide a relevant prognosis of the weather in the coming five days.

In other words, we have data covering at least three dimensions (two-dimensional geography plus a height of a measurement for example, maybe combined with a time dimension).

What is obvious from the above discussion is that a database that only works on simple data types, such as INTEGER or DECIMAL, will just not be good enough for this type of application. The geographical shapes might be any type of polygon that then needs to be matched with some other object, i.e. what is the total area of two objects (which is not necessarily the sum of the areas of the two objects, as they might overlap).

The traditional solution to all this has been to use specialized database systems that use proprietary spatial indexing, and proprietary interfaces. These systems are complex though, and not only that, any GIS stores some non-GIS data (for example, a meteorological database might store a temperature measurement at a given geographical location, height and time as a DECIMAL). And for non-GIS data, SQL has become the standard. As applications for GIS have expanded beyond what goes on in labs and high-powered scientific institutions and are found in more traditional applications, such a taxicab scheduling systems, the need for a more standardized solution has exploded. Another factor here is the availability of inexpensive and easy to use GPS systems which may be combined with mobile communication systems, so that getting a real-time position from, a taxi-cab, a ship on the sea or a police car is no longer complex or expensive.

OpenGIS - Linking SQL with GIS functionality

The desire to combine SQL with GIS was initially driven by the developers of GIS applications desiring to expand into other areas, more than by SQL database vendors getting into the GIS market.

The driving organization behind opening up GIS to a broader market and making GIS technologies available everywhere the Open Geospatial Consortium (OGC). OGC has been around for about 10 years and is a non-profit organization that works on many areas of GIS and provides specifications of interoperability with many other standards. One such standard that OGC has provided is a specification for interoperability SQL databases.

This specification, in short, defines extensions to a SQL based relational database to allow for GIS objects and operations. There are four important areas here:

• Data types. There needs to be data types to store the GIS information. This is best illustrated with an example, a POINT in a 2-dimensional system.
• Operations. There must be additional operators to support the management of multi-dimensional objects, again, this is best illustrated with an example, a function that computes the AREA of a polygon of any shape.
• The ability to input and output GIS data. To make systems interoperable, OGC has specified how contents of GIS objects are represented in binary and text format.
• Indexing of spatial data. To use the different operators, some means of indexing of GIS data is needed, or in technical terms, spatial indexing.

In addition to the above, there is also a need for GIS metadata, and in some cases for using different coordinate systems. MySQL currently supports a planar coordinate system. The other major coordinate system in use is the geocentric one, i.e. a coordinate system on the Earth's surface, which is not yet supported by MySQL.

Non-GIS use for MySQL spatial extensions

There are uses for spatial extensions outside of the pure GIS world. Spatial data is not limited to maps or to the Earth's geography. The definition of spatial data and operations is wide, and even though MySQL follows the OpenGIS specification to a large extent, this specification does not limit the use of spatial data to GIS applications.

Any type of data that has more than one dimension can be treated as a spatial entity. The specification does not limit the axis on the coordinate system to any particular unit, such as inches or centimeters, and each axis does not necessarily have to represent the same unit: they are just numbers. Of course, certain functionality assumes that the X and Y axis have similar properties, such as the Area() function.

Fact is, a lot of real-world data has two dimensions if we look at it this way, in particular if we assume that one dimension is a date. For example we could store the maximum and minimum price for a stock as a POINT, where the X axis is the date and the Y axis is the price. We can then use the spatial functions to check for overlaps and intersections with other stocks.

The OpenGIS® Simple Features specifications for SQL

This specification is what is used as the ground for almost all implementations of GIS-functions within an SQL-based relational database. This standard defines the data types, operations, input and output format, functions and much more. This is the standard that is followed by almost all SQL databases with spatial extensions, including MySQL.

The data types start from the most generic at the top of the hierarchy, GEOMETRY, to a number of specific types, such as POINT and LINESTRING. Some of the data types are "abstract" in the sense that you cannot create objects of this type, such as the GEOMETRY type. This does not mean that you cannot have a column of the type GEOMETRY, just that you cannot have any value in that column of the type GEOMETRY, but you can have values of any other spatial type in that column. Among the abstract object types, only GEOMETRY can be used as a column type.

Among the functions that can be performed on spatial objects are functions that evaluate the proximity of objects, such as Overlap(), functions that combine two spatial objects to create another spatial object, such as Envelope() and functions that perform conversion to and from text and binary formats, such as AsText() and GeomFromText(). As any spatial object can be treated as a GEOMETRY object, any function that operate on a GEOMETRY can operate on any other type of spatial object, such as a POINT, which doesn't necessarily mean that this operation always is meaningful.

The specification includes the definition of two formats for external representation of spatial data, WKB (Well Known Binary) and WKT (Well Known Text). This allows data to be exported and imported in binary and text formats. To complement these formats, there are functions that convert between the WKB and WKT formats and all of the spatial data types.

Spatial Indexing

Spatial data may be indexed, just like other data in MySQL. To make this effective, a special type of indexing is used for spatial data called R-tree ("R" stands for Region) indexing. The involves organizing the minimum bounding rectangle (MBR) of the spatial objects in a tree structure that is then used by the different spatial functions. There are a few variations of R-tree indexing, MySQL uses R-trees with quadratic splitting, which is one of the standard methods of building an R-tree index.

An R-tree index is similar to a B+-tree in many ways, and organizes the indexed nodes in a hierarchy where the nodes in the index represent the MBR of the objects in the node. The leaf nodes in the index contain references to the row that contain the data, just like a B+-tree index.

Current Spatial features in MySQL

In the current implementation of spatial extensions in MySQL, parts of the OpenGIS Simple Features have been left out. Among these are:

• Functions - Some functions are missing, among them some that deal with creating new spatial data values from existing ones, such as Union() (not to be confused with the SQL UNION operator) and Intersection() (not to be confused with the Intersect() spatial function).
• GIS Metadata - The OpenGIS Simple Feature specification defines certain metadata tables for GIS data.
• SRID - A Spatial Reference Identifier (SRID) defines the properties of the coordinate system. MySQL stores the SRID of any spatial objects and it can be extracted, but it is not used and the coordinate system is always supposed to be planar.

Except the above, all of the features of the OpenGIS Simple Features specification are included in MySQL 4.1 Spatial Extensions, support for the missing features will be added in future MySQL versions.

Intel is a brand synonymous with microprocessors, the little chips that give computers the power to process data. And in technology markets with millions of independent consumers, if brand power and technical power get into a mutual reinforcement loop, it is quite some force. That's the 'Intel inside' story.

AMD, short for Advanced Micro Devices, is a brand synonymous with. . . nothing particularly, though it is a brand of chips to rival Intel's. And in an Indian market with millions of independent consumers, increasing numbers have been evaluating AMD's proposition with an independent mind. And they're beginning to bite in. Could this become an "AMD insight" story? Read on.

End of Intelopoly

The US-based AMD made its first tentative foray into India four years ago. And according to IDC data, it put its chips in as many as 15 per cent of the 3.5 million computers sold in 2004-05 in India (that includes desktop PCs, servers and laptops). The winning combination?

Aggressive pricing, technological innovation and quick expansion of distribution channels. Delhi-based Skoch Consulting, which tracks the market, expects AMD to have at least a fifth of the market by 2006-07 -- despite rearguard action from Intel to protect its flanks.

Ajay Marathe, president, AMD India, wants a bigger slice than that. "Our target is to grow two to three times higher than the overall market growth rate. We are looking at growing at 70-100 per cent, annually." That could mean over a quarter of the market by 2006-07.

Should Intel worry? AMD has been rapidly expanding its offer basket to include almost everything Intel offers. In fact, having secured its presence in regular computers, AMD is now aiming at the lucrative server market, just 76,000 units strong but worth $295 million last year. AMD wants a 30-per cent share of this segment.

For his part, Surendra Arora, director, Intel India, does not want to display any more concern than necessary. "Let the customer judge the value of Intel," he says.

In some ways, the AMD challenge in India is a reflection of the global market scenario, where the challenger has already grabbed over 40 per cent of the consumer desktop market and around 8 per cent of the server space (and has sued Intel in the US for the alleged use of strongarm tactics to keep PC makers in exclusive loyalty). But the Indian experience is not quite the same.

Price Value Flux

So what has AMD done in India? It has stolen the lead in taking the customer up the power curve. The technical story focuses on AMD's innovation in offering a 64-bit processor at roughly the same price of Intel's 32-bit alternative.

For the uninitiated, most PCs are loaded with 32-bit chips, which means they can process 32 bits of data every second. AMD's 64 bit offering is not only four times faster, it offers more Random Access Memory (RAM), the instant memory that is needed to perform various tasks while the computer is on.

That's part of a twofold strategy, says Marathe. First, score a technological edge with 64-bit chips, segment by segment (desktops in 2001, servers in 2003 and laptops in 2005), thus upstaging Intel's upgradation curve (it launched desktop 64-bit chips only in March, and for servers only last month, and has left laptops unattended).

And then, turn up the knob on the sales pitch. Its advice to customers has been simple: why opt for weak old technology when extra power is already within reach?

For the customer willing to listen to a story of finer algebraic detail, AMD has its "dual core technology" to talk about. This offers virtually two processors in one, which, working in conjunction, delivers more than twice the performance.

The brand's popular image, however, continues to be that of a price warrior. Chip to chip, AMD sells at list prices about 20-30 per cent lower than Intel, enabling PC makers to meet lower price points in the Indian market.

Listen to Ravi Pradhan, country manager, India, Via Technologies India, part of a Taiwan-based firm that has a tie-up with AMD to bundle processors with its chipsets. "Of course they're cheaper," he says, "without compromising processing abilities, and that is why many PC makers are using AMD chips to offer PCs at Rs 10,000."

The idea of this price point, the magic figure of Rs 10,000, is to touch off an explosion in volumes. To this end, AMD is also working with HCL Infosystems.

"Nobody is making money at this price," admits Marathe, "as all the vendors have reduced their prices to make it possible. But if you get demand of 5 million units, you can make money."

This is part of the "light computer" vision of networking the country with cheap lightly-loaded machines. These would be machines that are just adequate for internet surfing, but which can also draw on remotely located heavy resources if needed.

Selling cheap machines requires deeper market penetration, and for this, AMD intends doubling its channel partners to 6,000 (across 300 cities instead of the current 150) within the next 12 months -- which it claims would put it on par with Intel's distribution.

Intel's Composure

Intel, meanwhile, has not lapsed into complacency. "We will do everything to win back customers we might have lost," vows Arora, who remains alert to any possible threat to Intel's long-running dominance.

Among Intel's big starting advantages has been the calibration of its technology to suit the software made by Microsoft for Windows, the standard man-machine user interface (hence the term "Wintel monopoly"). Intel and Microsoft tend to operate in alliance, taking customers up the technology upgradation curve.

So, argue Intel supporters, what's the point of a 64-bit machine so long before Windows Vista comes out (scheduled next year) to make appropriate use of 64 bit processing? Says Intel's Arora, "We come out with products when the market is ready."

At the market's lower end, Intel prefers to talk of monthly-outgo affordability rather than product price points. Says Arora, "We are not looking at it as a Rs 10,000 PC, but as a question of affordability: how much does he have to pay per month as an EMI to own a PC?"

Through its 'My First Intel' scheme, the company has tied up with public sector banks to offer loans at rates as low as Rs 300 a month. It is working out deals for bundled offerings too. So price is not a very potent weapon in AMD's arsenal after all.

Moreover, as Skoch's CEO Sameer Kochhar sees it, the price edge gets blunt as you go from the Rs 10,000 level to mid-range PCs for around Rs 25,000, where a saving of about Rs 1,000 does not easily get a switch from Intel to AMD. And the price-point game can drain AMD of cash.

"They are in the bleeding edge of the market," says Kochhar, "those who want to make inexpensive machines buy AMD, they have a lead there but you don't make money. Their challenge is to move up the value chain."

But in the server market, AMD is finding the going steep, according to market watchers. Intel's relationships with corporate and government bodies are proving quite durable, though government contracts no longer specify Intel supplies.

So, realistically speaking, can AMD pose more than a perfunctory challenge to Intel?

Marathe is convinced it can. He explains the server segment's poor showing so far, for example, as an issue of selling a product suited to Indian market peculiarities. The machines used in India as network servers tend to be upgraded desktops.

"We did not have a product here earlier. Intel was selling Pentium 4 in this market. But now we have introduced the Optron 100, which is a server-grade processor, and reliable -- with a price tag similar to a desktop's."

While Intel has good reason not to be daunted by AMD, perhaps the most interesting part of the story lies ahead.

As a brand, AMD has been uncertain of itself. Now it is slowly shedding its popularly held image as a price warrior in favour of a nicely differentiated value proposition. This should be interesting to watch. But can it combine a genuine market insight with its "dual core" advantage to set the mutual reinforcement loop into motion?

"They got mad. Then I told them we wanted to name it JavaScript, and that made them even madder."

 

Yahoo and Microsoft are linking up their IM networks to allow MSN and Yahoo Messenger users to communicate across the two platforms, creating a global network of more than 275 million strong.

The agreement brings actual federated IM to the industry after years of mostly talk about the prospect. During a press conference today, the companies said being able to instant message between IM communities is one of the features most requested by MSN Messenger and Yahoo Messenger users.

The deal means that, in addition to exchanging instant messages, consumers from both communities can see if friends are online or not, swap emoticons and generally communicate without being on the same IM network. Yahoo and Microsoft said they would launch the interconnectivity capabilities between MSN Messenger and Yahoo Messenger in the second quarter of 2006.

The two companies will look into providing more enhanced features, such as PC-to-PC VoIP (define), once they get the new IM network servers up and running, which will be based on the SIMPLE (define) protcol. For the time being, IM enhancements will focus on PC-to-PC communications, so Yahoo's recent acquisition of Dialpad Communications technology, picked up in part for its PC-to-Phone service, won't likely fall under that category.

Officials said complexity is the main reason they are not incorporating more features into the interoperable IM service next year. SIMPLE, while a proven technology, has not been scaled to the extent Yahoo and Microsoft want to deliver, they said.

"This is good for consumers; it's just a lot harder to do when you're flying an airplane as fast as these companies are flying and you want to change the engine at the same time," said Dan Rosensweig, Yahoo COO, in a press conference. "We have to get it right."

The combination of MSN Messenger and Yahoo Messenger networks could put a serious competitive dent in AOL's dominance in the IM world -- or bring the company closer to working out a federated IM deal with the other IM providers. Microsoft, Yahoo and AOL run the three largest IM networks in the world.

A recent study by research firm the Radicati Group reports some 867 million IM accounts worldwide today, a number expected to grow to 1.2 billion accounts in 2009. Public IM networks, such as AIM, MSN Messenger and Yahoo Messenger, primarily make up those numbers.

While Internet citizens have long called for interoperability between the top three, there has been no real serious work undertaken to let an MSN Messenger user talk to an AIM user or Yahoo Messenger user. Every once in a while, two of the three would come to the table but nothing ever came of those meetings.

Blake Irving, MSN communications services and member platform group corporate vice president, would not say whether recent talks with AOL touched on IM interoperability. Even if AOL and Microsoft were to come to some kind of agreement over federated IM, they probably wouldn't be able to do anything about it right now, he said in the press conference.

"The complexity of a deal like [Yahoo and Microsoft] and trying to execute is such that you can't do it with more than one partner at a time," he said.

When asked about a possible similar arrangement with Google, which launched its own IM service earlier in August.

"Certainly, we'd be willing to talk to them, but in terms of executing against the deal we described earlier, we've got to get this right," Irving said.

The closest public IM users have come to IM interoperability is through IM managers, such as Trillian, which lets users combine their AIM, Yahoo Messenger, MSN Messenger, IRC, Jabber and ICQ identities under one console.

What's the next big killer app from search companies? Quickly and easily searching telephone calls for a particular word or phrase—in essence, to Google your calls—is a likely candidate. And it isn't as far off as it might seem.

In the past two years, a number of customer service calling center operators for hire, some with thousands of employees working at the phones, have invested in the technology to identify inept operators and other measures of quality control.

While that's far from a mainstream scenario, these pioneering commercial applications are nonetheless an important first step toward a future in which phone calls will be among the Web pages available by visiting Google, Yahoo and other search engines.

Indeed, Ferris Research analyst Richi Jennings said, leading search engine giants like Google, Yahoo and Microsoft's MSN could introduce rudimentary searchable voice services right now.

"The big three of search could all do a good enough job of it to be of some value," Jennings said. "I do see adding into the search universe the ability to search what you said in phone calls."

While acknowledging such a feature is conceivable, and in some cases being worked on, executives from major search companies cautioned during recent interviews that it will be a long, slow slog to get there, and each will have to battle any number of factors beyond each companies' control.

 

"We are definitely evaluating whether to make available a feature like searching voice calls and voice mail and other advanced voice features," said Yahoo spokesperson Terrell Karlsten.

Analysts envision searchable voice applications that would help companies more easily comply with records-intensive Sarbanes-Oxley corporate governance mandates.

More mainstream applications would turn home phone call history into a searchable database to find telephone numbers, names, addresses or even documenting the type of calls someone makes.

Some analysts even believe phone calls will be listed among the results from using search engines design to mine information stored on someone's computer.

One reason searchable voice applications now appears on technology's horizon is because of the growing consumer interest in VOIP (voice over IP), which is freely available software that lets someone make phone calls using his or her Internet connection.

By treating the phone calls just like a Web page, e-mail or Instant Message, VOIP service providers create yet another Internet-based application for search engines to capture, archive and search.

VOIP calls also makes the transcribing process involved in a searchable voice feature much easier because of their revolutionary technology behind them.

 

The calls are digitized, and then packaged in routing instructions known as the IP, which is the most common way for machines of all kinds to communicate.

It was IP that, in essence, created the common language that Google and other search engines rely on.

For now, though, there are only a relatively few number of VOIP users—an estimated 5 million in the United States, according to several estimates.

Yet VOIP is clearly on the minds of each of the top search companies, and even companies like eBay that seem an unlikely choice to become a telephone operator.

On Aug. 9, Yahoo formally unveiled Yahoo Messenger with Voice, a version of Yahoo's Instant Messager that improves upon the call's sound quality.

Microsoft this week said it had acquired San Francisco-based Internet phone company Teleo.

Future versions of MSN Messenger, Microsoft's instant messaging application, will use Teleo's technology in order to let users make calls from PCs to land-line or mobile phones.

Also, VOIP has a rosy future, according to some analysts. VOIP lines are expected to grow significantly to 25 million in the next two years, or about 20 percent of the total number of traditional home phone lines in the United States.

Another positive sign for searchable voice is that speech recognition, which plays a critical role in the process, is improving and becoming less expensive. Once just able to spot a particular word, companies including U.K.-based Autonomy, a call center specialist, has developed technology to recognize spoken phrases, a quantum leap in effectiveness.

The company also recently purchased Irving, Texas-based eTalk, a provider of call center technology.

The combination will hasten the adoption of searchable voice, believes eTalk marketing director Kathy Kuehne.

Baby steps are being taken when it comes to archiving all those calls into a searchable database, for now a big investment in machines and manpower.

It's such a daunting task that Google isn't archiving the PC-to-PC phone calls capable among users of Google's relatively new GoogleTalk, its instant Messaging application. (IM is predominantly designed to be a stripped-down version of e-mail).

Idiot bosses exist only to stomp the life out of their intellectually superior and more innovative subordinates.

This keeps many good workers up at night. Some can't figure out why their ideas are rejected and their work is denigrated. Others sink into cynicism about their careers. A few devote all their energy to plotting revenge against the dummy in the corner office.

Instead, use a little jujitsu: Turn your boss's cluelessness to your advantage. Call it idiot engineering.

"A clueless boss gives you a wide-open field," says John Hoover, author of How to Work for an Idiot: Survive & Thrive -- Without Killing Your Boss. "Learn what's important to your boss, understand what your company is looking for and help the fool meet those expectations."

Tips on how to deal with seven types of idiot bosses

Some workers, fed up by the knuckle-dragging incompetence of the idiot boss, spend a good part of the day making the twit look bad. The shrewd employee works around the idiot boss by becoming a boost to the ninny's career -- not an impediment.

"You want to diminish the power of the boss's cluelessness to harm you," says Hoover, a corporate psychologist who holds a PhD in organisational behavior. "You do that by becoming an enhancement to the boss."

Start by paying attention to what interests the bumbler and listen carefully when the schmo grunts. This will provide vital information in planning your winning assault on idiocy.

Can't we all just get along?

If your boss has a hockey stick in the corner, uses a puck for a paperweight and has the jersey of his favorite player mounted on the wall, you don't have to be Sherlock Holmes to figure out that he's a hockey nut.

Rather than laying out your proposal in detailed and complex language peppered with chatter about the "leading edge" and "getting the lion's share of resources," try this:

"Wasn't it Hall of Famer Wayne Gretzky who said you shouldn't skate to where the puck is but to where the puck will be?"

7 tips for solving conflict at work

A true idiot will miss the metaphor. Relax, you're talking hockey, and your favorite jackass will listen. If you make your presentation in hockey-speak, chances are the boss will love your idea -- even if he doesn't understand it -- and will give you the go-ahead.

That's your opening, and, as a non-idiot, the rest is up to you.

Some may see efforts to handle an idiot boss as butt kissing, but anyone who thinks that probably believes the road to advancement starts by making the boss look stupid.

Business Basics: Age vs Youth

"Idiot engineering isn't butt kissing," Hoover says. "The whole idea is to make working conditions more conducive to your career growth."

Remember: The key to overcoming an idiot boss includes blending your ideas with the nincompoop's language and agenda. If the schmuck adopts your ideas as his own, you've hopped the first hurtle to success.

"Even though idiot bosses are inevitable, they don't have to be terminal," Hoover says.

But no matter how successful your idiot engineering efforts are, remember who's the boss.

The Secret to Career Success

"The person with the institutional authority is always the 800-pound gorilla," says Hoover. "People who go to work thinking they'll out-wrestle the big monkey will lose every time."

A clueless boss isn't necessarily unconscious, and most know they're in over their heads. This creates great insecurity. As a result, the idiot boss spends most of his day defending his turf against all threats rather than advancing the interests of the company. The idiot boss's imperative is clear: prevent others from seeing his near-terminal cluelessness.

The turbo-charged jerk in pinstripes is more than happy to slaughter a sacrificial lamb on the altar of his own incompetence. You can avoid being that innocent lamb by making yourself indispensable to the big goof.

The rare non-idiot boss does a genius thing: talk to employees, ask about their job and how it can be done better. Jack Welch, former head of General Electric, nailed it. Clearly, someone knows which end is up at top-notch companies such as Microsoft, Intel, Dell, Apple Computer, Southwest Airlines and JetBlue Airways.

"I'm a recovering idiot boss," Hoover says. "If I stop talking to my people, I'm dangling precariously. I've got to engage them and learn from their skills. If I do that, I've taken my personality out of the equation, and that creates consistency."

However, if your boss is dumber than a fence post and beyond redemption, it may be time to find another job. Hoover says an inability to get along with the boss is cited as the top reason for changing jobs. Then comes job dissatisfaction, followed by inadequate pay.

"In a free market, we can vote with our feet," Hoover says. "Leaving may have consequences -- pay and location, for example -- so do a cost/benefit analysis before giving notice."

The battle against idiocy is a long, twilight struggle. As you gird for battle, take a hard look at yourself.

"Beware your inner idiot," Hoover says. "Success and stupidity don't mix. Your boss's stupidity is only half the problem. Your own stupidity can easily complete the disaster."

'The whole process where people get an idea and put together a team, raise the capital, create a product and mainstream it -- that can only be done in the US. It can't be done sitting in India. The Indian part of the equation is to help these innovative US companies bring their products to the market quicker, cheaper and better, which increases the innovative cycle there. It is a complementarity we need to enhance.'

-- Nandan Nilekani, CEO, Infosys, quoted in The New York Times, March 7, 2004.

Translated into plain English, this means 'Indians lack creativity and cannot come up with the ideas to create and sell a product. Indians can only do the backend slog work that helps US companies create and sell their products.'

How about this?

ISRO -- the Indian Space Research Organisation -- is the result of Dr Vikram Sarabhai's vision. Its first rocket, like the one in the picture, was launched 40 years ago. Over the past 40 years, a multi-disciplinary group of electronics, mechanical, electrical, civil and chemical engineers has designed and built 32 satellites and three generations of launch vehicles culminating in the GSLV.

This was done with almost totally indigenous R&D, battling US sanctions. Each time that a technology or component was unavailable, ISRO went ahead and developed it on its own. ISRO's satellites help India in telecom, television broadcasting, weather forecasting, disaster warning, telemedicine, education and fishery. Technologies in areas as diverse as optics and artificial limb manufacture have been developed and transferred to Indian industry.

Jamsetji Tata wanted to make textiles in Nagpur in the 1800s with the cotton grown there. Nagpur had no textile industry then, and in Manchester Jamsetji was told that Nagpur's weather was not suitable as it was too dry. He said, 'Alright, I will bring the Manchester weather to Nagpur.' He imported humidifiers and started India's first textile mill in 1874.

When Jamshetji started the Tata Iron and Steel Company and wanted to export steel rails to Britain, a Britisher called Sir Frederick Upcourt said, 'Do you mean to say that Tatas propose to make steel rails to British specifications? I will undertake to eat every pound of rail that they make, if they do that.' The Tatas did manage to make steel rails and export them to Britain. Upcourt must have developed a massive case of indigestion). In World War II British tanks were called Tatanagars because the steel was made in Tatanagar.

To paraphrase Nilekani, Vikram Sarabhai and Jamsetji Tata got an idea, put together a team, raised the capital, created a product, and mainstreamed it. They did it sitting in India, 40 years and 125 years ago respectively, when India's technical capabilities were far less than they are now.

So we now have two Indias.

One has a severe inferiority complex and is unwilling to do anything creative because it thinks it is incapable of it. It thinks being called the back office of the world is the ultimate compliment, missing the implied insult in the word back. It thinks its ultimate destiny is to do all the slog work of the world.

The other is confident about its capability, dreams big dreams, then goes ahead and translates the dreams into reality. There are innumerable success stories like ISRO and Tata Steel in India today, in manufacturing, electronic hardware, pharmaceuticals, software, fashion design, or any area that you can think of. The problem is that these are not highlighted. Creative individuals and organisations who are developing products or technologies with a lasting impact are unsung heroes.

To be a hero in India today you just have to make a lot of immediate money. Creativity is irrelevant, and maybe dreamers like Vikram Sarabhai and Jamsetji Tata would be considered fools.

When you dream a big dream, maybe a small part of it gets translated into reality. If you do not dream at all, what do you finally get in reality?An entrepreneur must have self-confidence bordering on arrogance. Why is it that this confidence is missing in the heads of India's biggest software companies?

Back to the Raj?

Every Indian child's history textbook says something to this effect: 'During the British Raj we exported cheap raw material to Britain, then imported the finished products at a much higher price. We were paying for the value addition done in Britain, and the Raj prevented us from doing the value addition here. We were being exploited by the British.' The IT industry is considered to be India's biggest success story, but in reality 99% of it involves the export of cheap (human) raw material and the import of expensive finished products.

We are happy if Microsoft starts a development centre in India and employs a couple of thousand people. We develop the software modules that go into Microsoft Windows XP at a low price, and then pay through our noses to import the finished Windows XP.

There is no British Raj to exploit us today, so what prevents us from doing the big value addition here now instead of exporting cheap man days? Why are we exploiting ourselves? The standard argument is that the software industry is evolving, and will 'move up the value chain.' There is, however, no evidence of any motion up the value chain. Some of the biggest IT companies are on the contrary regressing into BPOs. Everyone is happy making a lot of money today, and there is no thought of tomorrow.

Another argument goes: 'Oh, but see how much foreign exchange the IT industry is earning for the country.' Agreed, we are making a lot of money selling our time, but we would be making many times this amount selling our creativity through technologies, designs or finished products.

Current government policies, value systems and the education system are creating a whole generation of people who believe they are second class professionals unfit to do anything creative. During the Raj the British convinced us we were fit to only produce raw material and not finished goods. They'd be proud of us now -- we've learnt the lesson very well and are now convincing successive generations too.

In today's India Jamsetji would probably have said to Frederick Upcourt, 'Maybe you have a point and I'm taking a big risk trying to make steel in this Third World country. I think I'll just sell you the iron ore from my Noamundi mines. Besides, I can start selling you the ore from next month itself, while it will take me 5 years to build the steel plant and start making money.'

So are we really dumb?

A century ago, Jamsetji Tata took some foreign visitors to the Majestic Hotel in Mumbai but was denied entrance because he was an Indian. Jamsetji simply resolved to build a hotel that was even finer, and which would not discriminate against people on the basis of colour or race. Today when we lose software outsourcing contracts and get thrown out of the US, we go back and beg to be allowed back in instead of fighting back by being more creative than them.

We need drastic changes in the education system and in government policies to reward creativity and value addition. Changes that produce creative people, visionaries, dreamers, people with guts, like Vikram Sarabhai and Jamsetji Tata.

We are definitely not dumb. We just have to stop thinking that we are.

Google has updated its software for searching PC hard drives and the internet, giving the free program a new look and adding tools that deliver personalised information based on a user's web surfing habits.

Google Desktop 2, available today as a public beta test, is the company's latest volley against Microsoft and Yahoo! as all three race to expand their presence on PC desktops.The software works on computers running Windows 2000 or Windows XP. Mac OS X is not supported.

The latest Google offering includes several twists. Beyond providing search results, it monitors the user's behaviour and presents relevant information in a resizeable and moveable vertical window called the Sidebar.

One module aggregates email messages from a variety of accounts, including Google's Gmail service or the user's internet provider. Others display stock prices, personalised news headlines, weather reports and what's popular on the web.

Another module pulls Really Simple Syndication feeds from websites that have been visited and offer that service. Unlike other feed aggregators, the user need not take any action for a feed to be added.

"For the novice, it's very easy. They don't even have to know what RSS feeds are," said Nikhil Bhatla, Google Desktop's product manager. "They'll just start seeing them in the Sidebar. Advanced users can go in and customise to their hearts' delight."

A photo module displays pictures from the local PC. It also pulls pictures from web-based galleries that have been visited.

Some features, including personalised news, involve sending details of its users surfing habits back to Google. Bhatla said no personally identifying data was transmitted, and users could opt out.

The program has several tools for finding information buried on local and network drives as well as the internet. The Sidebar has its own search box and it adds a new toolbar to Microsoft's Outlook email program for quick access to mail messages.

After the initial indexing of all content on a drive - a process that takes place when the PC is not being used, subsequent indexing takes place in real time. That means a file can be found as soon as it has been saved to the disk.

The Sidebar's search box also finds applications, which can be launched directly from the results list that appears as words are typed in. It's similar to the Spotlight feature of Apple Computer's Mac OS X and the built-in search of Microsoft Windows Vista, which is expected to be released next year.

Google, which has come under fire for making private information a bit too easy to find, said it has now disabled the caching of secure websites - an option that can be enabled if the user desires.

It also recommends against using the desktop program tool on computers in internet cafes or in cases where many people share the same operating system account.

Google Desktop 2 also offers the ability to encrypt - or scramble - the index to protect it from being read by unauthorised parties.