My Life, The Universe and Everything

Truths I learn. Barriers I seek to break. Let me scream.

Unicode Conversion Gateway for Indian Language Newspapers

Posted by themischord on December 22, 2006

Lack of usable content in Indian languages has been a major problem for a long time now. There are quite a few Indian language newspapers and magazines which have online portals, but unfortunately, they use proprietary fonts/encodings. This makes them good only for viewing the page. These pages cannot be indexed by search engines, cannot be used to create a corpus etc, making valuable content practically useless. For instance, if one searches for a Telugu word in google, there will be no results from which is a Telugu newspaper.

The Swecha team at TCS has set up a Unicode Conversion Gateway for some popular Indian language newspapers in Hindi, Telugu, Tamil, Gurajati, Kannada and Malayalam. For the tech savy, the proxy server fetches pages from the original server, converts it into a Unicode based encoding, which is a standard and serves the page to the user. It uses modified Padma Firefox Extension to do this.

Since search engines understand Unicode based encodings (like UTF8), they will be able to index the pages through this gateway. There are other advantages of a Unicode encoded page too. One can search for a word within the page and copy and paste the Indian language text from the page like regular English text.


One Response to “Unicode Conversion Gateway for Indian Language Newspapers”

  1. Kiran said

    Wow Chaitu. Today I was cursing about how I needed to install all types of fonts just to view a newspaper (eenadu) And then I searched on Google for newspapers in unicode, and the 3rd link was your blog. Kudos to the Swecha team I could actually view the news website without any hassle 🙂

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Google+ photo

You are commenting using your Google+ account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )


Connecting to %s

%d bloggers like this: