Yesterday, I gave a talk on InfoTools: Beyond Search at TiE Chennai. The slides of the presention are here. I think it went well, but I think, if I had cut down the slides and talk and gave more demos, it would have gone even better. Perhaps next time.
Before starting the talk, I requested people to give me (written) answers to three questions:
- What are your information needs?
- What are your problems with information?
- What tools do you use to manage information?
The questions, perhaps were a bit vague. I realized that after going through the answers. They varied in their level of granularity (specific vs generic problems) and the definition of information itself. But here they are (slightly modified to reduce redundancy).
Here is what I got from the survey:
What are your information needs?
- Potential customer info
- Right info at the right time (whenever I need it)
- To structure, unstructured web data
- Technology and Process to manage large newspaper portal
- Should be current, relevant (to my context. Should lead to (help?) actual decisions
- I need reference (information) of various consultants relating to start of business viz cost, web, management etc.
- Need for current information
- Need (to handle?) information from multiple sources and formats
- Collating information from multiple sources
- Information about competition
- About marketability and segments
- Company address information
- Company finance (annual reports)
- Executives within the company
- Trade details, products, services etc.
- Sales leads
- Knowledge enhancement
- Learning about old friends/acquaintances/family
- To learn to grow personally & business
- Needs to be local search for providers near to me (for ex: a photo copier shop near to my house)
- Technical solutions (day to day) for career and personal growth
- My business is providing information based services, package with recommendations. So need for information varies.
- Various technologies in market
- Information about market situation
- About stock/companies performance
- Details/support to solve issues
- Products available in the market for specifics(?)
- Focused News
- Similar business entity info
- Public info of competitor
- At a business level – market feelers about demand, ease of vendor options availability
- At an execution/implementation level – latent trends in tech
- Updated knowledge
- Price information about products etc.
- Information about technology
- Looking for acquiring an IT company. Need info on the industry they are in (macro) and more about that company (micro)
- Collect, compile for pattern understanding, plan for target customer
- Top IT temp staffing companies in India
- Total temp staff in IT in India
- How do I know the customer needs
- Scholarly articles on business entrepreneurship
- Product information, addresses from www
- Collecting/harvesting data from websites and collating, cleansing and delivering to clients
- Where is the resource for information?
- Where info is available, how to get data stream into our database
- How cost effective, credible, valuable is the data
- Accessibility
- About companies wanting to enter India -setup operations, joint ventures
- Companies in India wanting to enter other geographies
- Consultants from outside India needing partners in India
- Relevant, accurate data (specific to the task at hand)
- Info about prospective customers
- Info about vendors
- Info about current market
- Info about latest technology
Here are my list of information requirements (I took the survey along with others)
- Leads
- Trends
- Best practices
What are your problems with information?
- Locating the right data at the right time
- At times info overload
- Unable to get the right (specific) information
- Sometimes get caught into loads of data, making it difficult to sift through
- Credibility, cost and accessibility
- Frequent website updates
- Different formats of information
- Gettting data from complex templates and grouping into finite categories
- Precision, very difficult to get objective information
- Currency of data
- Comprehensiveness of data
- Need continuous monitoring
- Information overload and in such case, synthesizing & assimilating that information in a reasonable time frame is difficult
- Old data, not accurate
- Too much info
- Not easily accessible
- Irrelevant info
- Filter out the actual/real info from a large pool of junk data
- Do not have a scope to interact with peers in similar industries
- Direct actionable information takes several searches, navigation
- How to localize information (assume how to get local information) and get reliable info
- How to segregate info from the web
- Difficult to put together
- If put together, not sure whether it is the updated info
- If updated (up to date?) not sure about the integrity of the data source
- Availability (sources), Reliability (sources)
- Aggregation of data in a presentable manner
- Too much information
- Unable to identify precise locations quickly
- Quality of inputs not high (always)
- Too large varied and different
- Formats (word, pdf, excel etc. ), hard copies, books, magazines
- Difficult to authenticate, collate and organize based on requirement
- I like websearch engines but I strongly believe that these search engines are at a nascent stage. I just don’t need a site coming up in my search because it is in wikipedia or yahoo
- Inappropriate not timely
- Have to go through lots of notes/documents/pages to get a single piece of information
- Validating the information
- Storing and organizing information
- Time
- Where to see (sources?)
- Not a centralized reporting
- Assimilation requires a lot of pre-formatting
- Effective and speed search by everyone not followed
- Not sure what to look for, where to look for and how to get it
- Vast, use software to target timely, quick, on realtime
- Not able to source the information in the web
- We develop products based on blogs and emails. This is not enough.
- Too much info
- Info with noise
My List
- Signal vs noise
- Reliability
- Authenticity
What tools do you use?
- Blog, forums
- Google, web search
- Search engines
- Reliable third parties
- Friends
- Regular expressions
- Use bookmarking tools like delicious, share with team
- Knowledge repositories (wikipedia
- Books (online/printed)
- Inhouse tools to capture through automation
- Infosource – www, infoanalysis – spreadsheets
- Search engines to identify information
- Customized perl/php/vb.net programs to manage
- Scrape information from the web and manage it
- Search engines
- Networking sites (LinkedIn etc)
- Forums
- My brain power, word/excel
- justdial and few others provide localized service over phone but it is not so accurate
- Justdial
- Hakia
- None
- Excel/Computer/Notebooks
- Peer discussions
- IE Favorites (browser bookmarks)
- Bing
- Primary Research
- Internet, newspapers, meeting – software modules
- spreadsheet, email
- Internet, libraries
- Getting logic from other tools and using our own tools or languages
- Perl, regex
- Paid portals
- Spoke
- Ecademy
- My memory (sigh)
What I use:
- Social bookmarks (delicious, stumble upon)
- Twitter Search
- Facebook groups
- LinkedIn Groups and Answers
- Custom search
- Blog/Feed Search
- Twine
- Semantic Search engines
- InfoMinder
- InfoStreams (feed aggregator/search)
- InfoPortals (just started)
- Tag clouds (generated)
- Concept Mapping tools
- OpenCalais
- Zemanta
- Wikis
This is a small sample (about 40+ people who attended my talk). But you can see some patterns. I think we have a long way to go beyond search.