
Sign up to save your podcasts
Or


Intro: You may think Google and Yahoo have a lock on search but it may be time to starting thinking a little differently. In this podcast we take a look at some niche search sites.
Mike: Gordon, we love Google products and services - is there a the problem?
It may be Google does too good of a job! Have you ever tried Google searching on a persons name? A simple Google search on my first and last name gives over 1.9 million results!
Today, three companies control almost 90% of online search:
- over 50% of all searches are done using Google
- over 25% on Yahoo
- and over 13% using Microsoft
There are some problems though – these search engines primarily give results based on the number of sites linking to a page and the prominence of search terms on a page. Because they work this way there is room for niche.
Mike: With this kind of lock on search it would be almost impossible for a startup to launch a successful general search product - right?
Yes - it would be almost impossible but we are seeing some acrivirt in the niche areas. Areas like travel and finance are niches that have already been filled but today there seems to be some room in the people search area.
Mike: Are there companies in this market we should be looking at?
One of the startups to watch is Spock at www.spock.com. Spock is scheduled for their public launch the first week of August. Among other places on the web, Spock scans social networking websites like Facebook and LinkedIn. Search results give summary information (age, address, etc) about the person along with a list of website links that refer to the person.
According to Spock 30% of the 7 billion searches done on the web every month are related to individuals. Spock says about half of those searches concern celebrities with the other half including business and personal lookups. According to Spock, a common problem that we face is that there are many people with the same name. Given that, how do we distinguish a document about Michael Jackson the singer from Michael Jackson the football player?
With billions of documents and people on the web, we need to identify and cluster web documents accurately to the people they are related to. Mapping these named entities from documents to the correct person is what Spock is all about and they're coming at the problem in an interesting way.
Mike: I've looked at Spock - what is the Spock Challenge?
They've launched what they call the Spock Challenge – more formally referred to as the SPOCK Entity Resolution Problem linked here: http://challenge.spock.com/pages/learn_more
If you go to the site you can download a couple of data sets – one called a training set (approx 25,000 documents) and the other called a test set (approx 75,000 documents).
Along with the document sets they include a set of target names. You assume that each document contains only one of the target names (even though most documents contain many names). The challenge is to partition all the documents relevant to a target name by their referent.
Mike: When does the contest begin and end? It has already begun on 4/16/07. It will end on 11/16/07. On 11/16/07, Spock will run the final round of the competition and announce the winner.Here are the dates off the website: 4/16 Registration started 5/1- 8/15 Proposal submissions accepted 7/1 Leader board live 11/1 Finalists announced 11/16 Final round at Spock, winner announced Mike: What languages and tools be used?You can use any language and any non-commercial libraries, tools and data to develop the solution. There is one catch - the winner grants Spock non-exclusive right to use the software and data. As an FYI, much of Google is actualy written in Python with the Search Engine Core written in C++. Python provied scripting support for the search engine. and some apps like google code are done in pythonMike: Can you give us and example of how this works?From their website: Consider the following two documents with the target name "Michael Jackson":Michael Jackson - The King of Pop or Wacko Jacko?
Michael Jackson statistics - pro-football-reference.com
The referents of these articles are the pop star and football player, respectively. They've also included the ground truth for the training set so you have something to compare against.
Once you're done training, you can run your algorithm on the test set and submit your results on this site. Spock will provide instant feedback in the form of a percentage rank score. This way you can see how you stack up against the other teams.
So they provide you with a lot of well constructed data, and the ground truth about that data. "Ground truth? data is real results and you use this information to validate your search algorithm results.
This data is documents about people, and the challenge is to determine all the unique people described in the data set. This data can be your training set. Once you have got your basic algorithm working against the training set, they let you further tune your code by running it against a second test data set and give you instant accuracy feedback in the form of a score. The score depends on how many correct unique people you can identify in the data. This way you can continue to refine your work, and see how you are doing, and how well others are doing.
This looks like a great academic challenge. At the end of the contest time, you submit your code, a 3 page description of your approach, pre-built binary executables that can run in isolation on Spock servers, and your results (the "Software Entry?). Spock will select the finalists based upon submissions, and fly the finalists to visit the judges. The winner will win $50,000, 2nd place wins $5000 and 3rd place wins $2000.
Mike: How doe people enter?You may enter the Contest by registering online at www.spock.com/contestregistration . You may register as an individual or as a team. During the registration process, you must provide your name, your age, your email address, and the country you are from. If you are entering on behalf of an organization, a school or a company, you must identify its name. If you are registering as a team, you must provide the same information for each member of your team as well as the identity of a team leader. You will also provide a name for your team or for yourself by which you or your team will be known to other participants in the Contest. Spock may change the name if it feels the name you select is not appropriate for any reason.
Mike: What are the differences between the Spock Challenge and the Netflix Challenge? From Netflix website: The Netflix Prize (http://www.netflixprize.com ) seeks to substantially improve the accuracy of predictions about how much someone is going to love a movie based on their movie preferences. Improve it enough and you win one (or more) Prizes. Winning the Netflix Prize improves Netflix ability to connect people to the movies they love. Netflix provides you with a lot of anonymous rating data, and a prediction accuracy bar that is 10% better than what Cinematch can do on the same training data set. (Accuracy is a measurement of how closely predicted ratings of movies match subsequent actual ratings.) If you develop a system that Netflix judges beats that bar on the qualifying test set they provide, you get serious money and the bragging rights. But (and you knew there would be a catch, right?) only if you share your method with Netflix and describe to the world how you did it and why it works. In addition to the Grand Prize, we're also offering a $50,000 Progress Prize each year the contest runs. It goes to the team whose system we judge shows the most improvement over the previous year's best accuracy bar on the same qualifying test set. No improvement, no prize. And like the Grand Prize, to win you'll need to share your method with us and describe it for the world. The Netflix contest started October 2, 2006 and continues through at least October 2, 2011.So..... back to your question - The Netflix Challenge will run another 4 years; Spock Challenge has every intention to give out the grand prize to a team with a reasonable solution at the end of the 6 months. Netflix Chellenge sets an absolute standard for winning the grand prize; Spock Challenge intends to award to the best reasonable solution.
Mike: How about some other companies?
Wink – www.wink.com Similar to Spock – launched a few months ago. Claim that Wink People Search now searches over two hundred million people profiles. Searches people across numerous social networks including MySpace, LinkedIn, Friendster, Bebo, Live Spaces, Yahoo!360, Xanga, Twitter and more. Also included in the results are Web sources such as Wikipedia and IMDB with more coming all the time.
Zoominfo – www.zoominfo.com Specializes in executive searches. Claim 37,131,140 People and 3,518,329 Companies indexed. You can currently search on three categories – people, jobs and companies.
Searchwikia - http://search.wikia.com Jimmy Wales and his open-source search protocol and human collaboration project. From Press release:
"Last week Wikia acquired Grub, the original visionary distributed search project, from LookSmart and released it under an open source license for the first time in four years. Grub operates under a model of users donating their personal computing resources towards a common goal, and is available today for download and testing at: http://www.grub.org/ .
Grub, now open source, is designed with modularity so that developers can quickly and easily extend and add functionality, improving the quality and performance of the entire system. By combining Grub, which is building a massive, distributed user-contributed processing network, with the power of a wiki to form social consensus, the open source Search Wikia project has taken the next major step towards a future where search is open and transparent".
There have been a couple of interesting Skype product upgrades/releases over the past few days. The first is SoonR Talk, an AJAX enabled application that allows Skype to run on the iPhone and other mobile devices. The second is the release of Skype on the Nokia N800 Internet tablet. The small hand-held device connects to available Wi-Fi networks that we're all finding just about everywhere these days. Here's a Yahoo News quote from Gartner analyst Elroy Jopling:
"We will see more Skype and similar free Wi-Fi phone services moving into mobile devices in the U.S. and Europe, he said, although Europe could adopt it more quickly. However, he said he expects to see "mobile operators put up as many roadblocks as they can" in both places". Both of these products allow free Skype voice calls from anywhere to anywhere with Wi-Fi access. Saturday, July 14, 2007 Blog Some Interesting Skype AlternativesNetwork Computing recently published a piece evaluating 6 Skype Alternatives here. Each alternative adds enhanced features that Skype currelty does not offer. Here's the list:
Grand Central - This product allows you to select one phone number and link up to six phone numbers you enter into your user profile. For example, you can set your Grand Central account to ring both your office phone and your cell phone. The one you pick up is the one that connects the call. Grand Central was acquired by Google a few days ago (Mike Q was the first to tip me off) and is currently taking number reservations on their website. TalkPlus - TalkPlus is sort of the opposite of Grand Central - it allows you to have several phone numbers that all ring to one phone. TalkPlus is inexpensive but not free. They currently offer number in 32 different countries and especially looks like a great product if someone has relatives in other parts of the world. Jajah - I've blogged on Jajah in the past - see link here. Jajah provides a paid service that allows calls to be routed to landline/cell to landline/cell in many parts of the world without long distance fees. Here's how it works: Let's say I'm a Jajah customer and I want to call my brother who is living in London. I log into my Jajah account at jajah.com, enter my brother's landline or cell number and my landline or cell number. Jajah makes the connection and rings my phone and then my brothers phone over connections that are local to each of us. Talkster - Talkster's paid service provides calls from phones to to voice-enabled instant-messaging services like GoogleTalk and Yahoo IM. One of the neat things about Talkster is that it allows you to see your friends presence (whether or not they are on IM) using you mobile phone browser. Jangl - Jangl is a currently free service (even for international calls) that works similar to Jajah - it connects phone network end-points. The difference is Jangl does not require that you know the number you want to call. Jangl uses semi-permanent phone numbers and allows people to call you that don't know your permanent number. Jaxtr - Jaxtr is similar to Jangl with a flashier user interface. It is also currently a free service for domestic and international calls. Both Jangl and Jaxtr's anonymity features cater to the "social networker" market. Each of these products offer features and functionality beyond current Skype offerings - it will be very interesting to see what Google does with Grand Central. Now Skype is not without competion, right?T-Mobile HotSpot @Home service For $10 a month, on top of your regular plan, you can eliminate the problem of poor wireless coverage in your home and make unlimited calls without using voice-plan minutes. All it takes is a broadband connection, a Wi-Fi network, and one of two Wi-Fi-ready handsets sold by T-Mobile. T-Mobile's product is based on Unlicensed Mobile Access (UMA) - we'll have to do a separate podcast on this technology.
Thursday, July 19, 2007 Blog Goodbye Copper?There's been some recent press about Verizon and their FIOS product installation. FIOS is a fiber optic network service that delivers voice, video and data services. You may also see it referred to as a Fiber to the Premises (FTTP) or Fiber to the Home (FTTH) service that Verizon is selling and installing in select markets in 16 different states.
Most who have the service installed are extremely happy with the bandwidth and cost when compared to lower bandwidth DSL and Cable Modem services. The product has become so popular that it is even being used as a selling point by real estate agents when marketing homes.
A few are complaining though. It appears Verizon, when installing the FIOS service, is cutting out the existing copper lines leaving the customer with only one option – fiber and FIOS. There are a couple of good reasons from a business perspective for Verizon to do this. The first is the existing copper wiring is old and requires a significant amount of maintenance – Verizon spends hundreds of millions of dollars a year just maintaining the existing "copper plant? and it makes sense to remove it when it is replaced. The second reason is the Telecommunications Act of 1996 which requires the telephone companies (like Verizon) share their existing copper lines with competitors. There is no current legal requirement for Verizon to share new fiber optic lines with anyone.
In fairness to Verizon, there is a three step notification process for people who sign up for the FIOS service. According to the International Herald Tribune, customers are told by the Verizon sales person, it is indicated in the sales contract and the customer is told by the technician that the copper will be cut out. Currently, Verizon is publicly stating they will replace removed copper if a FIOS customer wished to revert back to copper service.
Also according to the International Herald Tribune, Verizon has filed more than 100 notices with the Federal Communications Commission to retire portions of copper throughout its network.
I can understand the customer concerns about lack of choice and some technical issues like battery back-up and also Verizon's concerns about having to maintain two separate networks.
Friday, July 20, 2007 Blog Casual Gaming = Big BusinessThe Hollywood Reporter has reported that Nickelodeon will make an investment of $100 million in the development of casual games. Casual games are games that are typically played for a few minutes at a time - examples include puzzle and card games. This announcement was made by Nickelodeon Kids and Family Group President Cyma Zarghami at the Casual Connect Gaming Conference yesterday in Seattle. Zarghami is quoted:
"Particularly in the kids' space, with more than 86% of kids 8 to 14 gaming online, we see great momentum for online casual gaming," Also, according to The Reporter:"Included in the Nickelodeon initiative is myNoggin, a preschool educational game in the form of a subscription service; an expansion of the Nicktropolis multiplayer games franchise; Nick Gaming Club, Nickelodeon's first subscription offering featuring multiplayer games with 3-D avatars; the-NGames.com, a casual gaming site geared toward female teens; and the transformation of the site Neopets.com to NeoStudios, a property centering on the creation of new online virtual world experiences".
In addition, the Casual Game Association (CGA) has released some preliminary data from their Casual Games 2007 Report. Here's a few preliminary data highlights from a MCV press release:
The number of games being submitted to major online portals has doubled over the past two years, suggesting an increase in new publishers developing more titles.
In 2006 the most popular casual games were Mystery Case Files, Diner Dash, Cake Mania, Bejeweled and Slingo.
Women still make up the majority (74%) of all paying players online with men now represent about half of the much-larger non-paying player universe.
The number of games being submitted to major online portals has doubled over the past two years, suggesting an increase in new publishers developing more titles.
The rapid growth of the casual games market has prompted companies to create games for more audiences and also for more platforms, including the Internet, PC and Macintosh computers, Xbox, PlayStation, Nintendo DS, Wii and even mobile phones and PDAs.
The full CGA report will be released in the fall - if you are interested in receiving a copy watch the CGA website at http://www.casualgamesassociation.org or send an email to [email protected]
In this podcast we interview Donna Milgram, Executive Director of Institute for Women in Trades, Technology & Science (www.iwitts.com , www.womentechworld.org ). Donna and IWITTS.com provide the tools to successfully integrate women into male-dominated careers via workshops, publications, products, e-strategies and technical assistance.
Gordon: Hi Donna, welcome and thanks for joining Mike and I, before we get into the great details, can you give us a quick overview of IWITTS and a little bit of IWITTS history?
See www.iwitts.com and www.womentechworld.org and www.womentechstore.com
Mike: Can you tell us a little about your background?
Donna discusses basic bio, IWITTS history, etc
Gordon: What is some of the work your organization is doing that could help National Science Foundation technology centers and projects??
Donna discusses the WomenTech Portal and the CalWomenTech Project along with several other IWITTS projects.
See http://www.iwitts.com/html/womentechportal_home.html and http://www.iwitts.com/html/calwomentech_summary.html
Mike: Gordon and I both have daughters (Gordon has 2 and I have 1) so we are very interested. How are girls doing? Are they going into these technical fields?
Donna discusses the facts that #s are still small and the AAUW Tech-savvy study. Research shows interventions make a difference including proactive recruitment.
Donna also discusses the Discover Engineering" program http://www.iwitts.com/html/017anderson.pdf
Gordon: My 15 year old is really excited about computer science - it is not engineering but similar. Any information on CS?
Donna discusses the TWiCE program http://www.iwitts.com/html/052bair.pdf
Mike: Now you do not just focus on engineering and computer science. What other fields do you provide information on? Donna discusses the focus on emerging technology, type of technology does not matter because principles are the same
Gordon: Many community college technology programs would like to have more women entering their programs but they just do not sign up. How do we change this?
Donna discusses several methods and opportunities to recruit women.
Mike: Many of our technology programs find that the women who do enroll tend to drop out, how do we improve retention of women in technology programs?
Donna discusses several methods and opportunities to retain women.
Gordon: How can people get more information about the work you are doing and how can they get in touch with you?
See www.iwitts.com and www.womentechworld.org
CalWomenTech Community College Sites 2007
- City College of San Francisco, Digital Home Integration Technology certification
- San Diego Mesa College, Geographic Information Systems Program
- Canada College in Redwood City, CA, 3-D Animation and Video Game Art Program
- El Camino College in Torrance, CA, Air Conditioning Refrigeration Program
All four colleges will receive free, intensive training and assistance on recruiting and retaining women in their technology programs for the next 4 years. 4 to 6 more colleges from California will be selected via a competitive process end of 2007.
From the publisher's feed