CiL 2008: What’s New With Federated Search

Speakers: Frank Cervone & Jeff Wisniewski

Cervone gave a brief over-view of federated searching, with Wisniewski giving a demonstration of how it works in the real world (aka University of Pittsburgh library) using WebFeat. UofP library has a basic search front and center on their home page, and then a more advanced searching option under Find Articles. They don’t have a Database A-Z list because users either don’t know what database means in this context or can’t pick from the hundreds available.

Cervone demonstrated the trends in using meta search, which seems to go up and down, but over-all is going up. The cyclical aspect due to quarter terms was fascinating to see — more dramatic than what one might find with semester terms. Searches go up towards mid-terms and finals, then drop back down afterwards.

According to a College & Research Libraries article from November 2007, federated search results were not much different from native database searches. It also found that faculty rated results of federated searching much higher than librarians, which begs the question, “Who are we trying to satisfy — faculty/students or librarians.”

Part of why librarians are still unconvinced is because vendors are shooting themselves in the foot in the way they try to sell their products. Yes, federated search tools cannot search all possible databases, but our users are only concerned that they search the relevant databases that they need. De-duplication is virtually impossible and depends on the quality of the source data. There are other ways that vendors promote their products in ways that can be refuted, but the presenters didn’t spend much time on them.

The relationships between products and vendors is incestuous, and the options for federated searching are decreasing. There are a few open source options, though: LibraryFind, dbWiz, Masterkey, and Open Translators (provides connectors to databases, but you have to create the interface). Part of why open source options are being developed is because commercial vendors aren’t responding quickly to library needs.

LibraryFind has a two-click find workflow, making it quicker to get to the full-text. It also can index local collections, which would be handy for libraries who are going local.

dbWiz is a part of a larger ERM tool. It has an older, clunkier interface than LibraryFind. It doesn’t merge the results.

Masterkey can search 100 databases at a time, processing and returning hits at the rate of 2000 records per second, de-duped (as much as it can) and ranked by relevance. It can also do faceted browsing by library-defined elements. The interface can be as simple or complicated as you want it to be.

Federated searching as a stand-alone product is becoming passe as new products for interfacing with the OPAC are being developed, which can incorporate other library databases. vufind, WorldCat local, Encore, Primo, and Aquabrowser are just a few of the tools available. NextGen library interfaces aim to bring all library content together. However, they don’t integrate article-level information with the items in your catalog and local collections very well.

Side note: Microsoft Enterprise Search is doing a bit more than Google in integrating a wide range of information sources.

Trends: Choices from vendors is rapidly shrinking. Some progress in standards implementation. Visual search (like Grokker) is increasingly being used. Some movement to more holistic content discovery. Commercial products are becoming more affordable, making them available to institutions of all sizes of budgets.

Federated Search Blog for vendor-neutral info, if you’re interested.

CiL 2008: Going Local in the Library

Speaker: Charles Lyons

[Speakers for track C will all be introduced in haiku form.]

Local community information has been slower to move online than more global information provided by sources such as search engines and directories, but that is changing. Google can provide directory information, but they can’t tell you which of the barbers listed near you, for example, are good ones. They’re trying, but it’s much harder to gather and index that information. “In ur community, inforimin ur localz.” The local web can be something deeper, hyper, semantic.

Local information can sound boring if it doesn’t effect you directly. For example, information about street repairs can be important if it is happening along the routes you drive regularly. The local web connects the real world and the virtual world. The local web is bringing a sense of place to the Internet.

Libraries provide access to local information such as genealogy, local history, local government info, etc.

Local search engines started off as digital phone books, but now they are becoming more integrated with additional information such as maps and users reviews. Ask.com provides walking directions as well as driving directions, which I did not know but plan to make use of in the future. By using tools like Google Custom Search, libraries are creating local search engines, rather than just having a page of local links. MyCommunityInfo.ca is a popular search engine for residents of London, Ontario.

Local blogs also provide information about communities, so creating a local blog directory might be useful. Be sure to add them to your local search engine. Local news sites blend user-generated information with traditionally published sources. Useful news sites will allow users to personalize them and add content. Libraries are involved in creating local online communities (see Hamilton Public Library in Ontario).

Local data is being aggregated by sites like EveryBlock, which pulls information from the deep web. It’s currently available in three cities (Chicago, New York, & San Francisco) with plans for expansion, and once the grant ends, the code will be opened to anyone.

Wikipedia is a start for providing local information, and a few libraries are using wiki technology to gather more detailed local information.

Metadata such as geotagging allows more automation for gathering locally relevant information. Flickr provides geographic feeds, which can be streamed on local information sites.

Libraries are using Google Maps mashups to indicate their locations, but could be doing more with it. Libraries could create maps of historical locations and link them to relevant information sites.

No successful revenue generation has been formulated for local information sites. Most local sites are generated by passionate individuals. Libraries, which are not revenue generating sources anyway, are better poised to take on the responsibility of aggregating and generating local information. Particularly since we’re already in the role of information provision.

Libraries can be the lense into local information.

CiL 2008 Keynote: Libraries Solve Problems!

Speaker: Lee Rainie, Director of the Pew Internet & American Life Project

[Prez of InfoToday, in his introduction, announced that 2202 attendees are registered for this conference with 49 states (no one from Wyoming), Puerto Rico, D.C., and 18 countries (7 Canadian provinces) represented. 186 speakers and moderators this year!]

[House-keeping note from Jane Dysart: The men’s restroom on the ballroom level is now a women’s restroom, so the guys will have to go up to the exhibit level. There was much rejoicing.]

Rainie began by apologizing for not originally including librarians as stakeholders in the work of PIALP. This year, his new grant proposal lists librarians at the top, which was well received by the audience. He thanked librarians for their active involvement with the Pew project.

Bloggers were thanked for raising awareness of the Pew project, and for praising Rainie’s past presentations. Yay, bloggers! New media rocks. “Blogging is about community and connection as much as it is about publishing.”

In 2000, studies showed that most Internet connections were via dial-up, and no one was using wireless. In 2007, more than 50% of Americans now access the Internet via broadband, and 62% connect via wireless, both through computers or through cell phones. Wireless connectivity is decreasing the digital divide, and it also responsible for the resurgence of the value of email. “The reports of the death of email are premature.”

Information and communication technology tools are now so interconnected that it’s changing the way we think about information storage and retrieval. The Internet is becoming our storage device, which we access through various portals such as cell phones, TiVo, and yes, computers.

39% of online teens share their creative content through sites like Facebook, Flickr, and YouTube. 33% of college students blog, and 54% read them. However, many are blogging through social networking tools or course management tools and they don’t necessarily identify them as blogs. Avatars are now considered to be creative content, which is something I hadn’t thought about before.

A recent grant research with funding from IMLS and in partnership with IUC, PIALP looked at how folks get information from government sources to solve problems. 79.5% of the adults surveyed had, in the past two years, had an information need that could have been satisfied by information from government agencies. Gen Y (18-30) were the most likely to have visited a library in their search for information (62%), followed closely by Gen X (31-42) at 58%. (Psst… 60% of online teens use the Internet at libraries, up from 36% in 2000!)

Don’t listen to the naysayers who claim that the Internet is killing libraries. Public library users are more likely to be Internet users. Those who are information seekers are more likely to be adventurous in exploring information sources. Broadband users are also more likely to use a public library, and there is no difference in the patronage of libraries based on ethnicity. Young adults are more likely to visit a library to solve a problem than any other age group!

Users talked to library staff to solve their information needs slightly more than using the technology provided by the library, which were the top two ways that they found solutions to their problems. Gen Y users are generationally most likely to return to a library. Rainie thinks that because Gen Y users have been forced to use libraries through school projects, and they have seen how libraries have grown and changed over the years to meet their needs, so they have a good feeling about libraries as a source for solving their problems.

Rainie’s take-away message is that libraries need to do more publicity about how they can solve problems. “The people who know you best are the ones that keep coming back.” Let’s tell our success stories to more than just each other, which we already do a pretty good job of. Give our fans the tools to evangelize and provide feedback, and they can have a significant impact on raising awareness of libraries. Create a comfortable environment for “un-patrons” so that they aren’t afraid to ask questions and learn the technology. Become a node in social networks. (For example, Facebook apps for searching library resources or communicating with reference librarians may not be as unwanted as we might think they are.)

Rainie is an engaging speaker that I look forward to hearing from him in the future.

I got skillz and I know how to use them

What I wouldn’t give for a pre-conference workshop on XML or SQL or some programming language that I could apply to my daily work!

Recently, Dorothea Salo was bemoaning the lack of technology skills among librarians. I hear her, and I agree, but I don’t think that the library science programs have as much blame as she wants to assign to them.

Librarianship has created an immense Somebody Else’s Problem field around computers. Unlike reference work, unlike cataloguing, unlike management, systems is all too often not considered a librarian specialization. It is therefore not taught at a basic level in some library schools, not offered as a clear specialization track, and not recruited for as it needs to be. And it is not often addressed in a systematic fashion by continuing-education programs in librarianship.

I guess my program, eight years ago, was not one of those library schools that doesn’t teach basic computer technology. Considering that my program was not a highly ranked program, nor one known for being techie, I’m surprised to learn that we had a one-up on some other library science programs. Not only were there several library tech (and basic tech) courses available, everyone was required to take at least one computer course to learn hardware and software basics, as well as rudimentary HTML.

That being said, I suspect that the root of Salo’s ire is based in what librarians have done with the tech knowledge they were taught. In many cases, they have done nothing, letting those who are interested or have greater aptitude take over the role of tech guru in their libraries. Those of us who are interested in tech in general, and library tech in specific, have gone on to make use of what we were taught, and have added to our arsenal of skills.

My complaint, and one shared by Salo, is that we are not given very many options for learning more through professional continuing education venues that cover areas considered to be traditional librarian skills. What I wouldn’t give for a pre-conference workshop on XML or SQL or some programming language that I could apply to my daily work!

carnival of the infosciences #87

Welcome to the Carnival of the Infosciences #87! Not too many submissions this time, but they’re all good, so take a few minutes, kick back, and let the Carnival start your Monday morning.

Martha Hardy made two recommendations for this edition of the Carnival. The first is an essay from Roy Litwin entitled, “Annotated list of things not to forget (in the 2.0 craze)….” Litwin writes, “These days, when reading the library literature or a conference program it’s hard to find much that is not about the Library 2.0 idea. It seems to me that many librarians have forgotten that there is something worthwhile in what we do already, and that ‘Library 2.0’ is an update rather than something completely new.” This essay is a must-read for librarians, both twopointopians and those annoyed by them.

The other submission from Hardy is a news item from the Library Boy, Michel-Adrien Sheppard, about a criminal investigation in Toronto and the way authorities are using Facebook to get around the publication ban (“Is Facebook Interfering With Criminal Investigations?“). The Uncontrolled Vocabulary crew also discussed this in the January 9th episode.

Sol Lederman recommends that everyone take a look at Federated Search: The year in review, a review of the major events in the federated search industry in 2007, from the Federated Search Blog. 2007 saw commercial entities making odd business decisions, mergers and acquisitions, and new open source options.

Iris Jastram writes about her experience with creating “subversive handouts” for library instruction sessions, and what she learned from the process. This might give you a few ideas for your own “subversive” handout.

Kate Sheehan asks the question, “Are librarians culturally self-aware?” She also gets a few responses from John Blyberg (“Library 2.0 Debased“) and Rochelle Hartman (“Blyberg Speaks: Safe to come out of hiding“), among others.

The 2008 conference season kicked off with an early January ALA Midwinter meeting, which prompted Sarah Houghton-Jan to link to the useful Tips for conference bloggers, which was originally posted by Ethan Zuckerman and Bruno Giussani last October. Midwinter may be over, but there are still plenty of upcoming conferences that need to be blogged. Be sure to read their advice before you pack your laptop.

Blake Carver at LISNews has put together a list of ten blogs to read in 2008. I’m already reading a few, but I’ve added more to my pile based on Carver’s recommendations.

That’s all, folks! Please submit posts to the Library Garden for #88. You can use the online form or tag posts carninfo in del.icio.us.

my career has peaked

I shushed a room full of librarians. And it worked.

A couple of weeks go, I attended a short conference for academic librarians in the Pacific Northwest, which was organized and hosted by the Washington chapter of the Association of College and Research Libraries. Until recently, I was a member-at-large on the executive board of the organization, and one of my roles at the conference was to get one of the concurrent sessions started. This meant herding everyone to their seats after a snack break, and directing their attention to the speakers.

The room we were in required the use of a microphone in order to be heard. I spoke clearly and evenly into the microphone as I tried to call the room to order, but apparently it wasn’t loud enough because someone in the first few rows said, “They can’t hear you.” And that was when I did it.

I shushed a room full of librarians.

And it worked.

i readed some buks

I read some professional literature for #23 & #24.

First Have Something To Say by Walt Crawford is a must-read for anyone who wants to write for the library profession. The language is accessible, and Walt lays out the processes in a way that just makes sense. I plan to purchase my own copy soon.

I read Walt’s book in preparation for reading and reviewing Meredith Farkas’ Social Software in Libraries. I won’t be posting the review here or anywhere because (hopefully) it will be published in the first issue of the Journal of Electronic Resources Librarianship next year. If you have any interest in incorporating social software in your library, I recommend reading Meredith’s book. She asks all (or nearly all) of the questions you need to ask before deciding to implement anything.

For anyone who’s counting, that puts me at 24 books read this year, which is one more than I did last year. w00t!

librarians in the news

I have determined that there are five types of general news articles about librarians.

I have determined that there are five types of general news articles about librarians:

  1. Librarians are hip. No, really! That stereotype thing is so last week.
  2. Librarians are awesome! Look at all the cool stuff they do. No one appreciates them as much as they should.
  3. Gasp! A librarian did [insert act of bravery or indecency]!
  4. OH NOES! There aren’t enough librarians!
  5. OH NOES! There aren’t enough librarian jobs!

FRBR

FRBR is so cuddly and soft!

From the Library Society of the World Meebo room:

p: FRBR
p: I want a tickle me FRBR
n: it is awfully fun to say
p: with five different expressions…
p: nerd pun!
me: p, I am totally saying that to the next serials cataloger I meet.

* Screen names have been altered to provide anonymity.
** I don’t need anonymity in this case.
*** It isn’t funny unless you’re a librarian who knows what FRBR is and has a sense of humor.

michael gorman needs a hug

I can hear the clattering of keys as bloggers and other Web/Library 2.0 fans gear up for Gormangate Round 2, but aside from this little note, I intend to refrain from joining. Frankly, after skimming through Gorman’s latest pronouncement (no link love from me, sorry), I have to wonder if he’s just itching for some … Continue reading “michael gorman needs a hug”

I can hear the clattering of keys as bloggers and other Web/Library 2.0 fans gear up for Gormangate Round 2, but aside from this little note, I intend to refrain from joining. Frankly, after skimming through Gorman’s latest pronouncement (no link love from me, sorry), I have to wonder if he’s just itching for some attention now that he’s had about a year off from being in the public eye as ALA President? Someone send him a copy of How to Win Friends and Influence People, please.

source: snarkivist's icons on LiveJournal