CiL 2008: What’s New With Federated Search

Speakers: Frank Cervone & Jeff Wisniewski

Cervone gave a brief over-view of federated searching, with Wisniewski giving a demonstration of how it works in the real world (aka University of Pittsburgh library) using WebFeat. UofP library has a basic search front and center on their home page, and then a more advanced searching option under Find Articles. They don’t have a Database A-Z list because users either don’t know what database means in this context or can’t pick from the hundreds available.

Cervone demonstrated the trends in using meta search, which seems to go up and down, but over-all is going up. The cyclical aspect due to quarter terms was fascinating to see — more dramatic than what one might find with semester terms. Searches go up towards mid-terms and finals, then drop back down afterwards.

According to a College & Research Libraries article from November 2007, federated search results were not much different from native database searches. It also found that faculty rated results of federated searching much higher than librarians, which begs the question, “Who are we trying to satisfy — faculty/students or librarians.”

Part of why librarians are still unconvinced is because vendors are shooting themselves in the foot in the way they try to sell their products. Yes, federated search tools cannot search all possible databases, but our users are only concerned that they search the relevant databases that they need. De-duplication is virtually impossible and depends on the quality of the source data. There are other ways that vendors promote their products in ways that can be refuted, but the presenters didn’t spend much time on them.

The relationships between products and vendors is incestuous, and the options for federated searching are decreasing. There are a few open source options, though: LibraryFind, dbWiz, Masterkey, and Open Translators (provides connectors to databases, but you have to create the interface). Part of why open source options are being developed is because commercial vendors aren’t responding quickly to library needs.

LibraryFind has a two-click find workflow, making it quicker to get to the full-text. It also can index local collections, which would be handy for libraries who are going local.

dbWiz is a part of a larger ERM tool. It has an older, clunkier interface than LibraryFind. It doesn’t merge the results.

Masterkey can search 100 databases at a time, processing and returning hits at the rate of 2000 records per second, de-duped (as much as it can) and ranked by relevance. It can also do faceted browsing by library-defined elements. The interface can be as simple or complicated as you want it to be.

Federated searching as a stand-alone product is becoming passe as new products for interfacing with the OPAC are being developed, which can incorporate other library databases. vufind, WorldCat local, Encore, Primo, and Aquabrowser are just a few of the tools available. NextGen library interfaces aim to bring all library content together. However, they don’t integrate article-level information with the items in your catalog and local collections very well.

Side note: Microsoft Enterprise Search is doing a bit more than Google in integrating a wide range of information sources.

Trends: Choices from vendors is rapidly shrinking. Some progress in standards implementation. Visual search (like Grokker) is increasingly being used. Some movement to more holistic content discovery. Commercial products are becoming more affordable, making them available to institutions of all sizes of budgets.

Federated Search Blog for vendor-neutral info, if you’re interested.

michael gorman needs a hug

I can hear the clattering of keys as bloggers and other Web/Library 2.0 fans gear up for Gormangate Round 2, but aside from this little note, I intend to refrain from joining. Frankly, after skimming through Gorman’s latest pronouncement (no link love from me, sorry), I have to wonder if he’s just itching for some … Continue reading “michael gorman needs a hug”

I can hear the clattering of keys as bloggers and other Web/Library 2.0 fans gear up for Gormangate Round 2, but aside from this little note, I intend to refrain from joining. Frankly, after skimming through Gorman’s latest pronouncement (no link love from me, sorry), I have to wonder if he’s just itching for some attention now that he’s had about a year off from being in the public eye as ALA President? Someone send him a copy of How to Win Friends and Influence People, please.

source: snarkivist's icons on LiveJournal

tagging

So, I’m finally hopping on the blog tag bandwagon. I thought my categories were enough, and I didn’t know how to make the keyword field show in the entry creation process. But now that I have a brand new plugin, I’ve started adding keywords to my posts with Technorati links. I tagged the last however … Continue reading “tagging”

So, I’m finally hopping on the blog tag bandwagon. I thought my categories were enough, and I didn’t know how to make the keyword field show in the entry creation process. But now that I have a brand new plugin, I’ve started adding keywords to my posts with Technorati links. I tagged the last however many entries just now and I will tag future posts, but at 457 entries, I don’t plan to do any retrospective tagging. Heck, I think some of my earlier entries aren’t categorized, either. Probably for the best. There are some things I’d like to forget.

Oh! I had a brainstorm yesterday evening for an article topic, so maybe I’ll get cracking on that soon. After all, I just have to have stuff submitted. If it gets published, well, so much the better.

writing

It’s been a quiet month here at eclectic librarian dot net…. Actually, my non-digital life has been eventful and not at all quiet or boring. However, very little of it has been relevant to the focus of this blog, so I haven’t written much about it. Also, I’ve been saving my creative literary juices for … Continue reading “writing”

It’s been a quiet month here at eclectic librarian dot net…. Actually, my non-digital life has been eventful and not at all quiet or boring. However, very little of it has been relevant to the focus of this blog, so I haven’t written much about it. Also, I’ve been saving my creative literary juices for an essay I am contributing to a book about electronic resource librarians. I will need every drop of those creative literary juices if I’m going to get anything decent cranked out. I’ll be happy when it’s done. Formal writing is unpleasant and bothersome.

One thing that I have learned about myself in writing this essay is that my perception of the digital revolution is skewed in a way I had never fully realized before. My family first purchased a PC in the late 1980s. It had two 5 1/4 inch floppy disk drives and no hard drive to speak of. The monitor was green monochrome, and although we had a mouse, we rarely needed to use it. In grade school through high school, I used various Apple computers and the occasional PC, but none of them were networked. I began college in 1994 and discovered the networked computer labs. My concept of the whole thing was still very hazy, but I understood that the computers were all connected to each other somehow, and more importantly, to the printer. In the spring of 1995, I received my first email account. I didn’t know anyone to email besides my friends at the university. I still remember a painful telephone conversation with the father of my high school best friend, trying to transcribe the @ symbol so I could email my friend. However, by the fall of 1996, my university connected with the World Wide Web, and a whole new world was opened up to me. I discovered Yahoo! and listservs and guitar tablature and and…

To me, the Internet began in 1995/1996. Over time, that has evolved to include integrated library systems, online public access catalogs, and just about anything electronic in libraries, even though I know better. In high school I used an OPAC terminal to look up books at my local public library, and I have vague recollections of using a telnet session to search ArticleFirst and WorldCat for research in the first few years of college. These things existed long before my experiences with the Internet, but over the years I have forgotten or ignored that fact, and it is coming back to haunt me now.

My essay is about the evolution of serials librarians to electronic resource librarians, where applicable. Once again, my own perspective has come in to trip me up. Before I started my research, I placed the beginning of the electronic revolution somewhere around 1999/2000. Probably because that is when I became more aware of electronic resources and ceased using print indexes for research. In reality, it was a decade or two earlier. My fear is that my skewed perceptions of the history of technology will taint the essay and make me look like a complete fool to my colleagues. Then again, if they have been reading this blog, they already know me for the fool I am.

interruption – gorman & ala

I promise to get back to writing up my thoughts on the NASIG conference. It’s been a busy two weeks. As you can see, I ran out of what I had written while at the airport and I haven’t had the energy or time to get back to it. Meanwhile, I read Karen’s thoughts on … Continue reading “interruption – gorman & ala”

I promise to get back to writing up my thoughts on the NASIG conference. It’s been a busy two weeks. As you can see, I ran out of what I had written while at the airport and I haven’t had the energy or time to get back to it.

Meanwhile, I read Karen’s thoughts on the latest Gormangate episode, and they became the final tipping point in a decision I’ve been trying to make. As a result, I bring you my open letter to ALA, which I also sent to them by email this afternoon:

Dear ALA,

Some years ago, I let my membership lapse because my income and expenses were such that I couldn’t afford to continue it. Since that time, I have found myself in a better paying job and I have been thinking about re-joining the association. However, I have been unimpressed by president-elect Michael Gorman and the anti-technology, anti-progress statements he has been making publicly in the past several months (re: bloggers, Google Print, etc.). Since he is the future leader of the association, I have to wonder if ALA is right for me.

I have concluded that if the majority of members would choose a leader who prefers the past to the present, much less the future of librarianship, then it’s not an organization that I need to be a part of. For now, I will participate professionally in other areas of librarianship, and perhaps reconsider membership in the ALA sometime after Gorman’s tenure.

Respectfully,
Anna Creech

frbr

Finally, I have found an article on FRBR that makes sense to me. [LJ NetConnect, Spring 2005] I’ve been reading buzz about it in the library blogosphere for a while, but I couldn’t figure out what the thing was. Linda Gonzalez explains that FRBR “is a conceptual model for how bibliographic databases might be structured, … Continue reading “frbr”

Finally, I have found an article on FRBR that makes sense to me. [LJ NetConnect, Spring 2005] I’ve been reading buzz about it in the library blogosphere for a while, but I couldn’t figure out what the thing was. Linda Gonzalez explains that FRBR “is a conceptual model for how bibliographic databases might be structured, considering what functions bibliographic records should fulfill in an era where card catalogs are databases with unique possibilities.”

For example, an OPAC using the FRBR principles would display on one screen all of the holdings for a journal, regardless of format and including title changes. This is an issue serials catalogers have been struggling with for decades, and the problem has only increased with the introduction of electronic formats. Instead of trying to find a way to loosen cataloging standards to incorporate public service needs, the burden of displaying data from the catalog in a user-friendly form would be placed on the database coding. Brilliant!

ouch!

I just read Michael Gorman’s scathing critique of the librarian blogosphere’s response to his op-ed piece on Google in the December 17th edition of the Los Angeles Times. If you have access to the February 15th issue of Library Journal, it might be worth your time to give it a read. Aside from snubbing his … Continue reading “ouch!”

I just read Michael Gorman’s scathing critique of the librarian blogosphere’s response to his op-ed piece on Google in the December 17th edition of the Los Angeles Times. If you have access to the February 15th issue of Library Journal, it might be worth your time to give it a read. Aside from snubbing his nose at the “Blog People,” Gorman writes the entire lot of us off as non-intellectuals in the following few sentences:

“Given the quality of the writing in the blogs I have seen, I doubt that many of the Blog People are in the habit of sustained reading of complex text. It is entirely possible that their intellectual needs are met by an accumulation of random facts and paragraphs. In that case, their rejection of my view is quite understandable.”

I vaguely remembered reading some thoughtful critiques of his op-ed, but in searching for them, I could find only this one. Granted, there are quite a few bloggers who may fit his description of the Blog People. However, if he thinks that all of the so-called Blog People are that intellectually dull, I shutter shudder to think what will come of ALA with this egotistical snob as the president.

Update 4:17pm: The Digital Librarian has linked to the LJ opinion piece by Gorman, which I didn’t realize was also online.

minority librarians

My reaction to Clark Atlanta University closing their library science program.

According to a posting on LISNews.com, Clark Atlanta University is closing their LIS program (along with four other programs) due to budget problems. I nearly applied to Clark Atlanta when I was shopping around for library schools. I’ve never lived in Atlanta, so that was one of the appealing factors. When I told my parents my top five list of schools, they were shocked that Clark Atlanta was on it. That was the first I had ever heard that this school is one of the historically black schools. That shouldn’t have made a difference in my choices, but for some reason, it did.

In college, I spent two months in a West African country as a part of my studies; so I was already familiar with what it is like to live in an area where I am a racial minority. However, I have since discovered that the things that set me apart from my Ghanaian friends were not so much race as culture. I am a North American from the Midwest and they are West Africans. Here in the U.S., the differences in culture are less and it becomes more about race. I realized that I was afraid to go to a school where most of the students are black. I was afraid that I would be rejected and excluded socially because I am hopelessly not black. And that, my friends, is a stupid reason to cross an institution off of your list of graduate school possibilities.

The closing of the LIS program at Clark Atlanta concerns me. The library profession in the U.S. is, for the most part, overwhelmingly white. If I was uncomfortable with going to a school where I could possibly be the only person of my race, I can only imagine what minority students considering librarianship must be feeling like. At least Clark Atlanta University’s program offered black students an opportunity to attend a graduate LIS program where they would not be a minority.

There are two things that I see happening as a result of this closure:

  1. Fewer black students consider a career in librarianship.
  2. Other LIS programs experience an increase in black enrollment.

Frankly, I hope it’s #2.

Please feel free to correct any misconceptions expressed in this entry. I know very little specifically about Clark Atlanta University, it’s now defunct LIS program, or the position of black librarians in the profession beyond my limited experience. All comments expressed in this entry are a reaction to the news item read on LISNews.com and are not researched. If any offence is taken, please remember that none is intended. I welcome all opportunities for enlightenment.

css.php