Easy Does It: Examining First-Year Law Student Impressions of the Online Resources They Use Most Often

“Easy Does It: Examining First-Year Law Student Impressions of the Online
Resources They Use Most Often” 

LISA D. KINZER, University of Texas at Austin – School of Law

You’ve got what you get and you don’t throw a fit.

It’s a mantra heard in households across the country when kids sit down at the
kitchen table and realize they do not have what they wanted for dinner. A few
weeks ago, I had a “you’ve got what you get” moment as I was looking over data I
had collected from first-year J.D. students at the University of Texas School of
Law.

The data, as it turned out, were not what I wanted. I had asked
students to name the online resource they use most often, and then to answer a
series of brief questions about that resource. I had intended to (1) measure
student use of WestlawNext, and (2) get a sense of what students think of
WestlawNext. But in retrospect I realized I had not accomplished my second goal,
because I had failed to collect any information about WestlawNext from students
who do not use it. It is not particularly useful to hear about a resource from
its fans, without also hearing from individuals who are perhaps not as enamored
with that resource. So I could not use the data to write anything very
interesting about WestlawNext.

However, some of the data patterns that
emerged were so striking that I wanted to share them. I found that, regardless
of whether a student is using Lexis, Westlaw, or WestlawNext, students are
overwhelmingly convinced that their resource is the easiest and the fastest to
use. I also found that students are not nearly as convinced that their resource
returns relevant material or everything they need. In addition, it seems that
students simply do not care near as much about vendor rewards programs as
vendors might have us believe. And finally, to the extent that their legal
research professors have any preference as to what resource students should use,
students are either unaware of that preference or simply unaffected by
it.

In this paper, I review the data that create these patterns, and then
try to sort out what these patterns mean, practically speaking. I will begin
with an overview of my methodology, then review the results of the survey, and
then turn to the implications and possibilities for further research.

 

Source: LSN Legal Education eJournal Vol. 8 No. 41, 07/20/2011

How widespread is WestlawNext?

A student asked me this question.  Since I live and work in the beautiful bubble known as Stanford University,and have no idea how things work in the Real World, I turned to outside help to answer the student’s question.

I first asked our Westlaw representative, who provided this interesting and useful piece of information:

Based on a recent article about Thomson Reuters revenue, “The WestlawNext legal database has been sold to more than 18,500 customers since its launch in February 2010, representing 34 percent of Westlaw’s revenue base.”

http://us.mobile.reuters.com/article/businessNews/idUSTRE73R2OI20110428

 

But I knew that our students would want to know more specific information, so I sent out a quick request on the Northern California Association of Law Libraries (NOCALL) listserv.  I received 21 replies — 6 from Biglaw law firms, 8 from small/midsize firms, 2 from county law libraries, 4 from the courts (U.S. District, United States Court of Appeals and California Appellate), and 1 from a state agency.  Of the 6 Biglaw law firms, 4 have WestlawNext (although one, at present, is only making it available to firm librarians — see comments below) and 2 do not.

Of the 8 small/midsize firms, 5 have WestlawNext and 3 do not.

None of the public sector law libraries have WestlawNext.  The state agency reports that it might be added this summer.  I did find it a little ironic that the court libraries do not have WestlawNext — didn’t West get started by wooing the judiciary and treating judges extra special nice?

The comments I received were also very useful and I read many of them to my students, since they contain some great research tips and insights.

Here are a few of the comments:

I know that when firm librarians first saw the marketing materials, we were worried that the quality of search results would go down due to the one-box searching, but if anything the opposite has happened.  The result ranking is much better than it was previously, and you can see a lot more information before clicking into a document, which is great.

Our firm has a flat rate contract, so even though there is a cost for the original search ($50), the amount billed back to the client is significantly lower.  They shouldn’t be scared to use the resource due to the cost (at our firm anyway).  It’s in line with Lexis and the old version of Westlaw.  But of course, books are still cheaper.
Of course, they should still use good search practices so we’re not charging the client needlessly – searching broadly and then narrowing the focus, thinking before clicking into documents, checking before getting material from outside our pricing plan.  You can refer back to materials saved to a folder for a year, for free.  I’m saving a ton of material to folders.
The “price triggers” that incur costs: initial search, opening a document, clicking on the keycite materials. 
Our firm’s flat-rate contract doesn’t cover the PDF images of reporters – that’s the only place where you’re not warned before getting material outside of our contract.
We did a firm survey last year, and honestly, most of our attorneys start their research process on Google because it’s free.  Once they have useful information (like a case name or a statute or a law review article), they’ll go online and find all the related documents and secondary sources.  WestlawNext does a really good job of that, and the new format for KeyCite makes it easy to trace between material types. 
 
One more caveat: Keycite and Shepards both may say a case is good law when underlying statutes or cases have been invalidated (not always, but sometimes).  They don’t always catch it when a case has been invalidated by new legislation, as well.  Knowing how far to trust citator services is important.

 ————————-
 
Only librarians have been given permission to use WLN.  We will be offering mandatory class(es) on the product before attorneys are given passwords to access it.  We are aware that the law school students have been exposed to WLN & will likely expect to use it upon entering into the firm environment, so our window to get up-to-speed is fast approaching.Caveats:  Not everything has been loaded into WLN, so it could be frustrating to attorneys when prompted to transition in the middle of their research  to go to Westlaw. We’re also not sure if the costs will increase since clicking on any results keeps adding up the total.  I know we librarians have had conference call discussions about some of the quirky searching & results . . . .  Do I like it?  I had a trial ID & have not used it much since our contract went into effect in January.  I’m still “on the fence” about it, but realize it is the wave of the future in this Googlish society.
 
————————-
 
The federal courts do not have WestlawNext at this time, and my understanding is that while the Administrative Office in D.C. has discussed it with Thomson-Reuters, there is no plan to purchase it for the federal judiciary in the near future.
 
———————–
 
We are using it.  The attorneys really like it.  One thing I’ve learned about it is that you should never choose the hourly setting on WestlawNext.  Always use it in transactional mode since the nature of it promotes lots of browsing time.  Most law firms are turning off the hourly feature and forcing transactional mode, but if not it can wreak havoc with your flat-rate contract client allocation.
 
————————
 
My advice for students:  Know how much the search costs are before you do it.  And always call the research attorneys — they know their tool better than any of us ever will.
 
————————-
 
We aren’t using it in the [state] Judicial Branch.  It’s way too expensive and we can’t afford it!  And if Westlaw itself becomes too expensive for us we may be forced to use just one service.  Since Lexis has the official reporting contract, we must have access to them.
 
————————
 
We do not have WestlawNext.  We did a trial of it and it has potential, but we are not willing to pay extra for it.
 
———————-
I see other problems besides cost for WestlawNext in law firms.  To oversimplify: Google on new steroids represents WestlawNext’s research model. That model shows remarkable detachment from application to real-life research problems in law firms.  The stock examples used in WestlawNext’s demos fit TR’s marketing well enough, but I could not translate them into everyday, online research done in law firms. I also see evidence of algorithmic anomalies – possibly widespread – that have only begun to be explored.
 
———————–
We have been using WLN for the past year.  We hopped on the band wagon pretty early due to a demo seen here by our litigation partners.  The litigation attorneys like it a lot.  Power users of regular Westlaw have a big learning curve so do not like it quite as much.  It is great, however, for researching an area you may be unfamiliar with since it will give you the most relevant cases up front.  Our attys like this feature.  The attys also like the cost..they can figure out how much their research will cost them before going in since a search runs about $65
and then you can open as many docs as you want until you hit your research budget ($15/doc. or so).  It relieves some the pressure they feel when going in.  I think it is here to stay.  Even [after] I have cancelled Lexis access here, cut my print budget and staffing, the WLN contract was added without blinking an eye. . . .
 
———————–
 
We require everyone to be trained first on regular Westlaw. We will then train them on WestlawNext.  There a cost pitfalls with both.  Searching is cheaper and broader with WestlawNext, but if you want to look at lots of documents, you will run up the costs. Initial searching Westlaw is probably narrower (have to select a database), but then the documents don’t cost additional to view.
 
———————–
 
I would recommend that students avoid WestlawNext like the plague until they have a solid grasp on doing research on their own.  You do not want to be dependant on an algorithm created by a corporation to be able to do an essential part of your job.
 
I think Next can be a valuable tool and time-saver for attorneys who understand what the algorithm is doing and what the resources are it is returning in the results, but I worry if students start learning how to research using Next, they will not be able to do any research when they leave school unless they are using, and paying a steep price for, Next.
 
———————–
 
The two main reasons [we don't have it] is that Westlaw would require us to have a separate contract for WestlawNext (we see this as paying for Westlaw twice), and WestlawNext does not have all of Westlaw’s content. . . .
 
————————-
 
Though honestly we haven’t embraced it completely and probably won’t until West tells us they are pulling the plug on classic.  I think it is a good product.  I like the $60.00 search and the left-hand screen that guides you to your hits.  The biggest issue is the pricing per document.  Those clicks just add up.  I am planning on asking our summer assoc. class if they are using Classic or NEXT, then based on the response, the rep. will concentrate on one or the other for the orientation. It will be interesting to see where the product stands with this first summer class who have potentially been using it at school.
 
———————–
 
We at the California Appellate Courts are not.  We have Westlaw and Lexis . . . [and] should be rolling out LMO [Lexis for Microsoft Office] soon, but that is as fancy as we are getting.
 
 
 
 
 

Bloomberg Law’s discounts challenge information suppliers

“Bloomberg Law’s discounts challenge information suppliers” is the headline to a story in today’s Financial Times (p. 19) by Andrew Edgecliffe-Johnson.

The story quotes Lou Andreozzi, the new head of Bloomberg Law, on the company’s efforts to persuade attorneys to consider at least replacing one of their “Wexis” accounts with Bloomberg Law, since Bloomberg’s flat rate pricing (quoted at $ 450 per attorney) is preferable to the “more expensive and unpredictable sums” charged by the competition.

The story also reports how “Bloomberg has recruited ‘hundreds’ of lawyers to create a citation system, which advises users whether cases are still in use, to rival those owned by Westlaw and Lexisnexis.”

The story quotes analyst David Curie who says that “Bloomberg looked unlikely to make big inroads in the short term, but its ‘deep pockets’ made it a long-term challenger.  ‘The pricing definitely is the most challenging and disruptive thing about it,’ he said, predicting that others may follow its flat fees . . .

The story  includes a sidebar, “Legal services industry continues to expand” which includes this information:

Law firms and corporate legal departments once looked to legal research services for basic case law, newspaper articles and public records.

As such information has become more freely available, companies such as Thomson Reuters’ Westlaw division and Reed Elsevier’s LexisNexis have concentrated to turning their databases into online tools to enhance clients’ productivity.

The sidebar goes on to use Thomson’s acquisition of Pangea3 as an example.

Bloomberg Lays Down the Law

From Crain’s New York Business, “Bloomberg LP lays down the law: Financial data giant storms legal research in its typically big way.”

Hilary Potkewitz writes: “The financial data and news juggernaut has quietly hired nearly 500 lawyers over the past year, making it the largest source of new legal jobs in New York.”

What do Westlaw and Lexis make of Bloomberg‘s ambitions in the legal research arena?

““We’re not seeing much of a change in the marketplace [because of Bloomberg]. We’re feeling very strong and comfortable,” says Mike Dahn, chief U.S. marketing and product development officer for Eagan, Minn.-based Westlaw….

LexisNexis Vice President Clemens Ceipek is more blunt. “Bloomberg has a lot of money, and that’s why we can’t ignore them,” he says, “but it’s going to be really hard for them, just like it would be really hard for us to compete in the financial markets.””

The article continues that “cost-conscious law librarians” are taking notice of Bloomberg’s less expensive flat fees and extended free trials.

“The 200 largest law firms spend an average of $2.7 million per year on Lexis and Westlaw combined, according to The American Lawyer.”  How much of that will go to Bloomberg over time?  Other contenders?  Watch and wait….

Thomson Reuters: Westlaw sales up, but print declines dragging down profits

From today’s Financial Times (p. 16), “Thomson Reuters raises revenue outlook”

“The professional division . . . saw strong subscription revenues in its large legal business, WestLaw, but further declines in its high-margin print products, dragging operating profits in legal down 6 per cent.

The new WestLawNext product . . . had been sold to more than 9,000 customers, double its initial expectations,” according to Tom Glocer, chief executive of the financial and professional information group.

Bloomberg Law’s selling point

According to this story in today’s Wall Street Journal (p. B8):

Bloomberg Hangs New Shingle

Financial-Data Firm Enters Legal Research, Challening Westlaw, LexisNexis

By Russell Adams

From the story:

Bloomberg Law says its selling point is the news and company information and financial data it has pulled from the core terminal product and woven into the legal-research materials. For example, if company X sues company Y for copyright infringement, lawyers representing company X can get more than a copy of the complaint and relevant legal history. They get stock charts, patent histories and corporate filings. In addition, the name of every judge and attorney links to a database that pulls up that person’s school, his or her holdings and boards they served onpotential conflicts and case histories.

“We think we can help both the rainmaker and the junior associate with one, eat-all-you-can, elegant, easy-to-use platform,” said Constantin Cotzias, a 42-year-old former mergers-and-acquisitions attorney from the U.K. tapped by Bloomberg five years ago to build Bloomberg Law.

The Eggplant That Ate the Spokane County Law Library

 

You’d better watch out for the eggplant that ate Chicago,
For he may eat your city soon.
You’d better watch out for the eggplant that ate Chicago,
If he’s still hungry, the whole country’s doomed.

 

The 3 Geeks and a Law Blog pointed me to a story in the Spokane, Washington newspaper Spokesman-Review.  I won’t rehash what he 3 Geeks blog item “Spokane County Law Library Needs Bailout for Westlaw Bills” opines, but the Spokesman-Review story by reporter John Craig, “Spokane County law library falls behind on bills,”  is disturbing to me on several levels.

The story quotes the librarian as saying that her Westlaw fees “are three times as much as the company was charging Pierce County . . . for the ‘exact same’ service.”  I do not know the details, but I can see how a reader might be led to believe that this poor county law library is being gouged by a huge monopolistic corporation. 

What is also disturbing to me is the report that the library is averaging $ 12,000 a month for Westlaw service, while its annual budget is only $ 220,000.  The library’s total labor costs are reported to be $ 78,236, which means that the county is paying Westlaw roughly twice what it’s paying its staff.   At the Stanford Law Library the total we spend for our staff is roughly twice what we spend for all materials (online and print), and that seems right to me — it’s the staff that is our most valuable resource.

The third disturbing element to the story is the suggestion that perhaps the county law library is a “relic” and should be shuttered for more “cost effective approaches” such as having public libraries (and not specialized law libraries) serve the legal information needs of the public.  To me this is short-sighted on so many levels that I could go on and on for pages about why this is a bad direction.

If this story does not help build a case for Law.gov, I don’t know what would.

Many states have discontinued publishing official state reports and rely upon West instead.  Appendix D of Fundamentals of Legal Research, 9th Edition, by Steven M. Barkan, Roy M. Mersky and Donald J. Dunn, includes a table “States That Have Discontinued Publishing Official State Reports” (excerpted below) showing what states have adopted West’s National Reporter System as the official publisher.

Washington is not one of these states.   It appears that Washington is one of the more progressive states in providing decisional law to the public for free.  The Washington State Court website contains free opinions from the last 90 days, and then links to www.legalWA.org ; the LegalWA site links directly to the Municipal Research Services Center of Washington, a nonprofit dedicated to providing free legal resources for Washington where case law from 1854 forward can be found.

There is definitely a place for expensive LexisNexis and Westlaw bills — in the high stakes world of Biglaw litigation (with clients to bill back) for certain, but in a county public law library?  There has got to be a better way.

Here’s an excerpt from that table I mentioned above:

B. STATES THAT HAVE DISCONTINUED PUBLISHING OFFICIAL STATE REPORTS.

Except for Louisiana, all states have discontinued their official reports have adopted West’s National Reporter System, or an offprint of the National Reporter System, as official.  Alaska has used the Pacific Reporter as its official reporter since it became a state.

[Copied below are the states listed in this table, next to the "Year of Last Case"]

Alabama                            1976

Ala. App.                           1976

Colorado                           1980

Colo. App.                        1980

Delaware                           1966

Florida                               1948

Indiana                              1981

Ind. App.                          1979

Iowa                                   1968

Kentucky                         1951

Louisiana                        1972

Maine                               1965

Minnesota                      1977

Mississippi                    1966

Missouri                        1956

Mo. App.                       1952

North Dakota              1953

Oklahoma                    1953

Okla. Crim.                  1953

Rhode Island             1980

South Dakota             1976

Tennessee                   1971

Tenn. App.                  1972

Tenn. Crim. App.      1970

Texas                            1962

Tex. Crim. App.       1963

Utah 2d                        1974

Wyoming                    1959

Between a Rock and a Free Site

We are big fans of free and low-cost legal research alternatives here at LRP.  And, we share our enthusiasm with our students in Advanced Legal Research.

But what do you do when there are apparent discrepancies in the free sites that you steer your students to time and time again?

Here is the story:

A professor stopped by the library one day and started off by saying how great Cornell’s LII site is but was wondering about a potential error on their site.

What was the error?

In the Federal Rules of Appellate Practice, Rule 4: Appeal as of Right — When Taken, there is a section dealing with appeals in criminal cases.

In 2009, that rule was modified: defendant’s notice of appeal needs to be filed within 14 days of certain events.  The prior version of the rule required that this notice needed to be filed within 10 days.

The big change: 14 days now; before, 10 days.

As of May 13th, the version of FRAP Rule 4 on LII’s site still shows the text of the old rule.  The top of that page states that it is current through 2007.  (And, not 2009.)

I decided to look around at other important research sites and see what was online.

The Office of the Law Revision Counsel prepares and publishes the United States Code, and on their site (uscode.house.gov) they have the text of the code and the rules.  They also have the wrong version of FRAP Rule 4.  The LII folks work off of the House site, so it isn’t that surprising.  This House version has a currency date as of 1/2009 — the rule was changed in March, taking effect in December 2009.

However, another site at the US House of Representatives has it right.  On the House Judiciary Committee site, they have the correct version of the rule posted on their Procedural Documents page.

The Administrative Office of the U.S. Courts has the correct version posted on their Rules page.   I also checked a number of Federal Court websites and all had the current version.

The GPO Access site directs you to the most recent printed, official version of the US Code (2006), so this is out of date.  And, worth noting: “The information contained in the U.S. Code on GPO Access has been provided to GPO by the Office of the Law Revision Counsel of the U.S. House of Representatives.”   But, of course.   Also, FDSys has such a great interface and so much useful information, but it is only current through the last official supplement — missing the current version of this rule.

As to various commercial versions: Westlaw and Lexis have the correct version.  And, FastCase and CaseMaker also have the current version.

However, newcomer on the block, Bloomberg’s BLAW has a 1998 version — very out of date (and still with the 10 days instead of 14 days mistake, among others).

So, what is the right thing to say to your class?  Do we feed the research paranoia, as Bob Berring describes it, where students feel the need to double or triple check everything online on multiple sources?  Or do we frustrate the students with the caveat that sometimes even the best resources aren’t going to do the trick?

This is truly a teachable moment, but not the type of lesson I had in mind.

Judge says: Keep this opinion out of Westlaw and LEXIS

 Judges make decisions and write opinions.  Some opinions get published and some do not.  Unpublished opinions get unofficially published in West’s Federal Appendix and very often show up online.   And on infrequent occasions some opinions find their way into LexisNexis but not Westlaw; others are found in Westlaw but not LexisNexis.

Here’s a case that caught my eye while doing some docket searching (I drink POM Wonderful, so that’s why it stood out).

On December 21, 2009 Judge A. Howard Matz, of the United States District Court for the Central District of California, issued an 7-page order in the case of POM Wonderful LLC v. Welch Foods, Inc..   This opinion includes, among other things, a discussion of standing under the California Unfair Competition Act and the California False Advertising Act.  At the end of the document, the judge writes:  “This Order is not intended for publication or for inclusion in the databases of Westlaw or LEXIS.” (emphasis mine)

A quick search of Bloomberg Law dockets produces at least a dozen other orders from this same judge with this same language.

So what about Bloomberg Law.com?  Or Google Scholar?  Or Fastcase?  Justia?  May any/all of them include the order?

Or is it just the strength of the Wexis duopoly and the judge really means he does not want the order published online anywhere.

LexisNexis and Westlaw have been the big players for decades.  But Google really could be a game-changer.  As a review article in the March 8, 2010 issue of The Recorder (“Worthy Adversary”) by Oliver Benn of Google Scholar points out:

If Google wants to devote its resources to addressing its current limitations, the future of legal research could become very different.  Many courts accept briefs electronically.  Why not hyperlink cited cases in the brief to the cases’ free Google pages?

And getting back to POM Wonderful, apparently it is available in LexisNexis and Westlaw, despite the judge’s request that it not be (please see comment from Bev Butula).

Will Knowledge and People Converge?

In today’s HuffPo, Paul Lippe (Legal OnRamp founder) interviews David Curle (legal information market analyst) in “Will Knowledge & People Converge?”

The interview moves through key trends and recent history in the legal information and publishing sector (including the latest improvements offered by the ‘big guys’ at Westlaw and Lexis).

Then the discussion shifts to the impact of Google Scholar‘s free case law on the legal information market:

“It’s revolutionary in the sense that the general public now has easy access to the law of the land, something that was surprisingly hard to obtain before.”

Curle mentions the FastCase iPhone app that allows free searching of its database.   The days of charging for ‘just access’ to primary legal materials are coming to a close.    And, welcome to the generation of data.gov and law.gov:

“Law.gov has the ambition of making all primary US legal material available in standardized, machine-readable formats that can be incorporated into new kinds of information products.”

. . . .

“open access to legal sources will spur the creation of new markets for legal information among consumers, and even more so among non-lawyer professionals who need to understand a narrow field of that they work with all the time. Expect to see new products and services built on top of the free legal information that will make the law more accessible to those new markets.”

And, speaking of new products building on free content.  Curle moves on to discuss SpindleLaw.

“They are building, in a kind of collaborative, Wiki-like way, a database of the legal rules that lawyers find in court decisions and in legislation. Their idea is that it’s pretty inefficient to get to those rules by searching and reading long court opinions. They are extracting and organizing the rules with links to the legal sources. They have a long way to go to prove that the concept works, but I like the way they are trying to turn the research process on its head.”

These are very interesting times.