October 31, 2014

LJ Index 2012: Five-Year Reflection

When we first proposed the LJ Index ratings in 2008 we had several purposes in mind:

  • To showcase a substantial number of U.S. public libraries whose levels of service delivery distinguish them among their peers.
  • To rate libraries based on services delivered (outputs) only, exclusive of resources used (inputs).
  • To acknowledge the approximate nature of ratings of any kind by classifying the LJ Index awards into tiered 3-Star, 4-Star, and 5-Star categories.
  • To make the results understandable by using straightforward scoring methods and publishing the detailed data upon which rating scores are based, and to encourage libraries to explore these statistics regardless of whether they earned a Star or not.
  • To raise awareness of the need for improved completeness and accuracy of annual library statistical reporting.
  • To inspire discussion about new output measures that will reflect the changing nature of library service.

Given the current financial climate and evolving roles of 21st-century public libraries, we are more convinced of the relevance of these objectives than ever. Further information about the LJ Index design, calculation methods, qualifications for libraries to be included, and similar topics are available at lj.libraryjournal.com/stars-faq.

More libraries than ever (7,570) qualified for 2012 ratings (see second table, below). Since the first edition in 2009, the count of libraries rated has increased by 6.4 percent. In large part, this increase has been due to improved reporting of the four LJI per capita measures. In the spring 2009 edition, 919 libraries neglected to report one or more of the required output measures. However, this shrank to 477 this year—a 48 percent decrease in unreported data.

Four of the nine expenditure groups—$100K–$199K, $200K–$399K, $1M–$4.9M, and $10M–$29.9M—account for increases in the number of libraries rated in this 2012 edition. The other five groups had minor decreases in counts primarily owing to disqualifications for unreported data, service area populations dipping below 1000, or changes in expenditures that moved some libraries to different peer comparison groups. In the $30M+ group, for instance, expenditure decreases in 2010 caused three libraries to be reclassified into the $10M–$29.9M group.

Changes in mind

Speaking of year-to-year changes, it is important to be mindful of the potential volatility of annual ratings of any type, including ratings of libraries, colleges and universities, hospitals, and cities. In the LJ Index expenditure categories, new entrants in one group might make comparisons more or less competitive than in prior years. So, there can sometimes be a disconnect between an increase or decrease in a library’s data reported and its final LJI score. This is why it is essential to tread cautiously when interpreting a library’s LJI rating from one year to the next.

Readers may recall that, in any given edition of the ratings, each library’s output statistics are compared to the average (mean) values for those statistics in the expenditure group to which the library belongs. The more above-average a library’s data are, the higher the chances the library will earn a Star rating. The table below gives the mean values for the four LJI measures for this 2012 edition and the next gives library counts across the editions, while the third table gives mean LJI values for all five LJ editions.

Mean Values of LJ Index Measures November 2012 Ratings

Expenditure CategoryCirc Per Capita (Mean)Visits Per Capita (Mean)Program Attendance Per Capita (Mean)Pub Internet Computer Use Per Capita (Mean)
LJI Edition2012201220122012
IMLS Data Year2010201020102010
$10,000-$49,9994.993.770.3521.09
$50,000-$99,9997.545.400.4671.47
$100,000-$199,9998.385.990.4651.44
$200,000-$399,9998.596.580.5021.46
$400,000-$999,9999.797.490.5151.53
$1,000,000-$4,999,99910.767.240.4741.55
$5,000,000-$9,999,99912.006.750.3991.69
$10,000,000-$29,999,99912.016.520.3301.54
$30,000,000 +11.085.950.2621.32

US Public Libraries with LJ Index Scores by LJ Index and IMLS Data Year

Total Libraries Rated75707513740772687115
Expenditure CategoryLibrary Count
LJI Edition201220112010Fall 2009Spring 2009
IMLS Data Year20102009200820072006
$10,000-$49,999945953103610151088
$50,000-$99,99911261145112811521115
$100,000-$199,99912581236120411911173
$200,000-$399,99911701129108711131089
$400,000-$999,99913731377133312781247
$1,000,000-$4,999,99913491307128212091125
$5,000,000-$9,999,999191211186176159
$10,000,000-$29,999,9991141071069888
$30,000,000 +4448453631

Mean Values of LJ Index Measures, All Five Editions

Expenditure CategoryCirc Per Capita (Mean)
LJI Edition201220112010Fall 2009Spring 2009
IMLS Data Year20102009200820072006
$10,000-$49,9994.994.994.995.325.52
$50,000-$99,9997.547.697.517.537.41
$100,000-$199,9998.388.298.157.827.83
$200,000-$399,9998.598.638.138.088.19
$400,000-$999,9999.799.599.289.079.08
$1,000,000-$4,999,99910.7610.5810.089.839.69
$5,000,000-$9,999,9991211.8811.1910.8410.68
$10,000,000-$29,999,99912.0111.9210.9810.4910.1
$30,000,000 +11.0810.9610.5198.51

Expenditure CategoryVisits Per Capita (Mean)
LJI Edition201220112010Fall 2009Spring 2009
IMLS Data Year20102009200820072006
$10,000-$49,9993.773.813.773.883.9
$50,000-$99,9995.45.455.415.315.22
$100,000-$199,9995.995.785.655.545.33
$200,000-$399,9996.586.636.336.266.16
$400,000-$999,9997.497.337.126.846.85
$1,000,000-$4,999,9997.247.387.026.826.77
$5,000,000-$9,999,9996.757.026.666.626.72
$10,000,000-$29,999,9996.526.626.155.945.78
$30,000,000 +5.956.045.845.285.12

Expenditure CategoryProgram Attendance per Capita (Mean)
LJI Edition201220112010Fall 2009Spring 2009
IMLS Data Year20102009200820072006
$10,000-$49,9990.3520.3310.3240.3350.344
$50,000-$99,9990.4670.4780.4750.460.453
$100,000-$199,9990.4650.450.4480.4370.436
$200,000-$399,9990.5020.4890.4720.4470.447
$400,000-$999,9990.5150.5010.4730.4520.434
$1,000,000-$4,999,9990.4740.4610.4430.4110.394
$5,000,000-$9,999,9990.3990.3870.3780.3770.361
$10,000,000-$29,999,9990.330.3390.3140.2850.278
$30,000,000 +0.2620.2820.2880.2690.264

Expenditure CategoryPublic Internet Computer Use per Capita (Mean)
LJI Edition201220112010Fall 2009Spring 2009
IMLS Data Year20102009200820072006
$10,000-$49,9991.091.11.091.070.99
$50,000-$99,9991.471.481.451.381.26
$100,000-$199,9991.441.431.371.311.22
$200,000-$399,9991.461.451.381.311.28
$400,000-$999,9991.531.511.471.451.44
$1,000,000-$4,999,9991.551.531.481.51.53
$5,000,000-$9,999,9991.691.721.691.651.75
$10,000,000-$29,999,9991.541.611.611.641.51
$30,000,000 +1.321.331.321.591.18

This article was published in Library Journal. Subscribe today and save up to 35% off the regular subscription rate.

Ray Lyons & Keith Curry Lance About Ray Lyons & Keith Curry Lance

Ray Lyons (raylyons@gmail.com) is an independent consultant and statistical programmer in Cleveland. His articles on library statistics and assessment have also appeared in Public Library Quarterly, Public Libraries, and Evidence Based Library and Information Practice. He blogs on library statistics and assessment at libperformance.com.
Keith Curry Lance (keithlance@comcast.net) is an independent consultant based in suburban Denver. He also consults with the Colorado-based RSL Research Group. In both capacities, he conducts research on libraries of all types for state library agencies, state library associations, and other library-related organizations. For more information, visit http://www.KeithCurryLance.com.

Share