This Article Abstract Free Full Text (Free PDF) Free Alert me when this article is cited Alert me if a correction is posted Citation Map Services Email this article to a friend Similar articles in this journal Similar articles in Web of Science Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Citing Articles via Scopus Google Scholar Articles by Miller, J. Articles by Lin, J. Search for Related Content Social Bookmarking                         What's this?

Applying a Generic Juvenile Risk Assessment Instrument to a Local Context

Some Practical and Theoretical Lessons

University of Málaga, Spain

Jeffrey Lin

University of California, Irvine

This article examines issues raised by the application of a generic actuarial juvenile risk instrument (the Model Risk Assessment Instrument) to New York City, a context different from the one in which it was developed. It describes practical challenges arising from the constraints of locally available data and local sensibilities and highlights important differences between locally relevant recidivism predictors and generic tool predictors. The analysis shows that the generic tool is less predictive than a locally developed risk-assessment tool and also performs less well than unassisted clinical judgment. This is true even after the generic tool has been validated and optimized on local data. This is because the tool does not include key demographic variables relevant to the New York City context.

Key Words: risk assessment • actuarial • clinical judgment • juvenile recidivism • family court

References

• Andrews, D.A. (1989). Re-arrest is predictable and can be influenced: Using risk assessments to reduce re-arrest. Forum on Corrections Research, 1, 11-18.
• Andrews, D.A., Bonta, J., & Wormith, J.S. (2006). The recent past and near future of risk and/or need assessment. Crime & Delinquency, 52, 7-27.[CrossRef][Web of Science]
• Ashford, J.B., & LeCroy, C.W. (1990). Juvenile recidivism: A comparison of three prediction instruments. Adolescence, 98, 441-450.
• Assessments.com. (2006). Assessment catalog. Retrieved June 7, 2006, from http://www.assessments.com/purchase/category.asp?cid=3&cl=2
• Austin, J., Coleman, D., Peyton, J., & Johnson, K.D. (2003). Reliability and validity study of the LSI-R risk assessment instrument. Washington, DC: George Washington University.
• Baird, S.C. (1984). Classification of juveniles in corrections: A model systems approach. Madison, WI: National Council on Crime and Delinquency.
• Bonta, J. (1996). Risk-Needs Assessment and Treatment. In A. T. Harland (Ed.), Choosing correctional interventions that work: Defining the demand and evaluating the supply (pp. 18-32). Thousand Oaks, CA: Sage.
• Brennan, T. (1987). Classification methods in criminology. In D. M. Gottfredson & M. Tonry (Eds.), Prediction and classification: Criminal justice decision making, Vol. 9, Crime and justice: A review of research (pp. 201-248). Chicago: University of Chicago Press.
• Burgess, E.W. (1928). Factors determining success or failure on parole. In A. A. Bruce, E. W. Burgess, & A. J. Harno (Eds.), The workings of the indeterminate sentence law and the parole system in Illinois (pp. 221-234). Springfield: Illinois State Board of Parole.
• Carroll, J.S., Wiener, R.L., Coates, D., Galegher, J., & Alibrio, J.J. (1982). Evaluation, diagnosis, and prediction in parole decision making. Law and Society Review, 17, 199-228.[CrossRef]
• Carter, R.M., & Wilkins, L.T. (1967). Some factors in sentencing policy. Journal of Criminal Law, Criminology, and Police Science, 58, 503-514.[CrossRef]
• Clear, T., Wasson, B.F., & Rowland, J. (1988). Statistical prediction in corrections. Research in Corrections, 1, 1-52.
• Cottle, C.C., Lee, R.J., & Heilbrun, K. (2001). The prediction of criminal recidivism in juveniles: A meta-analysis. Criminal Justice and Behavior, 28, 367-394.[Abstract/Free Full Text]
• Dawes, R.M., Faust, D., & Meehl, P.E. (1989). Clinical versus actuarial judgment. Science, 243, 1644-1673.
• Flores, A.W., Travis, L.F., & Latessa, E.J. (2004) Case classification for juvenile corrections: An assessment of the Youth Level of Service/Case Management Inventory (YLS/CMI), Executive summary (98-JB-VX-0108). Washington, DC: U.S. Department of Justice.
• Gambrill, E., & Shlonsky, A. (2000). Risk assessment in context. Children and Youth Services Review, 22, 813-839.[CrossRef][Web of Science]
• Gavazzi, S.M., Slad, D., Buettner, C.K., Partridge, C., Yarcheck, C.M., & Andrews, D.W. (2003). Toward conceptual development and empirical measurement of global risk indicators in the lives of court-involved youth. Psychological Reports, 92, 599-615.[CrossRef][Web of Science][Medline] [Order article via Infotrieve]
• Gendreau, P., Goggin, C., & Little, T. (1996). A meta-analysis of the predictors of adult offender recidivism: What works? Criminology, 34, 575-607.[CrossRef][Web of Science]
• Glaser, D. (1955). The efficacy of alternative approaches to parole prediction. American Sociological Review, 20, 283-287.[CrossRef]
• Glaser, D. (1962). Prediction tables as accounting devices for judges and parole boards. Crime & Delinquency, 8, 239-258.[Medline] [Order article via Infotrieve]
• Glueck, S., & Glueck, E. (1950). Unraveling juvenile delinquency. New York: Commonwealth.
• Gottfredson, D.M., & Beverly, R.F. (1962). Development and operational use of prediction methods in correctional work. Proceedings of the Social Statistics Section. Washington, DC: American Statistical Association.
• Gottfredson, M.R., & Gottfredson, D.M. (1984). Decision making in criminal justice: Toward a rational exercise of discretion. New York: Plenum.
• Gottfredson, S.D. (1987). Prediction: Methodological issues. In D. M. Gottfredson & M. Tonry (Eds.), Prediction and classification: Criminal justice decision making, Vol. 9, Crime and justice: A review of research (pp. 29-33). Chicago: University of Chicago.
• Gottfredson, S.D., & Gottfredson, D.M. (1979). Screening for risk: A comparison of methods. Washington, DC: National Institute of Corrections.
• Gottfredson, S.D., & Moriarty, L.J. (2006). Statistical risk assessment: Old problems and new applications. Crime & Delinquency, 52, 178-200.[Abstract]
• Grove, W.M., Zald, D.H., Lebow, B.S., Snitz, B.E., & Nelson, C. (2000). Clinical versus mechanical prediction: A meta-analysis. Psychological Assessment, 12, 19-30.[CrossRef][Web of Science][Medline] [Order article via Infotrieve]
• Hawkins, J.D., Herrenkohl, T.L., Farrington, D.P., Brewer, D., Catalano, R.F., & Harachi, T.W. (1998). A review of predictors of youth violence. In R. Loeber & D. P. Farrington (Eds.), Serious and violent juvenile offenders: Risk factors and successful interventions (pp. 106—146). Thousand Oaks, CA: Sage.
• Herrenkohl, T.L., Maguin, E., Hill, K.G., Hawkins, J.D., Abbott, R.D., & Catalano, R.F. (2000). Developmental risk factors for youth violence. Journal of Adolescent Health, 26, 176—186.
• Hodge, R.D., & Andrews, D.A. (1999). The Youth Level of Service/Case Management Inventory and manual. Ottawa, Ontario, Canada: Carleton University, Department of Psychology.
• Holland, T.R., Holt, N., Levi, M., & Beckett, G.E. (1983). Comparison and combination of clinical and statistical predictions of recidivism among adult offenders. Journal of Applied Psychology, 68, 203-211.[CrossRef][Web of Science][Medline] [Order article via Infotrieve]
• Hood, R. (1966). A study of the effectiveness of pre-sentence investigations in reducing recidivism. British Journal of Criminology, 6, 303-310.[Free Full Text]
• Johnson, K., Wagner, D., & Matthews, T. (2002). Missouri juvenile risk assessment re-validation report. Wisconsin: National Council on Crime and Delinquency.
• Juvenile Sanctions Center. (2002). Structured decision making for graduated sanctions. Training and Technical Assistance Program, 1, 2.
• Klein, S.P., & Caggiano, M.N. (1986). The prevalence, predictability, and policy implications of recidivism. Santa Monica, CA: RAND.
• Krysik, J., & LeCroy, C.W. (2002). The empirical validation of an instrument to predict risk of recidivism among juvenile offenders. Research on Social Work Practice, 12, 71-81.[Abstract/Free Full Text]
• LeCroy, C.W., Krysik, J., & Palumbo, D. (1998). Empirical validation of the Arizona Risk/ Needs instrument and assessment process. Phoenix, AZ: LeCroy & Milligan.
• Lipsey, M., & Derzon, J.H. (1998). Predictors of serious delinquency in adolescence and early adulthood: A synthesis of longitudinal research. In R. Loeber & D. P. Farrington (Eds.), Serious and violent juvenile offenders: Risk factors and successful interventions (pp. 86-105). Thousand Oaks, CA: Sage.
• Loeber, R., Farrington, D.P., Stouthamer-Loeber, M., Moffitt, T.E., & Caspi, A. (1998). The development of male offending: Key findings from the first decade of the Pittsburgh Youth Study. Studies in Crime and Crime Prevention, 7, 141—172.
• Loeber, R., & Stouthamer-Loeber, M. (1987). Prediction. In H. C. Quay (Ed.), Handbook of juvenile delinquency (pp. 325-383). New York: John Wiley.
• Lowenkamp, C.T., Holsinger, A.M., Brusman-Lovins, L., & Latessa, E.J. (2004). Assessing the inter-rater agreement of the Level of Service Inventory Revised. Federal Probation, 68, 34-38.[Web of Science]
• Marczyk, G.R., Heilbrun, K., Lander, T., & DeMatteo, D.S. (2003). Predicting juvenile recidivism with the PCL-YV, MAYSI, and YLS-CMI. International Journal of Forensic Mental Health, 2, 7-18.
• McCord, J., Widom, C. S., & Crowell, N. A. (Eds.). (2001). Juvenile crime, juvenile justice. Panel on juvenile crime: Prevention, treatment, and control. Washington, DC: National Academy Press.
• Moffit, T. (1993). Adolescent-limited and life-course-persistent antisocial behavior: A developmental taxonomy. Psychological Review, 100, 674-701.[CrossRef][Web of Science][Medline] [Order article via Infotrieve]
• Neubauer, D.W. (1974). Criminal justice in middle America. Morristown, NJ: General Learning Press.
• Office of Juvenile Justice Delinquency Planning. (1995). Guide for implementing the comprehensive strategy for serious, violent and chronic juvenile offenders. Washington, DC: U.S. Department of Justice
• Office of Juvenile Justice Delinquency Planning. (2005). The mathematics of risk classification: Changing data into valid instruments for juvenile courts. Washington, DC: U.S. Department of Justice.
• Orbis Partners. (2006). Welcome. Retrieved June 7, 2006, from http://www.orbispartners.com/frame.htm
• Risler, E.A., Sutphen, R., & Shields, J. (2000). Preliminary validation of the juvenile first offender risk assessment index. Research on Social Work Practice, 10, 111-126.[Abstract]
• Rodríguez-Labarca, J., & O'Connell, J.P. (2005). Delaware juvenile recidivism: 1994-2004 Juvenile Level III, IV and V Recidivism Study. Dover: State of Delaware, Office of the Budget, Statistical Analysis Center.
• Rosecrance, J. (1985). The probation officers' search for credibility: Ball park recommendations. Crime & Delinquency, 31, 539-554.[Abstract]
• Schmidt, F., Hoge, R.D., & Gomes, L. (2005). Reliability and validity analyses of the youth level of service/case management inventory. Criminal Justice and Behavior, 32, 329-344.[Abstract]
• Schwalbe, C., Day, S., & Fraser, M. (2002). Risk assessment in the juvenile justice system (Web report) Chapel Hill: University of North Carolina.
• Simon, F. (1971). Prediction methods in criminology. London: HMSO.
• Tarling, R., & Perry, J. (1985). Statistical models in criminological prediction. In D. Farrington & R. Tarling (Eds.), Prediction in criminology (pp. 210-231). Albany: State University of New York.
• Tremblay, R.E., & LeMarquand, D. (2001). Individual risk and protective factors. In R. Loeber & D. P. Farrington (Eds.), Child delinquents: Development, intervention, and service needs (pp. 137—164). Thousand Oaks, CA: Sage.
• Turner, S., Fain, T., & Sehgal, A. (2005). Validation of the risk and resiliency assessment tool for juveniles in the Los Angeles County probation system. Santa Monica, CA: RAND.
• Wainer, H. (1976). Estimating coefficients in linear models: It don't make no nevermind. Psychological Bulletin, 83, 312-317.
• Washington State Institute for Public Policy. ( 2004). Assessing risk for re-offense: Validating the Washington State juvenile court assessment. Olympia: Author.
• Wasserman, G.A., & Seracini, A.G. (2001). Family risk factors and interventions. In R. Loeber & D. P. Farrington (Eds.), Child delinquents: Development, intervention, and service needs (pp. 165—189). Thousand Oaks, CA: Sage.
• Wiebush, R.G., Baird, C., Krisberg, B., & Onek, D. (1995). Risk assessment and classification for serious, violent, and chronic juvenile offenders. In J. C. Howell, B. Krisberg, J. D. Hawkins, & J. J. Wilson (Eds.), A sourcebook: Serious, violent, & chronic juvenile offenders (pp. 171-210). Thousand Oaks, CA: Sage.
• Wright, K.N., Clear, T.R., & Dickinson, P. (1984). Universal applicability of probation risk assessment instruments. Criminology, 22, 113-134.[CrossRef][Web of Science]

Crime & Delinquency, Vol. 53, No. 4, 552-580 (2007)
DOI: 10.1177/0011128706293689


CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    Twitter    What's this?

This article has been cited by other articles:

				T. Q. Emeka and J. R. Sorensen Female Juvenile Risk: Is There a Need for Gendered Assessment Instruments? Youth Violence and Juvenile Justice, October 1, 2009; 7(4): 313 - 330. [Abstract] [PDF]

				C. S. Schwalbe A Meta-Analysis of Juvenile Justice Risk Assessment Instruments: Predictive Validity by Gender Criminal Justice and Behavior, November 1, 2008; 35(11): 1367 - 1381. [Abstract] [PDF]

This Article Abstract Free Full Text (Free PDF) Free Alert me when this article is cited Alert me if a correction is posted Citation Map Services Email this article to a friend Similar articles in this journal Similar articles in Web of Science Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Citing Articles via Scopus Google Scholar Articles by Miller, J. Articles by Lin, J. Search for Related Content Social Bookmarking                         What's this?