Performance Measures Training Welcome grantees and RSAT team members! July 19, 2017 Performance Measurement Tool (PMT) RSAT Performance Management Training Performance Measurement Tool (PMT) 7 Poll Question What is your role with the BJA funded RSAT program? Program/Grant Manager (grantee) Analyst/Data Collector Correctional Staff Social Worker
Case Manager Other Service Provider Other Dont know Performance Measurement Tool (PMT) 8 What is performance measurement? Definitions Ongoing data collection to determine if a program is implementing activities and achieving objectives. It measures inputs, outputs, and outcomes over time. In general, pre-post comparisons are used to assess change (BJA Center for Program Evaluation and Performance Measurement). Ongoing monitoring and reporting of program accomplishments, particularly progress toward program goals (Government
Accountability Office). Performance Measurement Tool (PMT) 9 Why do we have performance measures? To identify your (grantee) successes and potential areas of improvement. So you can improve your program To help us (BJA/DOJ) understand your (grantee) activity and progress So we can provide targeted training and technical assistance To help us (BJA/DOJ) understand what funds are being used for Informs the budget, strategic plan, future funding Respond to external requests (e.g., congressional inquiries, media requests) It is required by law
Yes, we have to do it Performance Measurement Tool (PMT) 10 BJA RSAT Program Goals The goal of the RSAT Program is to break the cycle of drug addiction and violence by reducing the demand for, use, and trafficking of illegal drugs. RSAT enhances the capabilities of states and units of local and tribal governments to provide residential substance abuse treatment for incarcerated inmates; prepares individuals for their reintegration into the communities from which they came by incorporating reentry planning activities into treatment programs; and assists individuals and their communities through the reentry process through the delivery of community-based treatment and other broad-based aftercare services. Treatment practices/services should be, to the extent possible,
evidence-based as shown through treatment outcomes that are consistent with RSAT program objectives. --FY 2017 RSAT Solicitation Performance Measurement Tool (PMT) 11 BJA RSAT Objectives Provide residential treatment facilities set apartin a completely separate facility, or a dedicated housing unit in a facility exclusively for use by RSAT program participantsfrom the general correctional population. Focus on the substance abuse problems of the RSAT program participants. Develop each RSAT program participants cognitive, behavioral, social, vocational, and other skills to solve substance abuse and related problems.
Require urinalysis and/or other proven reliable forms of drug and alcohol testing for RSAT program participants, including both periodic and random testing, and for former participants while they remain in the custody of the state or local government. Performance Measurement Tool (PMT) 12 BJA RSAT Objectives Focus on the substance abuse problems of the RSAT program participants. Total enrollment (target population) Participant completion/noncompletion rates
Reasons for noncompletion Length of time in program prior to completion (program requirement) Utilization of MAT (if applicable) Develop each RSAT program participants cognitive, behavioral, social, vocational, and other skills to solve substance abuse and related problems. Utilization of assessment tools Array of services received (substance abuse treatment is required)
Mental Health Employment Cognitive and Behavioral Case Planning Reentry Other (e.g., parenting classes, life skill training, education/GED) Require urinalysis and/or other proven reliable forms of drug and alcohol testing Utilization of urinalysis testing Rates of clean/dirty tests by participants Performance Measurement Tool (PMT)
13 RSAT Performance Management Training What are BJAs PM Products and Processes? Performance Measurement Tool (PMT) 14 Performance Management Products Bureau of Justice Assistances Performance Management Products Product GMS Report Audience
Grantees Dashboard Grantees and general public Purpose Level of Analysis Frequency Semiannual January and July Uploaded to GMS for accountability
System generated Data available for review by manager or grantee Simple illustration of PMT data for a single award (note: JAG will also contain an Excel document containing a summary of all data) A tool for grantees to create reports for comparisons Basic analysis, including data preparation and limited coding Quarterly January, April,
July, and October Moderate level of analysis, including measures of variance Semiannual January and July Annual December Provides convenient view of key program measures Delivers transparency of program activity Grantee
Feedback Report (GFR) Grantees TTA providers Policy advisors get a snapshot of overall program performance Program Update Congress, Senate Presents overall performance of grant program over time
High level of analysis at the program level General public Highlights program accomplishments OJP/BJA leadership Details program contribution to overall OJP/BJA strategic objectives Analysis of both quantitative and qualitative data Policy advisors
Allows grantee to make comparisons to similar programs Grant managers Identifies grantees that exceed or do Moderate level of analysis at the grantee not meet program- specific expectations level as determined by performance metrics Policy advisors Some more complex calculations (e.g., indices) TTA providers Identifies grantees that may need TTA Feeds directly into the performance metric for GrantStat
Semiannual October and April GrantStat Grant managers Ad Hoc Identifies grantees that exceed or do Hi level of analysis at the grantee level not meet program- specific expectations Analysis of financial, performance, across multiple dimensions Policy advisors
program design and Grant Assessment Highlights overall programmatic issues Tool (GAT). TTA providers Informs overall program understanding and may lead to changes in future solicitations M A N U A L A N A L Y S IS Mini-GrantStat SYSTEM G ENERATED Grant managers (SPAs)
Development TBD Note: This graphic does not include: specialty products/analysis produced for specific programs or data requests or analysis conducted as part of evaluation research. Performance Measurement Tool (PMT) 15 What is a Grantee Feedback Report? Contains data on key performance measures Looks at aggregate totals, averages, and ranges Allows you to compare your RSAT site to others and the RSAT program as a whole Gives an overview of the program, including number of grants and funding amount Provides you with TTA information to improve your outcomes
The central tool in our suite of new reports Performance Measurement Tool (PMT) 16 What is Mini-GrantStat? The GOAL of Mini-GrantStat is to use performance data to drive internal decision making that leads to improved practices in the field. The GOAL of GrantStat is to use data to assess grantee practices, assess the overall health of programs, and improve BJA practices, and drive decision-making. Performance Measurement Tool (PMT)
What is Mini-GrantStat? Internal process for BJA staff to look at performance data Provides a mechanism for the discussion of non-reporting (PMT), data inconsistencies, high performance, and under performance Helps to identify training needs Provides BJA staff with data that helps to develop or direct technical assistance Performance Measurement Tool (PMT) 18 RSAT Performance Measures: A Brief Overview *Poll Question Performance Measurement Tool (PMT)
19 What is the Performance Measurement Tool? The Performance Measurement Tool (PMT) is an online questionnaire (see https://bjapmt.ojp.gov) that grantees must complete every quarter The PMT includes performance measures (completed quarterly) and narrative questions (completed semi-annually) Grantees have 30 days at the end of the reporting period to complete the PMT data entry Performance Measurement Tool (PMT) 20 RSAT Performance Measures
A few things to remember: Report PMT data for each active award separately. DO NOT DUPLICATE data. PMT Reporting is award-based Required each quarter PMT GMS reports are required every 6-months (January and July of each year) Question Types Administrative Program Level/Program Characteristics Training Participant Level Narrative Performance Measurement Tool (PMT)
21 Administrative Questions Performance Measurement Tool (PMT) 22 Program Level Measures Performance Measurement Tool (PMT) 23 Program Level Measures Please respond to this question based on the physical location of the federally funded program.
A jail-based program is one that is physically located within a locally run (non-state) entity. Jails are typically short-term facilities holding inmates of terms for less than one year. A prison-based program is one that is physically located within a facility operated by state and typically holds felons and persons with sentences of more than one year. (This may vary by state.) Performance Measurement Tool (PMT) 24 Program Level Measures Performance Measurement Tool (PMT) 25 Program Level Measures
Performance Measurement Tool (PMT) 26 Training 9 Performance Measurement Tool (PMT) 27 Participant Level Measures The following questions pertain to individuals who are receiving services in your RSAT program. The following sections include the following: Risk Assessment and Treatment Planning, Number of Participants Receiving Services, Services Provided, Program Completion, Alcohol and Substance Involvement, and Court and Criminal Involvement. For these questions,
please report the number of individuals that is equal to the proportion of the Federal funds (plus matching funds) of your total annual budget for the RSAT program. For example, if the BJA RSAT grant (plus matching funds) accounts for 65% of the total annual budget, then please report on 65% of the program participants. When applying the percentage, please round to the nearest whole number. Similarly, if BJA RSAT funds (plus matching funds) are paying for a specific number of beds/treatment spaces within your facility, please report on those individuals who are occupying those beds/treatment spaces. Performance Measurement Tool (PMT) 28 Participant Level Measures Performance Measurement Tool (PMT)
29 Participant Level Measures Performance Measurement Tool (PMT) 30 Participant Level Measures The text highlighted should be interpreted as new participants that started in the program during the reporting period. (Question 16 for Jail/Prison and 38 for Aftercare) Performance Measurement Tool (PMT) 31 Participant Level Measures
Performance Measurement Tool (PMT) 32 Participant Level Measures Count of the RSAT population as of a certain point in time NEW means that the inmate was previously in the general population, or otherwise has not received services through the RSAT program prior to the existing reporting period. Performance Measurement Tool (PMT) 33
Participant Level Measures Performance Measurement Tool (PMT) 34 Participant Level Measures Performance Measurement Tool (PMT) 35 Participant Level Measures Respond to these questions even if federal grant funds are not used for MAT. Performance Measurement Tool (PMT)
36 Participant Level Measures Performance Measurement Tool (PMT) 37 Participant Level Measures Program completion means that a program participant completed all required as determined by your policies, procedures, or practices. This could include, but not limited
to length of time in the program, substance abuse treatment, administrative requirements, urinalysis testing, and other educational or cognitive services. Performance Measurement Tool (PMT) 38 Participant Level Measures Performance Measurement Tool (PMT) 39
Participant Level Measures Did not complete means those that are no longer participating in the RSAT program and were removed without completing all the program requirements. Performance Measurement Tool (PMT) 40 Participant Level Measures Performance Measurement Tool (PMT) 41 Participant Level Measures
Participant Level Measures Performance Measurement Tool (PMT) 45 Participant Level Measures: Court and Criminal Involvement Performance Measurement Tool (PMT) 46 Participant Level Measures: Court and Criminal Involvement 31A is the number of active participants in
the program at closeout. 31B/C is the total number of participants that completed/did not complete the RSAT program during the time period that corresponds with the award start and end dates. 31D is the total number of participants released into mandated aftercare during the time period that corresponds with the award start and
end dates. Performance Measurement Tool (PMT) 47 Narrative Questions* What were your accomplishments within this reporting period? What goals were accomplished, as they relate to your grant application? What problems/barriers did you encounter, if any, within the reporting period that prevented you from reaching your goals or milestones? Is they any assistance that BJA can provide to address any problems/barriers identified in question #3? Are you on track to fiscally and programmatically complete you program as outlined in your grant application? What major activities are planned for the next 6 months? Based on your knowledge of the criminal justice field, are there any
innovative programs/accomplishments that you would like to share with BJA? *NOTE: NARRATIVE QUESTIONS ARE ONLY REQUIRED OF THE FEDERAL GRANTEE. Performance Measurement Tool (PMT) 48 RSAT Performance Measures A more in depth training is available on the Information and Resources page in the PMT (link provided here): https://bjapmt.ojp.gov/Training/Pages/RecordingInformation.html? title=BJA%20PMT%20-%20Measures%20&%20PMT%20Training %20(RSAT)-20161027%201702-1 Performance Measurement Tool (PMT)
49 A LOOK AT THE DATA: Some Results through March 2016 Performance Measurement Tool (PMT) 50 Grant Funds Table 1. Federal Appropriation and State Awards by Federal Fiscal Year State Awards Fiscal Year 2013 (N = 53)
Total Appropriation $10,589,247 Minimum $42,357 Average $197,301 Maximum $1,103,224 2014 (N = 53) 8,637,752
10,328,336 41,313 194,874 1,048,370 Fiscal appropriations ranged form a low of $8.6 million to a high of $10.5 million. Average state appropriations ranged from a minimum of $34,551 to a high of just over $1.1 million. The allocations are based on a formula that provides each State and Territory with a base amount, plus an allocation in proportion to the ratio that its prison population bears to the total prison population of all States and Territories. The prison population includes all inmates under the jurisdiction of the State or Territory for whom the State has legal authority and responsibility. [https://www.bja.gov/Funding/16RSATAllocations.pdf]
Performance Measurement Tool (PMT) 51 RSAT Programs Figure 1. Map of BJA-Funded RSAT Programs: October 2015March 2016  The U.S. territories of Guam and American Samoa are not included in this map.  Not all subawards are not included due to limited available geographic information. Performance Measurement Tool (PMT) 52 BJA and Matching Funds Spent Figure 2. Federal and Nonfederal Matching Funds Spent by Expense Category: October 2015March 2016
Other ; 5.19% Contract ; 43.11% Personnel; 48.20% Equipment ; 3.50% Of the $9.9 million spent during October 2015-March 2015: 48% went to personnel and fringe benefits 43% went to contracts, which include contracted services for treatment, housing, and employment services if not conducted in-house Performance Measurement Tool (PMT) 53 Participant Key Measures
In October 2015 and March 2016 Enrollment on any given day is: Prison programs: 7,000-8,000 participants Jail programs: about 2,800 participants Juvenile programs: 450-600 participants Aftercare programs: 330-680 participants Performance Measurement Tool (PMT) 54 Program Completion Rates: Prison, Jail, and Juvenile Programs
Figure 3. Percentage of Participants Completing or Unsuccessfully Exiting the Program: October 2015March 2016 80% 70% Successful Completion 71% 67% Unsuccessful Completion Release, Transfer, Death, Injury 60% 53%
Jail (N=42) Residential/Prison (N=43) Juvenile (N=9) 18% 10% 0% 23% Juvenile Note that program completion is calculated by taking the total number of participants that successfully complete the program divided by the total number of person exiting the program during a defined time period. Performance Measurement Tool (PMT)
55 Program Completion Rates: Aftercare Programs Number of Participants Figure 4. Number of Participants Completing Versus Not Completing Program: October 2015March 2016 (N=14) 300 258 250 200 150 100 61 50 11
0 Successful Completers Terminated Participants Release, Transfer, Death, or Serious Injury Average completion rate during this 6-month period was 18.4% and atypical. Aftercare completion rates typically range from 18 to 50%. Note that program completion is calculated by taking the total number of participants that successfully complete the program divided by the total number of person exiting the program during a defined time period. Performance Measurement Tool (PMT)
56 Program Completers Figure 5. Time in Program for Program Completers 90 80 80 70 60 Percentage 53 50 42 40
Aftercare (N=14) 10 or More Months Performance Measurement Tool (PMT) 57 Participants Exiting Without Completion Figure 5. Time in For Participants Exiting Without Completion 100 96 90 82 80
Percentage 70 58 60 52 50 40 33 30 20 20 12
10 0 18 11 4 4 2 Jail (N=42) 0 to 3 Months Prison (N=43) 4 to 6 Months
4 Juvenile (N=9) 7 to 9 Months 2 2 Aftercare (N=14) 0 10 or More Months Performance Measurement Tool (PMT) 58 Risk and Needs Assessments
90% of jail grantees, 98 percent of prison, and 100 percent of programs serving juveniles use an assessment tool LSI-R (17%), Compas (8%), GAIN (7%), and LSCMI (3%) are most common. Performance Measurement Tool (PMT) 59 Resources PMT Web Site: https://bjapmt.ojp.gov PMT Help Desk: MondayFriday 8:30 a.m.5:30 p.m. ET Toll-free number: 1-888-252-6867 E-mail: [email protected]
On behalf of BJA and the PMT team, thank you for your dedication and hard work! Performance Measurement Tool (PMT) 60 Questions? Performance Measurement Tool (PMT) 61 Questions? Type your question in the Q&A box on your computer screen
Speaker Contact Info Jimmy Steyee [email protected] 02/06/2020 62 Always Happy to Hear From You Thank you all for the great work you do! We know your job is not easy, but we aim to make it a bit easier & are always happy to hear how we can do so Contact me anytime with inquiries about the topics we have covered: [email protected] Also appreciate hearing about your experiences & innovations Thank you for your participation 02/06/2020
RSAT Technical Assistance and Training Center For more information on RSAT training and technical assistance visit: http://www.rsat-tta.com/Home or email Stephen Keller, RSAT TA Coordinator at [email protected] 02/06/2020 66
190 Volts (rms) - 2005. Conclusions RMS Larmor angle in the CS is calculated as 40 μrad - marginally tolerable for cooling. The same result was found in 2005, although the spectra differ significantly. BPM noise is white - both...
A performance task incorporating multiple disciplines which requires students to engage with texts, images, diagrams and other resources and then compose a narrative, informational/ explanatory text, or opinion (3-5)/argument (6-HS). ... provided through KITE.
It's unisex, although we do have our men's line as well. It is designed to PREVENT and REPAIR problems such as sun damage, wrinkles, fine lines, and age spots. It's a 5 step line with a Cleanser, Toner, Serum, Eye...
Conquering Malaria Burden Ecology and manifestations Successes Control Research and training Burden The Global Burden of Malaria 1.5 - 2.7 million deaths annually Over 1 billion clinical episodes 300 - 500 million people infected Every 10 - 30 seconds a...
TIQA. Your body paragraphs should provide a topic sentence. The rest of the paragraph should provide context for a quote or paraphrase. Then you should provide that example. After you provide that example, you should explain how it supports your...
What Is the Nutrition Facts Label? The Nutrition Facts label is a label found on the outside packages of food that states how many servings are in the container, how many Calories are in each serving, and the amount of...
Manulife Financial Other titles Times New Roman Blank Presentation Microsoft Clip Gallery Have Your Cake, Have Your Cake, Have Your Cake, Have Your Cake, Have Your Cake, Have Your Cake, Have Your Cake, Have Your Cake, Have Your Cake, Have...
Ready to download the document? Go ahead and hit continue!