 |
 |
Targeting Excellence - Evaluation Outcomes
|
|
 |
 |
 |
The Army has four principal outcomes all FAP activities should be designed to achieve:
1. Safety: All FAP programs should be designed to reduce the levels of violence within the Army community through prevention, prompt intervention, and treatment. Safety is everyone's responsibility. A community with less violence and less fear of violence allows fuller participation by, and greater contribution from, all its members.
2. Self Sufficiency: All FAP programs should contribute to the development of strong, adaptable, interdependent families, individuals and couples. Strong, adaptable families are an asset for the Army. Strong families make strong soldiers.
3. Personnel Preparedness: All FAP programs should assist individuals, families, and couples with interpersonal relationships and the responsibilities of parenting. Preventing or resolving personal problems results in higher readiness, less time away from duty, and less distraction while on duty.
4. Community Cohesion: All FAP programs should create cohesion within the military community, promote command involvement, support interagency partnerships, and encourage the family's interaction and active participation within the Army community.
In order to achieve each of these outcomes, each of your activities should be designed with these outcomes explicitly in mind. To facilitate this, follow steps 1 to 6 outlined in this section when developing activities to reach your target audience.
Need
Output
Activity
Key
Outcome
Output
Activity
Need
Need
Activity
Output
STEP 1: PROGRAM OUTPUTS
Program outputs are the results achieved by the intervention or program at the termination of service that can be directly tied to program activities. If program outputs are achieved it will greatly increase the likelihood that the Army outcomes (e.g., safety, self sufficiency, personnel preparedness, and community cohesion) will occur. Each outcome is likely to have multiple program outputs associated with it. In order to identify these program outputs, ask yourself:
What does FAP need to accomplish in order to achieve the outcome (e.g., safety, self sufficiency, personnel preparedness, or community cohesion)?
Select one of the outcomes and list three to four potential program or clinical service outputs (PO) that would be directly related to that outcome.
OUTCOME: ________________________________________________________________________________________________
PO #1: ________________________________________________________________________________________________
PO #2: ________________________________________________________________________________________________
PO #3: ________________________________________________________________________________________________
PO #4: ________________________________________________________________________________________________
Program activities/clinical interventions are the specific activities that are designed to lead to the achievement of the program outputs. There are likely to be multiple program activities or clinical services which support each program output. Select two of the program outputs generated in step 1. List 2-3 potential activities or clinical interventions you could sponsor that have the potential to directly result in your target program outputs. In thinking about such program activities or clinical services, ask yourself:
What program activities or clinical interventions could we sponsor that would directly result in achieving the program output?
PO #1 (FROM STEP 1): _____________________________________________________________________________________________
Activity #1: _____________________________________________________________________________________________
Activity #2: _____________________________________________________________________________________________
Activity #3: _____________________________________________________________________________________________
Activity #4: _____________________________________________________________________________________________
PO #2 (FROM STEP 1): _____________________________________________________________________________________________
Activity #1: _____________________________________________________________________________________________
Activity #2: _____________________________________________________________________________________________
Activity #3: _____________________________________________________________________________________________
Activity #4:_____________________________________________________________________________________________
Success of any activity is contingent on numerous factors, one of which is the recognition of the importance of targeting a specific and well defined target audience to attempt to involve in the program activity or clinical intervention. For each of the activities generated in Step 2 for your PO#1, list who you want to participate. Ask yourself:
Who specifically am I trying to reach? (Think about gender, age, race, rank, community affiliation, at-risk status, vulnerability to stress, etc.)
Activity #1: ______________________________________________________________________________________________
Target Audience Characteristics:_____________________________________________________________________
______________________________________________________________________________________________
Activity #2: _______________________________________________________________________________________________
Target Audience Characteristics:____________________________________________________________________________________
_______________________________________________________________________________________________
Activity #3: ______________________________________________________________________________________________
Target Audience Characteristics:_____________________________________________________________________
______________________________________________________________________________________________
Activity #4: ______________________________________________________________________________________________
Target Audience Characteristics: _____________________________________________________________________
_________________________________________________________________________________________________________
Indicators are the desired outcomes for each of your planned activities or clinical interventions generated in Step 2. When thinking of indicators, consider what changes you would like to have occur if your activity is successful. Ask yourself:
How will I know that our activity or clinical intervention worked?
There should be multiple indicators for any given activity or clinical intervention. Select 2 of the activities generated in Step 2. List 2-3 potential indicators for each of the activities and list below.
Activity #1: _______________________________________________________________________________________________
Indicator #1: _______________________________________________________________________________________________
Indicator #2: _______________________________________________________________________________________________
Indicator #3: _______________________________________________________________________________________________
Activity #2: _______________________________________________________________________________________________
Indicator #1: _______________________________________________________________________________________________
Indicator #2: _______________________________________________________________________________________________
Indicator #3: _______________________________________________________________________________________________
Perhaps the most critical task is to consider how you will evaluate or measure the indicators of program activity success. That is, determine specifically how you will measure each of the indicators generated for any given activity or intervention. Ask yourself:
What kind of data do I need in order to evaluate the targeted indicators? Is that data already available? Do I need to collect new data or information? How should I collect that data or information?
Consider each of the indicators listed under Activity #1. For each indicator, list 2-3 measures that you could use for the indicator and how you would gather the information (e.g., existing data, case records, surveys, interviews, focus groups, etc.).
Indicator #1: ______________________________________________________________________________________________
Measure #1: ______________________________________________________________________________________________
Data Gathering Strategy: ______________________________________________________________________________________________
Measure #2: ______________________________________________________________________________________________
Data Gathering Strategy: ______________________________________________________________________________________________
Measure #3: ______________________________________________________________________________________________
Data Gathering Strategy: _______________________________________________________________________________________________
Indicator #2: _______________________________________________________________________________________________
Measure #1: _______________________________________________________________________________________________
Data Gathering Strategy: _______________________________________________________________________________________________
Measure #2: _______________________________________________________________________________________________
Data Gathering Strategy: _______________________________________________________________________________________________
| OUTCOME | PROGRAM OUTPUTS | PROGRAM ACTIVITIES/ CLINICAL INTERVENTIONS | INDICATORS |
| SAFETY | Reduce Level of Subsequent Violence Secure Family Environment Prompt Intervention |
Emergency Evaluation Safety Plan Screening for Homicidality and Suicidality Risk Evaluation Screening for Substance Abuse Domestic Violence Awareness WOrkshop Batterer's Group Victim Support Group Separation of Combatants |
Decrease in Number of ER Visits Decrease in Severity of Violence Decrease in Recidivism Decrease in Number of Substantiated Cases Percentage of Cases of Substantiated Abuse Identified Decrease Expressed Anger Increase Conflict Resolution Ability Percentage of Cases of Psychiatric/Other Referrals Perception of Safety and Support by Patient Response Time, Average Waiting Time |
| OUTCOME | PROGRAM OUTPUTS | PROGRAM ACTIVITIES/CLINICAL INTERVENTIONS | INDICATORS |
| SELF SUFFICIENCY | Adaptability- Coping Independent-Interdependent Socially Supportive |
Stress Management Couples Therapy Parent Education Individual Therapies Financial Management |
Improved MS Reduced Stress Reduced Anxiety Reduced Depression Increased Quality of Life Index More Community Involvement Increased Time with Family Increased Self-Referrals |
| OUTCOME | PROGRAM OUTPUTS | PROGRAM ACTIVITIES/ CLINICAL INTERVENTIONS | INDICATORS |
| PERSONNEL PREPARED- NESS |
OptimizedDuty Performance Appropriate Resource Use Personnel Management Fewer Returns from Field Appropriate Response From Command |
Time Management Programs Aimed at Efficient Use of Community Resources Chain of Command Briefings/Trainings |
Report of Supervisor Effective Use of Support Resources Monitoring of Personnel Performance Measures |
| OUTCOME | PROGRAM OUTPUTS | PROGRAM ACTIVITIES / CLINICAL INTERVENTIONS | INDICATORS |
| COMMUNITY COHESION | Command Support for FAP FAP Support for Command Community Awareness Provider Collaborations FAPM and Chief of Social Work Cooperation |
Command Briefings Awareness Programs Safety Measures/Policy Established FAP Policy Statement of No Tolerance of Abuse Widely Distributed MOA with Local Child Protection Services Established FAP Training for all Children's Services: Staff, e.g., CDS, FCC Referral/Crisis Intervention and Treatment Services Established Multi-method Treatment Modalities Tailored to Specific Identified Abuse Related Problems Initiation of Strong Prevention vs. Rehabilitation Focus of the FAP Establish and Publicize Reporting Requirements for FAP Cases |
Increase Command Knowledge Attendance at CRCs Command Support for Treatment Command Perception of FAP Support Visibility/Awareness of FAP Programs FAPM Member of Community-wide Councils Child Protective Services Representatives Attend CRC meetings Number of Self-Referrals to FAP Amount of Services Delivered Participation Rates in Prevention Programs Participant Satisfaction with the Program |
THIS MATERIAL WAS DEVELOPED FOR THE U.S. ARMY COMMUNITY AND FAMILY SUPPORT CENTER, FAMILY ADVOCACY PROGRAM BY STAFF OF THE FAMILY LIFE DEVELOPMENT CENTER IN COOPERATION WITH CORNELL COOPERATIVE EXTENSION, CORNELL UNIVERISTY, ITHACA, NY. THE MATERIAL IS BASED UPON WORK SUPPORTED BY THE EXTENSION SERVICE, U.S.. DEPARTMENT OF AGRICULTURE, UNDER SPECIAL PROJECT NUMBER 92-EXCA-3-0221.
THIS MATERIAL MAY BE REPRODUCED FOR FAP USE.