Overall program evaluation


#1

We are a jointly accredited institution and are just now moving toward Ethos as an LMS. This is the first time that we are using an online tool, and one of the documents we are redesigning is the overall program evaluation. Would anyone out there who is jointly accredited or ACCME accredited share examples of how you are presenting the required questions? Thanks!


#2

Hi, Marion! I think it depends on what you mean by “required questions.” If you’re talking about bias, we have one question with a follow-up if they answer yes:

Did you detect any commercial bias in this activity? *
Yes
No
No Answer

If you detected bias, please describe the biased content:


#3

We use the same process as Gail mentioned.
We have the yes no checkbox with a free form box for them to identify what the bias was.

Terry Frederick
Performance Improvement, QI, MOC, CME
Aurora Sinai Medical Center / Outpatient Health Center
1020 N. 12th Street, Suite 3130, Milwaukee, WI 53233


#4

Thanks. What I really wanted to see was what types of questions you are asking. Would you be willing to share?
We current ask the following:
Overall, this program was (rate 1 - 5)
Do you plan to apply what you learned here in your work? Yes/No
If no, why?
Do you have any questions regarding this topic that are still unanswered?
Speakers evaluated:
Cited up-to-date research
Inspired me to learn more
Engaging, should be invited back
Was a commercial product, device, or service promoted in this session?
If so, please comment.


#5

Our whole eval is 9 questions:

Please rate your ability to perform the following objectives upon completion of this activity, with 1 = Not confident and 5 = Able to demonstrate *
{{list of objectives to rate}}

Please rate the following: * (Poor, Fair, Good, Very Good, Excellent)
Quality of the content
Quality of the format
Relevance to your practice (patient care, research, teaching)

Did you detect any commercial bias in this activity? *
Yes
No
No Answer

If you detected bias, please describe the biased content:

Based on knowledge and skills you gained in completing this activity, do you plan to make changes to your practice (patient care, research, or teaching)? *
Yes
No
No Answer

If you plan to change your practice based on what you have learned, please describe below:

If you have not made or do not plan to make changes to your practice based on what you learned by completing this activity, please indicate why. Select all that apply:
__Need to learn more before I feel comfortable changing my practice
__Knowledge and skills I gained did not have an immediate application
__Knowledge and skills I gained reinforced my current practice behaviors
__Financial limitations
__Staffing limitations
__Other:

After attending this activity, what do you need to learn more about to improve your practice (patient care, research, or teaching)?

Please provide any additional comments you would like to share:


#6

Our evaluation is very long because we have the joint accreditation, but are also accredited providers for several other groups so in order to fit all the requirements for all of them into one evaluation it’s become a bit unruly.

This activity enabled achievement of the following learning objectives *
(for all objectives)
Strongly Agree Agree Neutral Disagree Strongly Disagree

I plan to apply the learning objectives of this activity to my practice *
Strongly Agree Agree Neutral Disagree Strongly Disagree

Conflict of interest or lack thereof pertaining to faculty and planning committee member(s) has been declared either verbally or in writing prior to the start of the activity *
Yes No

The content presented was current and evidence-based *
Strongly Agree Agree Neutral Disagree Strongly Disagree

The information presented was pertinent to my professional needs/scope of practice *
Strongly Agree Agree Neutral Disagree Strongly Disagree

Please rate the faculty:
Knowledgeable of the subject matter
Strongly Agree Agree Neutral Disagree Strongly Disagree
Delivered content effectively
Strongly Agree Agree Neutral Disagree Strongly Disagree
Recommended for future activities
Strongly Agree Agree Neutral Disagree Strongly Disagree

The information was presented in a fair and balanced manner *
Strongly Agree Agree Neutral Disagree Strongly Disagree

This activity was free of commercial bias and influence *
Strongly Agree Agree Neutral Disagree Strongly Disagree

The teaching and learning methods were effective for the subject matter and incorporated active learning *
Strongly Agree Agree Neutral Disagree Strongly Disagree

The learning assessment activities were appropriate *
Strongly Agree Agree Neutral Disagree Strongly Disagree

The educational materials provided will be useful in my practice *
Strongly Agree Agree Neutral Disagree Strongly Disagree

This activity will improve my ability to effectively treat and manage my patients *
Strongly Agree Agree Neutral Disagree Strongly Disagree

I was able to access all components of the activity without difficulty *
Yes No

Of the patients you will see in the next week, how many will benefit from the information you learned from this activity? *
50 or less 51-100 101-150 151-200 More than 200
This activity will assist to improve my (Select all that apply): *
Competence
Performance
Patient Outcomes
Skills/Strategies
Communication

Do you plan to make changes in your practice based on the information in this activity? *
Yes No
What is your level of commitment to making the changes stated above? *
Very committed
Somewhat committed
Not very committed
Do not expect to change practice

Do you anticipate barriers in implementing the information gained from this activity? *
Yes No
I would recommend this activity to my peers *
Yes No
How did you learn about this activity? *
Brochure
Email
Professional Journal
NKF Website
Co-Worker
Direct Mail
Don’t Recall
Other:

How long did it take you to complete this activity? *
15 minutes
30 minutes
45 minutes
1 hour
1.25 hours
1.5 hours
1.75 hours
2 hours

Additional comments/suggestions


#7

Thank you all for your input!


#8

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.