Instructional Design: Course Evaluation and Capstone Project

Week One: Minicourse Features & LMS Declaration

For my Minicourse training on MEAL framework, the following learning features are going to be used.

Interactive Quizzes: These assessments are to provide immediate feedback, and help training participants gauge their understanding of the training material.
Discussion Forums: this online learning platform is to enable training participants to discuss course material, share ideas, and ask questions, promoting community of practices and collaboration.
Assignments and Projects: Tasks that require training participants to apply what they've learned, ranging from written assignments to practical concept notes and projects.
Case Studies and Scenario-Based Learning: Real-world scenarios or case studies that training participants analyze and solve, and to encourage practical application of concepts in to day to day works.
Self-Assessment Tools: Tools that allow students to assess their knowledge and skills independently, often used for reflection and personal growth.

LMS Declaration

For my Minicourse training on MEAL framework, I selected the Canvas LMS. I decided to use it because it has free version or it does not require a paid membership and it is commonly used both in K-12 and higher education systems for teachers and teacher educator’s development. Canvas offers a Free-for-Teacher option that has all of the course level features. In addition, on Canvas LMS, lots of tutorials and resources to help learn how to use the LMS are available. Another attribute of Canvas is the features it contains such as discussion forum, use of videos, quizzes and assignments, grading, a class syllabus and the rubrics for assessment.

Supportive Resources

Canvas has a lot of supportive resources for the instructor. The initial email also sends a link for a tutorial to help get you started with how to navigate the site, and even directs you to a course on Canvas that you can download to your dashboard.

Canvas Instructor Guide: https://community.canvaslms.com/t5/Instructor-Guide/tkb-p/Instructor
Get to Know Canvas Free for Teacher/Instructure : https://www.instructure.com/canvas-free-for-teacher/orientation
Video Guides for your Canvas Role: Video Guide - Instructure Community (canvaslms.com)
Instructure Community: Home - Instructure Community (canvaslms.com)
Canvas Free Training Options: https://community.canvaslms.com/t5/Training/tkb-p/Training

Week Two_Kirpatrick Level 1 Survey

Course Evaluation Survey - for Introduction to Monitoring and Evaluation.

I created my Course Evaluation Kirkpatrick Level 1 Survey on the LMS I will use to deliver the course, that is Canvas.

The course evaluation questions try to cover different aspects of the learning experience, i.e., learners' expectations before and after completing the course, effectiveness of course assignments for real work and real-life applications, instructor's feedback, the satisfaction with course contents and the level of peer interaction, and the use of the learning platform. I will use the responses of training participants to understand what aspects of the course could be improved and adjusted.

The course evaluation survey questions consist of multiple choices, True or False, Likert-scale questions and open-ended questions.

Course Evaluations Surveys Access

Use the following details to view the course evaluation survey:

Course URL: https://canvas.instructure.com/courses/9166309/quizzes/17734747/take?preview=1

Email: frekasu@gmail.com

Password: 2420@Kabelua#

Once you login, go to dashboard, click on Quizzes and then on questions.

If you face any issues accessing the survey, please e-mail me at frekasu@gmail.com.

Week Three:Kirkpatrick Level 2 Assessments

The week 3 Kirkpatrick Level 2 Assessments considered the following CLOs, and LOs for MEAL framework Training.

Course Learning Outcomes:

CLO1-Understand basics, concepts, and facts of M&E plus accountability & learning, and design MEAL Framework for English Programmes
CLO2-Interpret both quantitative and qualitative data for informed decision making and learning purposes.
CLO3-Create the accountability mechanisms for MEAL framework at various levels for English Programme.
CLO4-Determine and select the M&E data collection and analysis methods and tools for evidence based & informed decision-making programming purpose.
CLO5-Apply both qualitative and quantitative data collection and analysis tools skills and knowledge for MEAL framework in English Programmes

and the following Learning Objectives:

LO1: After completion of this module, training participants will be able to differentiate the monitoring, evaluation, accountability and learning terminologies and discuss when to do the M&E (CLO1).
LO2: At the end of this Module, training participants will be able to identify different types of MEAL framework significances for English Programmes (CLO1)

LO3: After completion of this module, training participants will be able to understand the M&E principles for English Programmes (CLO3)
LO4: At the end of this module, training participants will be able to name some MEAL standards to be employed for English Programmes (CLO3)

LO5: After completion of this module, training participants will be able to develop clear roles and responsibilities of MEAL for English Programmes (CLO3)
LO6: At the end of this module, training participants will be able to determine various accountability mechanisms for English Programmes.

Reflection

The final examination for course evaluation assessment is created by using Canvas.

There are total of 12 questions and to complete the exam, training participants have given 50-minutes. The final exam question assessments constitute True/False, Multiple-choices, real-world scenarios and case study types. Training participants have given three possible attempts for each question within 50-minute time period. After their final attempt, the correct answers are visible, and their highest score will be recorded. Training participants must score 70% points to pass this online course.

I tried to align the course assessments with Course Learning outcomes, learning objectives and activities across course modules. Due to the nature of my Minicourse training, I deliberately used multiple choices, real-world scenarios and case study focussed questions to gauge training participants’ knowledge, skills and behaviors in relation to Kirkpatrick Level 2 assessment. In addition, across all training modules, I have planned to employ knowledge checks for training participants.

Final Exam Assessment (Kirkpatrick Level 2) Access

The final exam assessment is created by using Canvas. Please click on the link below and use the email address and password to log in. Once you have logged in, click on dashboard and then Quizzes and at Final Exam Assessments on MEAL Framework Training.

The Course Assessment Link: https://canvas.instructure.com/courses/9166309/quizzes/17772406

Email: frekasu@gmail.com

Password :2420@Kabelua#

Week Four-Discussion and Assignment Prompts

Discussion Board 1:

Dear all training participants you have already been introduced or familiarized yourselves with the module that talks about basic concepts, significance and implementation of MEAL framework. Based on information you gained, discuss as how you can prioritize information on significance of MEAL framework in your work.

What do you already know about the MEAL framework in projects management? What do you want to know more about it and its significance?

This discussion board is directly aligned with CLO1 in Module 1, and with LO1 & LO2 of the MEAL framework Minicourse Training.

Discussion Board 2:

It’s quite important that Monitoring, Evaluation, Accountability, and Learning (MEAL) is critical for organizations to ensure that their programs are effective, efficient, and sustainable. In addition, there are driving factors or reasons why MEAL is important include Evidence-based decision-making, Program Improvement, Accountability, Learning & Adaptation, and Sustainability. However, ensuring Accountability for MEAL system is a serious challenge for many development organizations.

What do you think are mechanisms/strategies to ensure accountability? What best practices do you think can be solutions for this? how and why? the second discussion board prompt is aligned with the CLO3-Create the accountability mechanisms for MEAL framework at various levels for English Programme and with:

LO5: After completion of this module, training participants will be able to develop clear roles and responsibilities of MEAL for English Programmes (CLO3)
LO6: At the end of this module, training participants will be able to determine various accountability mechanisms for English Programmes

Discussions Link _https://canvas.instructure.com/courses/9166309/discussion_topics

Assignment Prompt on MEAL Framework Minicourse Training Modules 1 and 3

Instruction: Use the information from the presentations of a course, discussion boards, case studies and resource materials provided to answer the following questions. Each answer must have not more than 200 words, to be written by using Arial Text Style with font size of 12, and 1.15 line spacing.

Purpose of the Assignment Prompt: This assignment is mainly to give you an opportunity to understand about basic concepts, significances and implementation of MEAL framework (Module 1-CLO1), and also for your attention to different mechanisms to establish Accountability in MEAL framework (Module 3-CLO3) for projects and programs management. This assignment will prepare you to analyze the points included and presented on MEAL framework or system by different development organizations. It also helps you to evaluate the validity of MEAL components, Principles and standards so that you will develop your MEAL system for your works. Finally, this assignment will help you in your academic, professional, civic (community), and personal lives development.

Due date of Assignment: May 30,2024 Total Points of Assignment :10 Points.

Assignment Prompt Link_ https://canvas.instructure.com/courses/9166309/assignments/45710963

Assignment Prompt

Reflections

The 1st discussion board is initiated mainly to spur active discussion among the training participants by encouraging them to share what they already know about the MEAL framework concept or related concept, and to be an equally impactful way to get the conversation flowing. In addition, the 1st discussion board reduce barriers to participation in the discussion; they don't have to come up with an innovative idea to have something worth sharing.

Finally,1st board discussion can give me an insight into existing knowledge and experience with training participants, so that I can tailor upcoming exercises accordingly.

The 2nd discussion board is created mainly to encourage training participants to push into exercising higher-level thinking of Bloom’s Taxonomy. It’s also created to encourage training participants’ analysis, critical thinking, to make them more engaged in their own arguments and to spur their different opinions.

The Assignment Prompt is prepared to take through the training participants to do their critical thinking and analysis, to encourage and engage them in their reflections and opinions and to give them an opportunity for their arguments. For all these expectations, reference materials and case studies in practice of MEAL system by different development organizations are provided with training participants for the assignment prompt. For Assignment prompt work, training participants are encouraged or informed to use course lectures/presentations and discussion boards. The objective/purpose and due date of the assignment prompt are clearly indicated to them as well.

Finally, clear instructions are provided to training participants for assignment prompt as well.

Week Five-Discussion and Assignment Rubrics

Rubric 1: Discussion on Basic concepts, significance, and implementation of the MEAL framework.

Dear all training participants you have already been gone deeply or familiarized yourselves with the module that talks about basic concepts, significance and implementation of MEAL framework during your week 4 discussion board. Based on information you gained:

Discuss as how you can prioritize, generate and apply information on significance of MEAL framework in your work. (10 pts)
What practical experiences do you have in projects management before by using MEAL framework? Would you share examples? (10 pts)
Discus the significances of MEAL framework you gained from discussion by using examples that would help your works. (5 pts)
What do you want to know more about MEAL framework and its significance? (5 pts)

You are expected to participate in the course discussion forum. You are also expected to reply to at least three learner peers’ postings per discussion board topic. Peer replies should be thoughtful, reflective, and respectful while prompting further discussion using content knowledge, critical thinking skills, questioning, and relevant information of the topic. The following are discussion board posting criteria or guidelines on how to participate actively and score the grade.

Substantial – your posts should relate to the topic and provide information, opinions, or questions.
Concise – All messages you are posting should be clear.
Be provocative – Your posts should prompt others to reply or object
Explanatory – explore, explain or expand on a concept of connection
Logical – your post should contain a clearly stated conclusion supported by premises, reason, evidence
Do not post “I agree,” or similar, statements. Rather, expand by bringing in related examples, concepts, and experiences.
Stay on the topic of the thread – do not stray.
Grammatical – your posts are expected to be good, clear, concise post free of typos and fragments (similar to the tone and manner you would use within a professional environment).
Spell check all posts prior to posting.
My final expectation is that you read every posting and reply to a minimum of 3 posts in a manner that can lend further insight, and/or offer a different perspective. Your grade will include quality and quantity of responses.

With all these aforementioned criteria and guidelines, you are expected to understand MEAL elements concepts clearly, to identify the applicable significances of MEAL framework and you are also expected to indicate your decision of MEAL framework significance for your project’s management.

Submission Guidelines:

Post/Submit your responses to the discussion board prompts not more than 250 words for each.
Adhere to the discussion criteria/guidelines while posting your responses.
You are expected to reply to at least three learner peers’ postings

Evaluation Criteria:

Your discussion board responses will be evaluated based on the following criteria:

Adherence to the discussion forum guidelines (10 pts)
Clarity, accuracy, and relevance of the information with discussion forum topic (35 pts)
Understanding the discussion topic (20 pts)
Quality and quantity of the responses and/or posts. (15 pts)
Overall coherence and organization (20 pts) .This discussion board counts total of 30% score or grade, and the passing score will be 18%.

Discussion Rubric

Rubric 2-MEAL Framework Minicourse Training Modules 1 and 3

Instruction: Use the information from the presentations of a course, discussion boards, case studies and resource materials provided to answer the following questions. Each answer must have not more than 250 words, to be written by using Arial Text Style with font size of 12, and 1.15 line spacing.

Expectations from assignment prompt include but not limited to read every assignment prompts and reply accordingly in a manner that can lend further insight, and/or offer a different perspective. Your score or grade will include quality and quantity of responses. You are expected to understand MEAL elements concepts clearly, to identify the applicable significances of MEAL framework, and your substantial responses to all questions are expected to clarify expectations, such as providing examples, practical best practices, making connections with theoretical concepts, or evaluation practices.

Due date of Assignment: June 20,2024 Total Points of Assignment :70 Points.

In the reference materials provided on (MEAL Strategy, MEAL Policy, MEAL guideline), different organizations have put the MEAL frameworks in place for purposes of effective projects and programs management. According to your review and analysis, what common points did organizations have on MEAL framework? What are your critiques on applicability of MEAL frameworks based on organizations contexts? What did you learn from organizations’ MEAL frameworks for your use? Explain in detail. (20 Points)
In the case study 1, Mercy Corp’s MEAL system failed to put a robust data management system in place. Because of this, what do you think are the challenges and/or shortcomings to success of MEAL system? What strengths does the case study have? Synthesize information from discussions, presentations, and case studies with examples for your use and applicability. Explain in detail and put your experiences. (20 Points)
In the case study 2, the World Vision’s MEAL system missed to indicate or design and to provide regular feedback mechanisms to program participants who were involved in the design and implementation of the program. What would be the major challenges and/or gaps that the organization face while implementing a MEAL system? What strengths does the case study have? What would be your recommendations on this? Explain in detail. ( 20 Points)
List major four points/ things you found in the discussion boards of training modules, from Case Studies and reference materials that are interesting and useful to you. What did you learn? (10 Points)

I will use the rubric below to evaluate your assignment prompt. This assignment prompt counts toward 70% of your final grade.

The responses below 35 points have no marks or grade.

Assignment Prompt Rubrics

REFLECTION

While creating the rubrics, I have tried to align them to the course learning objectives, and focus on key elements such as thoughtfulness, reflective,and respectfulness to prompt further discussion using content knowledge, critical thinking skills, questioning, and relevant information of the topics.

I also encouraged learners to review rubrics before their submissions, to understand clear expectations and reminders of the quality and quantity of responses they should produce. Students have the option to improve their score for discussion prompt posts following the feedback received from the instructor and re-submit it a second time.

Creating rubrics for both discussion and assignment prompts needs a caution and it’s a lot of work. In addition, analyzing different rubric criteria helped me to look more critically at the materials I am providing with learners. I also believe in the information I gather after assessing students by using rubrics I created would also be instrumental in bridging the potential gaps in the training modules.

WEEK Six-Learning Theories/ID Models & Opening Presentation

REFLECTION ON LEARNING THEORIES

Initially I decided to employ two learning theories for my minicourse but following ID Course evaluation and Capstone project week 6 course, I decided to include one more additional learning theory because of the nature of my minicourse, and to fully address needs of training participants. So that, I found blending of three learning theories as the most influential in creating and designing my Minicourse:

Constructivism: Constructivism encourages learners to construct their own understanding of the world through experiencing things, reflecting on diverse perspectives, and then reflecting upon this experience, and enable them in applying concepts to solve real-world problems. Such an approach also not only fosters a deeper understanding of the subject matter but also cultivates essential skills like critical thinking, communication, and teamwork. Because of these and other reasons, I provided my training participants with opportunities to actively engage with materials/resources on reviewing and analyzing the best practices and lessons learned on MEAL frameworks from other organizations, and to make connections between new information and their existing knowledge.
Andragogy: I selected the Andragogy learning theory, because this learning approach is well known for being self-directed, problem-solving oriented, and adults’ centered learning. The target audience of my mini-course training are adults with many years of practical work and life experiences, and I employed this theory to design content to be relevant, practical, applicable, and allowing learners to immediately use new knowledge to their day to day works and activities. So that the knowledge gained through andragogy in the mini course will give the adult learners the key to solve real world problems that directly linked to their life and directly connected with their jobs. The minicourse training participants will also need to adapt those skills learned in the mini course to their own reality. In addition, in each training modules there are practical assignments with real world scenarios and case studies that they can apply directly into their day to day lives and works.
Connectivism: I decided to employ Connectivism because my mini-course training on MEAL framework will be mostly online and the connection with all training participants from different continents of the world will enrich the experiences, and will give opportunities in sharing experiences globally. Plus, connectivism emphasizes the integration of technology in learning, the need to be at ease searching for information online.

My mini course training on MEAL framework is hosted in Canvas, a popular LMS that offers the opportunity to complete the modules in different devices. The training participants can complete the modules at any time and different multimedia resources are included such as You tube videos, online articles, Case Studies, etc. Quizzes and online discussion forums included across training modules can facilitate peer interaction and knowledge sharing as well.

REFLECTION ON INSTRUCTIONAL DESIGN MODELS

For my minicourse training on MEAL framework, I decided to use two combined instructional Design models such as ADDIE and SAM design models.

The driving factor that encouraged me for ADDIE model is that ADDIE learning development model is commonly used because it’s highly adaptable and suitable for different industries, disciplines, and learning environments as well as for different scale projects. Its structured approach can boost efficiency and consistency in the quality of course development as well. This nature of ADDIE also fits with British Council’s English Programmes strategic plan. Plus, ADDIE is an iterative model which allows feedback, continous improvement, evaluation, and changes at every stage to ensure learning objectives are met.

In addition, because of iterative nature of ADDIE and today’s dynamic nature of the world, I decided to use the SAM model as a second instructional design model for minicourse. This is because its agility, flexibility, and adaptability nature gives a room for training participants adjustment of MEAL framework based on best practices and lessons learned they will acquire .

In addition, both ADDIE and SAM designing models have the following common characteristics in designing learnings and projects, and very fit with training modules.

Iterative Nature: ADDIE and SAM are iterative models that emphasize multiple design, development, and evaluation cycles. They recognize the importance of continuous improvement in the instructional design process which is highly imperative for MEAL framework.
End-User Focus: Both models prioritize the needs of learners and end-users. They advocate for involving stakeholders, subject matter experts, and learners early in the design process to ensure that the final instructional materials align with learner needs and learning objectives in which the MEAL framework implementation requires participatory stakeholders at all levels.
Phased Approach: ADDIE and SAM share a phased approach to instructional design. They both break down the process into distinct stages, providing structure and guidance for designers.

My minicourse training on MEAL framework requires improvement by incorporating new ideas, best practices and insights for projects and programs management to cope with dynamic world. Therefore, these two instructional design models for minicourse training on MEAL framework will help English Programmes team to meet the needs and end users in a phased approach from analysis to learning.

Both instructional design models helped me to keep LOs in mind and check my materials and assignments to make sure that they are aligned with LOs.

Reflection on Opening Presentation Screencast

The screencast I developed for week 6 assignment is on MEAL Framework Minicourse Training Overview and an introduction to Module 1 to training participants. I developed a script on Microsoft power point and employed Loom software for screen recording activity and added closed Captions function. Finally, exported it to YouTube.

So that, you can watch the video either on YouTube or via the course itself. Access information is listed below.

ULK: https://www.youtube.com/watch?v=5YNTTFuqXD8

Week Seven-MEAL Framework Minicourse Training Syllabus

Week Eight -Course Evaluation and Capstone Project Submission

I have employed the OCSQR Course Design Review template to evaluate my MEAL Framework mini course.

So that, acknowledgement must go to California State University, Chico for availing this rubric for online course design review and evaluation.

The minicourse on MEAL Framework is reviewed and evaluated by considering categories: Course Overview & Information, Course Technology & Tools, Design & Layout, Content & Activities,Interaction,and Assessment & Feedback for training participants learning.

When we see these areas in detail:

Course Overview & Information: The minicourse ensures in giving clear overview and information for students through consistent formatting, clear presentation of key information, and a comprehensive syllabus across course modules.
Course Technology & Tools: The minicourse tried its best on the integration of various technological tools and media, facilitating communication, learning, active engagement, and accommodating different learning preferences for training participants.
Design and Layout: The Minicourse on MEAL Framework contains clearly and well written instructions. The course is easy to navigate table header rows & columns are written clearly across Modules.
Content & Activities: The minicourse provides the learner with skills & knowledge to develop the problem-solving mechanisms and insights for their projects management roles and responsibilities. The mini course also provides an opportunity for learners to apply real world scenarios, experiential learning, case studies and problems focussed activities for programs and projects management.
Interaction: The minicourse offers opportunities for interaction among students and with the instructor, aligns lessons learnt and best practices with learning objectives, ensures engagement of all training participants with the material, and provides a room for learners in addressing their day-to-day work-related questions and gaps.
Assessment & Feedback: Assessments on learning outcomes of training participants are carried out through various learning activities such as discussion forums, written assignments, Knowledge checks and quizzes, through application of real world scenarios and lessons and any missed areas would be included/added later on.

Overall, the minicourse is effective in providing a well-organized, engaging, and effective learning experiences for training participants on programs and projects designing, implementation and management activities.

In addition, I have learned a lot on how to review and evaluate online courses by using standardized criteria, and I found the OSCQR course design review very fit for my Minicourse review and evaluation. Although there are some tasks to make the course very complete and perfect, the six (6) areas of course design review and evaluation gave me with many insights.

Evaluation Checklist

The Link for Screencast Presentation-https://youtu.be/cD0nUu1Tpsg?si=0iszAlspF0ZXdAKM