Difference between pages "Evaluate a Project (Activity)" and "Learning Activity Format with Directions"

From TeachingOpenSource
(Difference between pages)
 
m
 
Line 1: Line 1:
== Project Evaluation ==
__NOTOC__
{{:Learning Activity Definition}}


=== Preparation: ===
== Using This Template ==
 
The template below contains sections which describe the items that should be included when creating a learning activity. To use this template:
# Create a new page with the word "Activity" in the name. Use a short, descriptive name.
# Copy the source for this template into your new page.
# Fill in the sections below according to the instructions.
# Categorize the page using tags at the bottom of the page.
#* Include <nowiki>[[Category:Learning Activity]]</nowiki>
#* Remove <nowiki>[[Category:Template]]</nowiki>, since this page is a template, but your new page is not.
#* Add at least one subcategory from the list in [[Learning Activities]], e.g. <nowiki>[[Category:Coding and Style]]</nowiki>
# Use the '''Discussion''' tab (upper left of the page) to leave feedback to the author(s) of the activity, such as usage or suggestions for enhancements.
 
 
== TEMPLATE ==


{| border="1"
{| border="1"
|-  
|-  
|'''Description''' || Learners will gain an understanding of the breadth of available FOSS projects. Learners will also gain an understanding of the identifying characteristics of FOSS projects including pattern of contributions, patterns of commits, programming languages used, and more. 
|'''Title''' || Name of the activity
|-
|-
|'''Source''' ||
|'''Overview''' || High level description of what the student will do
|-
|'''Prerequisite Knowledge''' || What topics and tools does the student need to know prior to beginning this activity?
|-
|-
|'''Prerequisite Knowledge''' || Completion of Browsing a Forge Activity or understanding of SourceForge and OpenHub; Understanding of the course in which students will be participating in an HFOSS project.
|'''Learning Objectives''' || What should the student be able to do after completing this activity?
|-
|'''Estimated Time to Completion''' || 60-90 minutes
|-
|'''Learning Objectives''' ||Ability to utilize the rubric to identify likely HFOSS projects.
|-
|'''Materials/Environment''' || Access to Internet/Web and web browser, [http://xcitegroup.org/softhum/lib/exe/fetch.php?media=g:evalfossprojects.doc SIGCSE paper on evaluating FOSS projects],  [http://www.foss2serve.org/images/foss2serve/0/0c/Blank_Evaluation_Template.xlsx Blank evaluation template]
|-
|'''Additional Information''' || [http://www.foss2serve.org/index.php/HFOSS_Projects List of HFOSS projects]
|-
|'''Rights''' || Licensed CC BY-SA
|-
|'''Turn In''' || Wiki posting of evaluation of a project from the [http://www.foss2serve.org/index.php/HFOSS_Communities list of HFOSS projects]
|}
|}


=== Background: ===
=== Background: ===
This activity is intended to give you an overview of what to consider when evaluating an HFOSS project for student participation and for you to gain experience using the rubric.
Is there background reading material?


=== Directions: ===
Are there other activities the student should have done first?
====Part 1-Learn about the rubric====
#[http://youtu.be/MAGet2D5o2c Watch the video describing mission critical criteria]
#[http://youtu.be/e4lnIXjqczU Watch the video describing secondary criteria]


====Part 2-Walk through of an evaluation of the OpenMRS project - Use the [http://www.foss2serve.org/images/foss2serve/0/0c/Blank_Evaluation_Template.xlsx blank evaluation template] to record your results and the rationale for your scoring. ====
What is the rationale for this activity?
:'''Mission Critical criteria-Viability''' Recall that each component is given a score from 1 to 3, where 3 is the best.


#Size/Scale/Complexity - An ideal project should be neither overly simple nor overly complex.  One heuristic to use is the number of contributors as an indicator of project complexity.
Include helpful hints to faculty here.
##Go to the OpenMRS web page (http://openmrs.org/), scroll to the bottom and choose ''OpenMRS Wiki'' (under ''Other OpenMRS sites''). From the menu on the left expand the ''Developer Guide'' and the ''Getting Started as a Developer'' options and then choose ''Technical Overview''. From examination of the technology stack, the architecture looks modular and further search shows it is documented elsewhere on the site. 
##Based upon the results from OpenHub (gathered in the FOSS Field Trip activity) and the information from the OpenMRS Technical Overview page, what would you score this project for size/scale/complexity?
#Activity - To support student participation a project should be reasonably active.  Number of commits can be used as an indicator of activity. 
##Based upon the number of commits (gathered in the FOSS Field Trip activity) how would you rate the activity of the project?
#Community - A suitable project has an active user community.  While it is difficult to quantitatively evaluate the activity of a user community, some indicators include a regular history of project downloads and documentation updates over time, current activity on user mailing lists, and testimonials on the project web site.
##Examine download activity
###Go to [http://sourceforge.net/ sourceforge.net] and enter OpenMRS into the search box. 
###Choose OpenMRS from the search results.
###Click on the number of downloads that is listed on the project page.
###Change the date range to give a graph of downloads over the last year. 
##OpenMRS has begun migrating legacy mailing list activity to OpenMRS Talk. Examine [https://talk.openmrs.org/ discussion] activity
##Examine the [https://botbot.me/freenode/openmrs/ IRC logs]
##Based upon the download history, discussion activity, and IRC activity, what score would you give this project for community?


=== Directions: ===
What should the student do?


:'''Mission Critical criteria-Approachability'''
=== Deliverables: ===
What will the student hand in?


:Here you are evaluating a project's on-ramp to contribution, scoring as follows:
= Notes for Instructors =
The remaining sections of this document are intended for the instructor.  They are not part of the learning activity that would be given to students.


::1-Insufficient-Few or no pointers on how to become involved.
=== Assessment: ===
How will the activity be graded?
How will learning will be measured? Ideally, there should be a way to measure each of the objectives described above.  


::2-Sufficient-Suggestions about how to get involved other than contributing money with accompanying high-level instructions.
How will feedback to the student be determined?


::3-Ideal-Obvious link to get started, list of suggestions for things to do and detailed instructions.
Include sample assessment questions/rubrics. Feel free to indicate that the activity itself is not graded, however it would be helpful to include any questions that might be used at a later date to interpret learning, for example on a quiz or exam.  


#Examine project on-ramp.
The form of the assessment is expected to vary by assignment. One possible format is the table:
##Link to getting started - The website has a [http://openmrs.org/help/ Get Involved page] with links to ways you can contribute and share your ideas.
{| border="1" class="wikitable"
##Each of the links (Develop, Test, Document, Translate) contain more detailed information about what and how you can contribute.
! Criteria
##The [https://wiki.openmrs.org/display/docs/Getting+Started+as+a+Developer Getting Started as a Developer] page contains a detailed list of how to get started including a list of introductory issues.
! Level 1 (fail)
##Detailed instructions - The ]https://wiki.openmrs.org/display/docs/Developer+Guide Developer Guide] contains instructions and information in many areas including process, architecture, tools, and developer documentation.
! Level 2 (pass)
##Based upon the resources you looked at, how would you rate the approachability of the OpenMRS project?
! Level 3 (good)
! Level 4 (exceptional)
|-
| '''Criterion 1...'''
|
|
|
|


|-
| '''Criterion 2...'''
|
|
|
|


:'''Mission Critical criteria-Suitability'''
|}
#Appropriate Artifacts - Since evaluation is dependent on class objectives, in this example we'll assume the objective is to learn the process of working in an authentic development environment by contributing bug fixes to OpenMRS.
##Opportunities to contribute bug fixes - Examine the issues found at the bottom of the [https://wiki.openmrs.org/display/docs/Getting+Started+as+a+Developer getting started as a developer page].  Note that there are two categories of introductory issues. How many are listed in each category?
##Documentation on how to contribute bug fixes - On the [https://wiki.openmrs.org/display/docs/Tickets Tickets page] there is information on how to create and work on an issue, including links to coding standards and the code submission process. Review this information.
##Based upon the number of bugs suitable for students to tackle and information on the process of how to submit bug fixes, how would you rate OpenMRS?
#Contributor Support - Does the project have a high volume of guidance to help students as they learn?
##Communication Tools - Communication tools are directly available from any of the Wiki Spaces (Documentation, Projects, Resources). The [https://wiki.openmrs.org/display/RES/Home Resources page] contains links to OpenMRS Talk and IRC Chat, as well as links to group meetings (under Events), and training opportunities. 
##Web Presence - Examine the [https://botbot.me/freenode/openmrs/ IRC logs]. Has there been activity during the last week? 
##Operating Processes - Links to information about coding standards, the code submission process, and commit privileges can be found on the [https://wiki.openmrs.org/display/docs/How-To+Submit+Code How-To Submit Code page].  The process for making feature requests is available on the [https://wiki.openmrs.org/display/docs/Tickets Tickets page]. Are these processes well documented?
##Response to Questions - Review a few of the posts on the OpenMRS [https://talk.openmrs.org/ discussion platform]. Do posts to this forum receive timely and supportive responses?
##How would you rate the support that newcomers to OpenMRS receive?


=== Comments: ===
What should the instructor know before using this activity?


:'''The evaluation template should be uploaded to your blog -- while working on your blog post position the cursor on the page where you would like the link to appear and click 'Add Media'.
What are some likely difficulties that an instructor may encounter using this activity?
 
 
:'''Overall evaluation for Mission Critical criteria''' - If no mission-critical criteria were scored lower than a 2 the project should be then evaluated on secondary criteria.  Otherwise, the project would have been considered not suitable for student participation.
 
 
:'''Secondary criteria-Viability - Secondary criteria sections are OPTIONAL for the POSSE workshop assignment'''
#Domain
##Does this project require domain knowledge that may be difficult for students to learn? - OpenMRS is a medical records system. Students should be able to grasp it well enough to contribute a bug fix, which is the learning objective assumed in this example.
##How would you rate the viability of OpenMRS?
#Maturity
##To have the organization to support student learning, the project should have at least one stable production release - The [https://wiki.openmrs.org/display/RES/Platform+Release+Notes Platform Release Notes page] lists releases.
##Does OpenMRS have enough of a stable base to support student learning?  How would you rate it?
#User Support
##The project should have clear instructions for downloading, installing, and using the project - As noted previously, the [https://wiki.openmrs.org/display/docs/Getting+Started+as+a+Developer Getting Started as a Developer page] provides detailed information about setting up and using the required tools, in addition there are detailed instructions related to installation, configuration, system requirements, and troubleshooting, including videos.
##Rate the documentation for OpenMRS.
#Roadmap
##Student learning is best supported by projects that have a roadmap that includes new feature development, a method for users to submit new feature requests and a process for identifying how new features are prioritized - Feature requests are made through JIRA, the OpenMRS issue tracker. Road map planning and the process for prioritizing feature requests is available on the [https://wiki.openmrs.org/display/docs/Technical+Road+Map+Planning Technical Roadmap Planning page].  Here you will find information about the planning process and how to participate in the planning process. The [https://wiki.openmrs.org/display/docs/Technical+Road+Map Technical Road Map page] identifies features, their current status, and a point of contact, in addition to expected dates of completion.
##Based upon the roadmap provided, how would you rate OpenMRS?
 
 
:'''Secondary criteria-Approachability - Secondary criteria sections are OPTIONAL for the POSSE workshop assignment'''
#Contribution Types
##Does the project contain opportunities for multiple types of contribution and of the type that fits the class? - There are multiple projects for testers, tech writers, and developers.  These can be seen on the [http://openmrs.org/help/ Get Involved page].
##Result - May be a 1, 2 or 3 depending on whether the number of bugs is suitable for students is enough given the class size.
#Openness to Contributions
##Acceptance of a student contribution to a project provides valuable affirmation to student learning.  Determine whether the project accepts student patches. - The process for contribution is documented on the [https://wiki.openmrs.org/display/docs/Tickets Tickets page].
##Result - Score a 3 because the contribution process is documented.
#Student Friendliness
## Do community members moderate the tone of communication?  Review the discussion platform and IRC to gauge tone - Review of [https://talk.openmrs.org/ discussion platform] and [https://botbot.me/freenode/openmrs/ IRC logs] during evaluation of contributor support showed a positive tone during communication.
##Result - Score a 3, no inappropriate or demeaning messages. 
 
 
:'''Secondary criteria-Suitability - Secondary criteria sections are OPTIONAL for the POSSE workshop assignment'''
#Project Description
##Students must be able to understand the purpose of the project.  Does the project clearly describe the product? Can students understand the intended uses of the product? - The [http://openmrs.org/about/ About page] provides an overview of who, where, and what OpenMRS is, including a downloadable PDF file and a video. These describe the purpose of the project and how it is used around the world to efficiently manage medical records.
##Result - Score a 3, how the product is used and the vision for it is well documented and should be understandable by students. 
#Platform
##What software and hardware platform does the FOSS project run on? - Development environment can be built on Windows, Linux or Mac OS X completely with FOSS software.  (Project development information found [https://wiki.openmrs.org/display/docs/Step+by+Step+Installation+for+Developers here])
##Are there resources to support these platforms? - In this example, yes.
##Are students familiar with the platforms? - In this example, yes.
##Result - Score a 2, assumption in this example is students all have newer personal computers and given the ability to set up a development environment on different operating systems that makes the availability of student resources greater.  However, there is some risk because machine requirements for setting up developer environment are not provided and some documentation may be out of date. 
#Development Features - Is the class dependent on specific development features?  (Project development information found [https://wiki.openmrs.org/display/docs/Step+by+Step+Installation+for+Developers here])
##Programming language - Is primarily Java.
##Development environment - Can be built on Windows, Linux or Mac OS X completely with FOSS software. 
##Supporting technologies - Suggested IDE is Eclipse, requires mySQL, Maven and Jetty are optional.
##Result - Need to gauge this on knowledge of students and requirements of class.  Assumption here is students know Java and are familiar with mySQL.  While students are not familiar with Maven and Jetty this may not be necessary for intro bug fix plus the community is very supportive so assistance can be found there.  Given there is some risk, score a 2.


=== Additional Information: ===
{| border="1"
|-
|'''ACM Knowledge Area/Knowledge Unit''' || What ACM Computing Curricula 2013 knowledge area and units does this activity cover? [[ACM_Body_of_Knowledge]]
|-
|'''ACM Topic''' || What specific topics are addressed? The Computing Curriucula 2013 provides a list of topics in Appendix A - The Body of Knowledge (page 58) - https://www.acm.org/education/CS2013-final-report.pdf
|-
|'''Level of Difficulty''' || Is this activity easy, medium or challenging?
|-
|'''Estimated Time to Completion''' ||  How long should it take for the student to complete the activity?
|-
|'''Materials/Environment''' || What does the student need?  Internet access, IRC client, Git Hub account, LINUX machine, etc.?
|-
|'''Author(s)''' || Who wrote this activity?
|-
|'''Source''' || Is there another activity on which this activity is based?  If so, please provide a link to the original resource.
|-
|'''License''' || Under which license is this material made available? We request that you pick a Creative Commons license.  See http://creativecommons.org/licenses/ for general information.  Suggested text: This learning activity is available for use under the [http://creativecommons.org/licenses/by-sa/4.0/ Creative Commons Attribution-ShareAlike 4.0 International License].  Attribution need not include a link back to this site.
|}


:'''Overall evaluation for secondary criteria''' - Add up your scores to determine the overall score.  If the total score for criteria is over 20, the project passes.  However, criteria scoring below 1 and criteria for which there was some risk noted should be reexamined to see if steps can be taken to mitigate risk.
=== Suggestions for Open Source Community: ===
Suggestions for an open source community member who is working in conjunction with the instructor.


--------------------
--------------------
This work is licensed under a  
The blank template for this page is licensed under a [http://creativecommons.org/licenses/by/4.0/ Creative Commons Attribution 4.0 International License] Anyone using this template need not include a link back to this site as part of attribution.
[http://creativecommons.org/licenses/by-sa/4.0/ Creative Commons Attribution-ShareAlike 4.0 International License]


[[File:CC_license.png]]
[[File:CC-BY.png]]


[[Category:Learning Activity]]
[[Category:LEARNING_ACTIVITY_SUBCATEGORY]]


[[Category: Learning_Activity]]
When creating a new activity, remove it from the Templates category.
[[Category:Use_and_Evaluate]]
[[Category:Templates]]

Revision as of 11:27, 26 January 2017

Learning Activity Definition

Using This Template

The template below contains sections which describe the items that should be included when creating a learning activity. To use this template:

  1. Create a new page with the word "Activity" in the name. Use a short, descriptive name.
  2. Copy the source for this template into your new page.
  3. Fill in the sections below according to the instructions.
  4. Categorize the page using tags at the bottom of the page.
    • Include [[Category:Learning Activity]]
    • Remove [[Category:Template]], since this page is a template, but your new page is not.
    • Add at least one subcategory from the list in Learning Activities, e.g. [[Category:Coding and Style]]
  5. Use the Discussion tab (upper left of the page) to leave feedback to the author(s) of the activity, such as usage or suggestions for enhancements.


TEMPLATE

Title Name of the activity
Overview High level description of what the student will do
Prerequisite Knowledge What topics and tools does the student need to know prior to beginning this activity?
Learning Objectives What should the student be able to do after completing this activity?

Background:

Is there background reading material?

Are there other activities the student should have done first?

What is the rationale for this activity?

Include helpful hints to faculty here.

Directions:

What should the student do?

Deliverables:

What will the student hand in?

Notes for Instructors

The remaining sections of this document are intended for the instructor. They are not part of the learning activity that would be given to students.

Assessment:

How will the activity be graded?

How will learning will be measured? Ideally, there should be a way to measure each of the objectives described above.

How will feedback to the student be determined?

Include sample assessment questions/rubrics. Feel free to indicate that the activity itself is not graded, however it would be helpful to include any questions that might be used at a later date to interpret learning, for example on a quiz or exam.

The form of the assessment is expected to vary by assignment. One possible format is the table:

Criteria Level 1 (fail) Level 2 (pass) Level 3 (good) Level 4 (exceptional)
Criterion 1...
Criterion 2...

Comments:

What should the instructor know before using this activity?

What are some likely difficulties that an instructor may encounter using this activity?

Additional Information:

ACM Knowledge Area/Knowledge Unit What ACM Computing Curricula 2013 knowledge area and units does this activity cover? ACM_Body_of_Knowledge
ACM Topic What specific topics are addressed? The Computing Curriucula 2013 provides a list of topics in Appendix A - The Body of Knowledge (page 58) - https://www.acm.org/education/CS2013-final-report.pdf
Level of Difficulty Is this activity easy, medium or challenging?
Estimated Time to Completion How long should it take for the student to complete the activity?
Materials/Environment What does the student need? Internet access, IRC client, Git Hub account, LINUX machine, etc.?
Author(s) Who wrote this activity?
Source Is there another activity on which this activity is based? If so, please provide a link to the original resource.
License Under which license is this material made available? We request that you pick a Creative Commons license. See http://creativecommons.org/licenses/ for general information. Suggested text: This learning activity is available for use under the Creative Commons Attribution-ShareAlike 4.0 International License. Attribution need not include a link back to this site.

Suggestions for Open Source Community:

Suggestions for an open source community member who is working in conjunction with the instructor.

The blank template for this page is licensed under a Creative Commons Attribution 4.0 International License Anyone using this template need not include a link back to this site as part of attribution.

File:CC-BY.png

When creating a new activity, remove it from the Templates category.

Retrieved from "https://teachingopensource.org/index.php?title=Evaluate_a_Project_(Activity)&oldid=6192"
Powered by MediaWiki