Work Package 8 of the TeSLA project is focused on providing effective and timely evaluation of the technologies, pedagogies and implementation systems used in the project pilots. Evaluating the use of e-assessment technologies is essential in understanding how the complex inter-related set of tools, functionalities and behaviors operate together. Failure to do so can be detrimental to the learner experience, institutional reputation and effective operation of the learning platform.
Since the project started, WP8 has focused on developing an Evaluation Framework and a set of evaluation tools that will include staff and student surveys, focus groups, and collection of analytics. This evaluation framework has sought to focus both the individual system components alongside seeking a clear picture of how the parts of the e-assessment technology work together. A partner consultation took place in spring 2016 which gathered a range of requirements, needs and concerns relating to TeSLA system design, development, implementation, evaluation measures, and delivery to the end-user. Partners were invited to share their views on matters such as:
These data were collated by the WP8 lead institution – the Open University UK. Over 100 topics and key questions were identified and further categorized and refined. The questions detailed not only the evaluation criteria that need to be considered during the course of the project but also who are considered key stakeholders in the project outcomes and evaluation. The questions were felt to capture the breadth and depth of issues from the project stakeholder groups and became a core section of the TeSLA Evaluation Framework. A second core section of the Framework was the specification of key types of trust relating to authentication and authorship. These factors were identified in the context of the TeSLA project aims and objectives.
The aim of WP8 is to use the Framework to guide the evaluation of each round of project pilots. The intention is that the project will choose to stress particular questions and issues that are relevant to the pilot stage and that these will be then discussed and agreed. The most recent output from WP8 has been an evaluation plan for Pilot 1 and the gathering of data for analysis and insight for the first pilot is already underway.
Open University of UK
FUNDED BY THE EUROPEAN UNION
TeSLA is not responsible for any contents linked or referred to from these pages. It does not associate or identify itself with the content of third parties to which it refers via a link. Furthermore TESLA is not liable for any postings or messages published by users of discussion boards, guest books or mailing lists provided on its page. We have no control over the nature, content and availability of any links that may appear on our site. The inclusion of any links does not necessarily imply a recommendation or endorse the views expressed within them.
TeSLA is coordinated by Universitat Oberta de Catalunya (UOC) and funded by the European Commission’s Horizon 2020 ICT Programme. This website reflects the views only of the authors, and the Commission cannot be held responsible for any use which may be made of the information contained therein.