Current Research Activity

OLT Innovation and Development grant awarded: ID15-4747 'Transforming exams across Australia: processes and platform for e-exams in high stakes, supervised environments' 2016-2018.

OLT Seed e-Exam project final report released.

e-Exam trials are complete for 2014-2015 (see results section). Publications write-up underway.

Expressions of interest now being sought for 2017. We have a doubled sided flyer outlining 'phase 1' exam trials with a full roadmap on the reverse.

  • Calling CQU academics! Run an e-exam trial in your 2017 or 2018 course. Contact Dr Michael Cowling at CQU.
  • Calling UTAS academics! Run an e-exam trial in your 2017 or 2018 unit. Contact Dr Andrew Fluck at UTAS.
  • For all other institutions on the OLT ID grant (2016 to 2018) [Monash, UQ, ANU, ECU, Macquarie, RMIT, UniSA, UNSW], please contact the project leader, Dr Mathew Hillier.

Upcoming Presentations:

  • Hillier, M. (2017) "Striving for authentic assessment in the exam room and beyond", (keynote presentation) EdTechPosium, Canberra, 30-31 October.
  • Hillier, M. & Fluck A. (2017) "Transforming Exams - How IT works for BYOD e-Exams", ASCILITE conference, Toowoomba, 4-6 December.
  • Hillier, M. (ed) (2017) "Transforming Exams – stories from across Australia" (panel session) ASCILITE conference, Toowoomba, 4-6 December.
  • Hillier, M, Fluck, A & Coleman, M. (2017) "Transforming Exams – hands on with the technology" (post-conference workshop - focusing on assessment design and DIY logistics), ASCILITE conference, Toowoomba, 7 December.
  • Fluck, A & Hillier, M. (2018) "e-Exams for Maths and Computing" (private briefing/workshop), School of Computing and Mathematics Colloquium, Charles Sturt University, Canberra, 1 Feb.

Completed Research

Publications and presentations relating to the current phase of work on the e-Exam system version 5.

Overview

e-Exam pedagogical implementation roadmap [PDF] - A one page strategy outline for scaling up pedagogically rich e-Exams at an Institution.

Trial Result Summaries - UQ 2013-2015

Refereed

Fluck, A & Hillier, M. (2017) "eExams: Strength in diversity" (full paper), World Conference for Computers in Education (IFIP TC3), Dublin, Ireland 2-6 July

Hillier, M. (2017) "Bridging the digital divide with an off-line e-learning and e-assessment platform", Presented at 'Expanding Horizons in Open & Distance Learning', Open and Distance Learning Association of Australia Bi-annual conference, 5-7 February, Melbourne, Australia [download full text][download slides PDF].

Fluck, A & Hillier, M. (2016) "Innovative assessment with eExams", Australian Council for Computers in Education Conference, Brisbane, 29 Sep to 2 Oct. [download full text]

Hillier, M (2015) "To type or handwrite: student's experience across six e-Exam trials", ASCILITE Conference, Perth, 29 Nov - 2 Dec. [Full paper], [Slides with 2015 results included].

Hillier, M & Fluck, A (2015) "A pedagogical end game for exams: a look 10 years into the future of high stakes assessment", ASCILITE Conference, Perth, 29 Nov - 2 Dec. [short paper], [Slides].

Gregory, S., Jacka, L., Hillier, M. and Grant S. (2015) "Using virtual worlds in rural and regional educational institutions" Australian and International Journal of Rural Education, Vol. 25 (2), pp. 73-90. (This paper explores the use of the e-Exam System as the basis for an offline e-learning delivery platform).

Hillier, M (2015) "Filling the learning analytics gap for high-stakes exams", HERDSA Conference, Melbourne, 6-9 July 2015. [Abstract and Poster].

Fluck, A & Hillier, M (2015) "eExams for curriculum transformation", HERDSA Conference, Melbourne, 6-9 July 2015. [Abstract for Roundtable].

Hillier, M (2015) "e-Exams with student owned devices: Student voices", International Mobile Learning Festival 2015, Hong Kong, 22-23 May 2015 [view full paper] (refereed abstract).

Hillier, M & Fluck, A (2015) "Transforming Exams into e-Exams", Proceedings of the International Conference on Assessment for Learning in Higher Education, 14-15 May, Hong Kong. [refereed abstract] [view slides]

Hillier, M (2014) "The Very Idea of e-Exams: Student (Pre)conceptions" [Full paper], Proceedings of the 31st Australasian Society for Computers in Learning in Tertiary Education, 24-26 November, Dunedin New Zealand. [pre-press] [view slides]

Hillier, M (2014) "e-Exams at University of Queensland: Trial Results 2014" [Poster], Proceedings of the 31st Australasian Society for Computers in Learning in Tertiary Education, 24-26 November, Dunedin New Zealand. [Poster A4]

Gregory, S., Jacka, L., Hillier, M. and Grant S. (2014) "Using virtual worlds in rural and regional educational institutions" in 3 Decades On: Reflections Upon Rural Education - Achievements, Challenges and Future Directions, Proceedings of the 30th Society for the Provision of Education in Rural Australia Conference, 1-3 October, Armidale, NSW, Australia.

Fluck, A and Hillier, M (2014) "eExams Transforming Curriculum", 26th Australian Computers in Education Conference, 30 September - 3 October, Adelaide. [session synopsis]

Hillier, M and Fluck, A (2014) "e-Exam System v5: A Secure, Scalable, Ethical Approach to High Stakes e-Assessment" [Poster], Higher Education Research and Development Society of Australasia (HERDSA) Conference 7-10 July, Hong Kong. [read abstract] [view poster]

Hillier, M and Tran, L (2014) "Student Perceptions of e-Exams: Hopes and Fears" [Special Presentation], Higher Education Research and Development Society of Australasia (HERDSA) Conference 7-10 July, Hong Kong. [read abstract] [view slides]

Hillier, M and Fluck, A (2013) "Arguing again for e-Exams for high examinations" Proceedings of the 30th Australasian Society for Computers in Learning in Tertiary Education, 1-4 December, Macquarie University Sydney, Australia. [view slides]

Hosted Events & Edited Proceedings

Hillier, M (ed) (2014) "Final Answer: The Question of Summative eAssessment. Proceedings of eAssessment Scotland 2014 Online Conference", 8-19 September, Dundee, Scotland, UK & Brisbane, Australia. [Session synopses and recordings of all 8 sessions]

Presentations & Meetings

Hillier, M & Fluck A. (2017) "Running Authentic e-Exams" (invited presentation/closed conference), Examinations Network conference, Hobart, 6-7 September.

Hillier, M, Fluck A & Coleman M. (2017) "Running Authentic e-Exams Workshop" (focusing on e-exam administration and logistics), Hobart, [9am to 12.30], 8 September.

Hillier, M & Fluck, A. (2017) "The assessment triad and e-exams" (plenary presentation), Assessment integrity and the role of examinations, Melbourne, 22 Aug 2017

Fluck, A. (ed) (2017) "eExam symposium - design decisions and implementation experience" (symposium), World Conference for Computers in Education (IFIP TC3), Dublin, Ireland 2-6 July.

Hillier, M & Coleman, M. (2017) "Transforming exams across Australia: Processes and platform for e-exams in high stakes, supervised environments" (presentation) in eExam Symposium, World Conference for Computers in Education (IFIP TC3), Dublin, Ireland July.

Hillier, M. (2017) "Wrangling e-Exams: authenticity, integrity, and scalability" (invited presentation), Assessment in Higher Education conference, Manchester, UK, 29 June.

Hillier, M. (2017) "Towards authentic e-Exams in Australian universities" (invited presentation), The Open University, Milton Keynes, UK, 26 June.

Hillier, M. (2017) "Authentic assessment on Exams using computers" (invited presentation), Warwick University, UK, 27 June.

Hillier, M. (2017) "Towards authentic computerised exams national project progress" (invited seminar), University of Queensland, 10 April.

Hillier, M. (2017) "e-Assessment for Digital Learning" (guest online lecture), University of South Australia, Adelaide, 11 May.

Hillier, M, Fluck, A & Coleman, M. (2017) "Transforming Exams Across Australia - project partner workshop", Monash University, 17 February.

Hillier, M. (2016) "Authentic Assessment with e-Exams" (invited seminar), University of Adelaide, Adelaide, 1 Dec.

Hillier, M & Fluck, A. (2016) "Exam Analytics: how authentic can we get" (Workshop) Australian Learning Analytics Summer Institute (ALASI) for Australasian Society for Computers in Learning in Tertiary Education (ASCILITE) Conference, Adelaide, 27 Nov.

Hillier, M & Coleman, M. (2016) "OLT e-Exams: Authentic Assessment" (briefing/demo), Swinburne University of Technology, Hawthorn campus, 10 Oct.

Hillier, M. (2016) "Pushing the boundaries of authentic high-stakes assessment for the 21st century" (talk/briefing), University of New South Wales Sydney, 22 Sep. [abstract]

Hillier, M & Fluck A. (2016) "Ramping up the authenticity of high-stakes supervised assessment for the 21st century" (workshop), Macquarie University, Sydney, 23 Sep. [abstract][slides PDF]

Hillier, M & Fluck A. (2016) "An off-line e-assessment platform for Computer Science education" (poster), ACM International Computing Education Research (ICER) Conference, Melbourne, 9 to 11 Sep [Download A4 poster][Download lightening talk slides].

Hillier, M (2016) "Transforming Exams Across Australia - Exams of 2030" (poster), Australian Government Office for Learning and Teaching Conference, Melbourne, 28 to 29 April [Download A4 poster].

Hillier, M (2016) "e-Exam Trials at Monash" briefing, Faculty of Business & Economics Education Committee, Monash Collins Street campus, 24 March.

Hillier, M (2016) "Exploring e-Exams Technology" (workshop), UWA Assessment Conference, University of Western Australia, Perth, 17 March [2:30pm-3:30pm].

Hillier, M (2016) "Transforming Assessment and Exams with Technology" (invited keynote), UWA Assessment Conference, University of Western Australia, Perth, 17 March [11:15am-12pm].

Hillier, M (2016) "Developing exams for the twenty first century" presentation, Australian Business Deans Council, Geelong 1 Feb.

Hillier, M (2015) "e-Exams and assessment" briefing, University of Western Australia, Perth 3 Dec.

Hillier, M (2015) "e-Exams: Developing exams for the twenty first century" presentation, Edith Cowan University, Perth 3 Dec.

Hillier, M (2015) "Welcome to the Future (of Assessment for 21C Skills)", Faculty of Business & Economics, Innovation Incubator Residential Workshop, Cape Schanck Resort, 10 Nov.

Hillier, M (2015) "e-Assessment and e-Exams" presentation, Auckland University of Technology, 7 September.

Hillier, M (2015) "Transforming Exams Across Australia - National OLT project brief", Exams Network Conference, University of Auckland, 3 Sept.

Hillier, M (2015) "About e-assessment and e-exams", Open Polytechnic of New Zealand, Lower Hutt, 31 Aug.

Hillier, M (2015) "Filling the learning analytics gap for high-stakes exams", HERDSA Conference, Melbourne, 6-9 July 2015.

Fluck, A and Hillier, M (2015) "eExams for curriculum transformation" (Roundtable discussion), HERDSA Conference, Melbourne, 6-9 July 2015.

Hillier, M (2015) "Transforming Assessment and Exams", Institute for Education, Tsinghua University, Beijing, 26 and 28 May 2015.

Hillier, M (2015) "About e-Exams", Invited Seminar, Chinese University of Hong Kong, 20 May [view slides].

Hillier, M (2015) "Transforming Exams with E-Exams", Course co-ordinators workshop, [via video conference], James Cook University, Cairns, 27 Jan 2015.

Hillier, M (2014) "Transforming Exams: bring-your-own laptop to high-stakes e-exams", Staff seminar, University of Auckland, Auckland, NZ, 1PM 4 December 2014.

Hillier, M (2014) "Transforming Exams: BYO laptops for e-Exams at University of Queensland", Staff seminar, University of Canterbury, Christchurch, NZ, 11AM 1 December 2014.

Hillier, M (2014) "e-Exams", Private briefing, Christchurch Polytechnic Institute of Technology, Christchurch, NZ, 1PM 28 November 2014.

Hillier, M. (2014) "BYOD e-Exam Trials at UQ", UQ Teaching and Learning week, St Lucia campus, University of Queensland, 1.30PM 3 November.

Hillier, M (2014) "Transforming Exams: Results from the 2014 BYOD e-Exam Trials at University of Queensland" [slides], Invited Presentation, Educational Innovation Through Technology conference, Brisbane, Australia, 28 Oct.

Fluck, A (2014) "BYOD on-campus eExams at University of Tasmania (UTAS)" [invited presentation], Joint eAssessment Scotland and Transforming Assessment Online Conference, 8 September. [session synopsis and recording]

Hillier, M (2014) "UQ: BYOD for e-Exam Trial outcomes" [slides], Presentation (via online video conference), Exams Network Conference, University of New England, Armadale, Australia, 20 Aug.

Hillier, M (2014) "e-Exams: UQ trial findings", Private briefing, Centere for Enhancement of Teaching and Learning, University of Hong Kong, Hong Kong, 4 July.

Hillier, M (2014) "Transforming Assessment with e-Assessment", Seminar, Centre for Development of Teaching and Learning, National University of Singapore, 15 July.

Hillier, M (2014) "e-Exams", Private briefing, Singapore Institute of Technology, Singapore, 16 July.

Hillier, M (2014) "e-Exams", Private briefing, Ngee Ann Polytechnic, Singapore, 16 July.

Hillier, M (2014) "UQ e-exams trial preliminary findings" [Slides], ASCILITE Live! webinar Series, National University of Singapore, 15 May

Hillier, M (2014) "Transforming Assessment with e-assessment for e-exams" [Slides], Global Links Speaker Series, Bond University, Gold Coast, 4 April

Hillier, M (2014) "e-Exams", Teaching Innovations Conference, University of Queensland, Gatton Campus, 29 Jan

Hillier, M (2013) "Arguing for e-Exams" [Slides] Transforming Assessment in the Digital Era, Melbourne.

Hillier, M (2013) "Exploring e-Exams for high stakes assessment" [Slides] Examinations Network Conference, Brisbane.

Presented at UQ T&L Week (Flipped Classroom Expo) - Monday 28 Oct 2013 10-11am, Learning Innovation Building 17 Level 2

Presented at UQ T&L Week (Science-EAIT T&L Showcase) Wednesday 30 Oct 2013, 10.30-12noon. 316/316A, Level 3, Advanced Engineering Building (49)

Other Documents

Hillier, M (2014) "e-Exams: UQ Trial Outcomes S1 2014" A general information presentation with system overview and first phase trial findings.

Hillier, M (2013) "Argument Map – of a 'wicked' problem!" diagram.

Background literature, research and a bibliography.

Fluck, A (2013) 'e-Exams Transforming Curriculum' Transforming Assessment webinar, 13 March (a presentation relating to the predecessor project at UTAS)

e-Assessment Zotero library items tagged with 'e-exams'.

Related resources

Transforming Assessment - our sister site with e-Assessment examples.