Home  Computer Based Assessment Register for Testing Our Team Clients Contact us
Since its establishment in 2000, EPEC has successfully completed a variety of projects and still provides ongoing services to satisfied clients. Some of these include;

Case Studies  
NULL Case Study One

The Australian Medical Council

Until the late 1990s the Australian Medical Council (AMC) administered fixed length paper-and-pencil exams twice a year, and scored the exams in the Classical Test Theory (CTT) framework. To pass the exam a candidate had to achieve a certain overall score and also pass each of six disciplines (e.g. Medicine, Surgery, etc.). EPEC was approached in the late 1990s to evaluate the processes. EPEC recommended the Rasch Model could be used to improve the examination process in order to assist with compiling six subtests with exactly the same difficulty and spread of scores. Furthermore, since exams change in level of difficulty, this meant the same performance to pass the exam may not be maintained using (number-correct) scores.
EPEC calibrated the available items and located each itemís difficulty on a single scale through linking and anchoring (common) items. The analyses that followed were Rasch based and candidatesí abilities could be expressed on an interval scale. EPEC conducted a number of workshops and presentations with the examinations board and defined a dedicated AMC scale on which cut scores were determined. Candidatesí results were shown graphically on reports which enabled the candidates to see their performance relative to the other candidates. Further changes and improvements were made and because of increasing numbers of candidates more frequent exams and online administration was explored.
From 2005 to 2010 EPEC administered the AMCís exams online in Cliftons centres all over Australia, New Zealand, Hong Kong, Singapore and London. EPEC computerized the items, installed the compiled exams and analysed the data.
Fixed exams in which the items were randomized were used to deliver a unique exam to each of the thousands of candidates. More frequent administrations, however, put pressure on the development of multiple papers and issues such as security prompted EPEC to introduce the AMC to the concept of computerized adaptive testing (CAT). Since 2007 EPEC conducted trials with the AMC candidates and university students exploring various options of delivering CATs; including sequential CATs, fully integrated CATs, content control, exposure control, parameter drift, etc. EPEC produced numerous reports and trained AMC staff in this mode of examination. CATs were subsequently implemented since February 2011 and thousands of candidates have already been examined successfully in various countries around the world.
Case Study Two
Medical Councils and Colleges

EPEC provides psychometric services to many of the medical councils and colleges in Australia and New Zealand. EPEC has overseen the AMCís program since 1997, the ADCís program for over 10 years, the RACDSís psychometrics since 2009, and more. Initially the councils and colleges implemented Classical Test Theory (CTT) in their assessment through paper-and-pencil examinations. Candidates were traditionally scored by adding the number of correct responses and the standard to pass an exam is expressed in terms of the number-correct score. EPEC assisted the colleges and councils to implement Modern Test Theory (MTT) in order to overcome important problems in CTT and take advantage of the power of Rasch and Item Response Theory (IRT) measurement. Colleges and councils vary in size and the number of candidates examined. For example, the Australian Dental Council or the Royal Australasian College of Physicians has hundreds of candidates sitting an exam whilst colleges such as the Royal Australasian Council of Dental Surgeons (RACDS) and the Optometry Council of Australia and New Zealand (OCANZ) have much smaller numbers. EPEC converts the examination from CTT to Rasch or IRT based examination through calibrating the items, locating them on a common scale and locating cut scores on the scale. Each subsequent exam is linked to the scale so that the same level of performance to pass the exam is maintained over time. For example, EPEC has maintained the AMCís standard for over a decade. Different colleges and councils have different criteria to pass the exam and these are implemented by EPEC. For colleges and councils that administer paper-and-pencil exams, EPEC provides the answer sheets and oversees the whole process from scanning the answer sheets, validation an analysis of data to reporting, including a detailed report as well as individual reports for candidates. EPEC also has extensive knowledge and experience to implement computer-based and on-line examinations (see Case Study One above).
NULL Case Study Three

Luther College

Luther College is an independent and private secondary school in Melbourne, Australia. EPEC has been compiling scholarship exams for Luther College since 2002. The battery of tests, constructed and compiled by EPEC, includes tests in mathematics, English comprehension, abstract reasoning and written expression. In 2002 fixed length paper-and-pencil tests were used. It was found that such tests have ceiling effects and it was decided to computerize the tests and implement them as CATs. EPEC used its item banks to administer such tests from 2003 resulting in very precise measures. In addition to be able to rank order the students, EPEC could also advise in approximately which grade a student was performing. For example, students who sat the Year 6 tests for entry into middle school, could be told that in a certain test they functioned at a, say, Year 8 level. As far as could be determined this was the first scholarship program implementing CATs in Australia.
Case Study Four
Educational Institutions

EPEC has been involved in the analysis and reporting of a number of educational Boards and Departments. At the Year 12 level, EPEC has assisted the Queensland Studies Authority (QSA) with the analysis, grading and fielding and determination of overall performance (OPs) for over a decade. Likewise EPEC has conducted workshops and analysed Year 12 exams for Umalusi, the certification authority in South Africa and conducted national moderation exams. EPECís psychometric services range from individual schools (see Case Study Three above), to national level where, analysis and reporting was undertaken in Numeracy and Literacy for South African schools. EPEC has also been involved in the analysis of data at State level in Australia.
Case Study Five
Organisational Institutions

EPEC is active in providing psychometric services to various organisations, which can be tailored to the needs of each organisation. Some organisations require the development of specific tests (numerical reasoning, abstract reasoning, personality assessment) whilst others require an assessment service in administering such tests (paper-and-pencil and/or on-line). EPEC has the staff, experience and infrastructure to develop such tests, administer and score exams and provide general psychometric services. EPEC also assists recruitment agencies in personnel selection. Whether agencies or companies require quick but sound assessments to identify candidates to short list or detailed assessments yielding profiles of managerial candidates, EPEC can provide the assessments both online or on an individual basis. Please see our Computer Based Assessment page or contact us for more information.