- Email: [email protected]
Assessment on Author Contribution in Publication: A Tool for Decision-makers
Available online at www.sciencedirect.com
ScienceDirect Procedia Computer Science 91 (2016) 402 – 411
,QIRUPDWLRQ7HFKQRORJ\DQG4XDQWLWDWLYH0DQDJHPHQW ,740
$VVHVVPHQWRQDXWKRUFRQWULEXWLRQLQSXEOLFDWLRQ $WRROIRU GHFLVLRQPDNHUV .RRQ&KXQ/DLD 6HH+XQJ/DXE-LDQKXL:RQJE-RVKXD3UDNDVKD E
D )DFXOW\RI(QJLQHHULQJDQG*UHHQ7HFKQRORJ\8QLYHUVLWL7XQNX$EGXO5DKPDQ.DPSDU&DPSXV 3HUDN0DOD\VLD LKC Faculty of Engineering and Science, Universiti Tunku Abdul Rahman, Sungai Long Campus, 43000 Selangor, Malaysia
$EVWUDFW ,QWKLVSDSHUDQDVVHVVPHQWPRGHOWKDWLQFRUSRUDWHGZLWKIX]]\SUHIHUHQFHUHODWLRQVLVSURSRVHGWRDVVHVVWKHFRQWULEXWLRQ RIHDFKDXWKRUWKDWLVLQYROYHGLQSXEOLFDWLRQZRUN$FDVHVWXG\LVFRQGXFWHGWRGHPRQVWUDWHWKHDELOLW\RIWKHSURSRVHG PHWKRGRORJ\LQGLVWLQJXLVKLQJDQGUHIOHFWLQJWKHDFWXDOFRQWULEXWLRQRILQGLYLGXDODXWKRUWKURXJKSHHUDVVHVVPHQW5HVXOWV UHYHDOHG WKH IX]]\ SUHIHUHQFH UHODWLRQV DUH FDSDEOH WR SURYLGH LQGLFHV WR UHIOHFW DXWKRUV¶ FRQWULEXWLRQ LQ D WHDP DQG VXEVHTXHQWO\UDWHWKHPDFFRUGLQJO\ZLWKDSSURSULDWHLQGLYLGXDOPDUN7KHPDUNIRUDXWKRUVLQDWHDPLVFRPSXWHGE\WKHLU DVVRFLDWHGLQGLYLGXDOFRQWULEXWLRQIDFWRUVFRUHVDQGWKHMRXUQDOUDQNPDUNVHWE\WKHXQLYHUVLW\7KHPHWKRGRORJ\FDQEH IXUWKHUGHSOR\HGDVDVWDQGDUGL]HGPHWKRGWRTXDQWLI\FRDXWKRUV¶FRQWULEXWLRQVLQPXOWLDXWKRUSDSHUVDQGVXEVHTXHQWO\ EHFRPHDVXSSOHPHQWHYDOXDWLRQWRROIRUWKHXQLYHUVLW\¶VGHFLVLRQPDNHUWRJUDGHRUUHZDUGWKHDXWKRUV
© 2016 The Authors. Published by Elsevier B.V. This is an open access article under the CC BY-NC-ND license 7KH$XWKRUV3XEOLVKHGE\(OVHYLHU%9 (http://creativecommons.org/licenses/by-nc-nd/4.0/). 6HOHFWLRQDQGRUSHHUUHYLHZXQGHUUHVSRQVLELOLW\RIWKHRUJDQL]HUVRI,740 Peer-review under responsibility of the Organizing Committee of ITQM 2016 Keywords IX]]\SUHIHUHQFHUHODWLRQV SHHUDVVHVVPHQW MRXUQDOUDQNPDUN DXWKRUFRQWULEXWLRQ
,QWURGXFWLRQ 3XEOLFDWLRQLVDQLPSRUWDQWWDVNIRUERWKDFDGHPLFVDQGXQLYHUVLWLHVDVLWDSSHDUVDVDQLQGH[RISHUIRUPDQFH >@ $VVHVVPHQW LQ SXEOLFDWLRQ DFKLHYHPHQW LV JHQHUDOO\ FODVVLILHG DV D FRPELQHG MXGJPHQW RQ TXDOLW\ RI WKH SXEOLFDWLRQDQGH[WHQWRILQYROYHPHQWRUFRQWULEXWLRQRIWKHDXWKRU7KHTXDOLW\RIWKHSXEOLFDWLRQFDQEHGXHWR VHYHUDO PHWULFV HJ MRXUQDO LPSDFW IDFWRU MRXUQDO UDQN DQG QXPEHU RI FLWDWLRQV KRZHYHU LW LV GLIILFXOW WR DVVHVVWKHLQGLYLGXDOLQYROYHGLQDWHDP>@$FFRUGLQJWR>@DWHDPVFRUHLVRIWHQDVVLJQHGWRDOOWKHDXWKRUV ZKHUHDVLQ>@VLQJOHDXWKRUHGHTXLYDOHQW 6$( QXPEHULVFUHGLWHGWRHDFKLQGLYLGXDODXWKRU6$(QXPEHULV FRXQWHGE\GLYLGLQJHDFKSXEOLFDWLRQE\WKHQXPEHURIDXWKRUV
&RUUHVSRQGLQJDXWKRU7HO ID[ E-mail address:ODLNF#XWDUHGXP\
1877-0509 © 2016 The Authors. Published by Elsevier B.V. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/). Peer-review under responsibility of the Organizing Committee of ITQM 2016 doi:10.1016/j.procs.2016.07.104
Koon Chun Lai et al. / Procedia Computer Science 91 (2016) 402 – 411
403
1HYHUWKHOHVVERWKPHWKRGVGRQRWSURYLGHDIDLUUHIOHFWLRQRIHDFKPHPEHU¶VHIIRUW3HHUDVVHVVPHQW 3$ FRXOGEHDVROXWLRQWRWDFNOHWKHFKDOOHQJH,WLVDPHWKRGLQHYDOXDWLQJDQGSURYLGLQJIHHGEDFNRQWKHZRUNRI SHHUV >@ 9DULRXV UHVHDUFKHUV KDG UHSRUWHG WKH XVH RI SHHU DVVHVVPHQW PHWKRG WR HYDOXDWH LQGLYLGXDO FRQWULEXWLRQ LQ D WHDP >@ +DVWLH HW DO SURSRVHG D UXEULF PRGHO ZLWK SHHU DVVHVVPHQW WR HYDOXDWH WKH HIIHFWLYHWHDPZRUNVNLOOVRIWKHVWXGHQWV7KH\DVVXPHGWKHVNLOOVFDQKHOSVWXGHQWVWRFXOWLYDWHDJRRGSHUVRQDO EHKDYLRU>@*LHOHQDQG'H:HYHUUHSRUWHGDSHHUDVVHVVPHQWLQDFRPSXWHUVXSSRUWHGFROODERUDWLYHOHDUQLQJ HQYLURQPHQW LQ KLJKHU HGXFDWLRQ 3UHWHVW DQG SRVWWHVW ZHUH FRPSOHWHG E\ WKH VWXGHQWV EHIRUH DQG DIWHU WKH DVVHVVPHQWIRUFRPSDULVRQ>@ )X]]\VHWWKHRU\FDQEHXVHGWRGHDOZLWKOLQJXLVWLFWHUPVLQWKHSHHUJUDGLQJDVVHVVPHQW>@,WKDVEHHQ FRPPRQO\ LQWHJUDWHG LQWR YDULRXV DVVHVVPHQW WDVNV VXFK DV IX]]\ PXOWLFULWHULD GHFLVLRQ PDNLQJ PRGHO IRU FULWHULRQUHIHUHQFHG DVVHVVPHQW >@ SHHU DVVHVVPHQW RQ VWXGHQWVFHQWHUHG OHDUQLQJ DVVLJQPHQWV >@ RFFXSDWLRQDOVDIHW\ULVNDVVHVVPHQWRQFRQVWUXFWLRQVLWHV>@DQGUHFHQWO\LQGDWDHQYHORSPHQWDQDO\VLV '($ WR FRPSDUH WKH LQSXWVRXWSXWV DQG HYDOXDWH WKHLU UHODWLYH HIILFLHQF\ > @ 1HYHUWKHOHVV WKHUH LV D ODFN RI GHWDLOHG IX]]\ UHVHDUFK RQ LQGLYLGXDO DXWKRU FRQWULEXWLRQ LQ PXOWLDXWKRUHG SXEOLFDWLRQV ,Q WKLV SDSHU DQ DVVHVVPHQW PRGHOXVLQJ IX]]\ SUHIHUHQFHUHODWLRQ LV VXJJHVWHG WR LQYHVWLJDWH WKH FRQWULEXWLRQ RI HDFKDXWKRU $OO DXWKRUV ZKR FRQWULEXWHG LQ WKH SXEOLFDWLRQ DUH UHTXHVWHG WR SDUWLFLSDWH LQ D TXHVWLRQQDLUH 7KH ZHLJKWLQJ WKDW PHDVXUHV WKH LQGLYLGXDO FRQWULEXWLRQ LV FRPSXWHG XVLQJ IX]]\ SUHIHUHQFH UHODWLRQV (YHQWXDOO\ WKH SUDFWLFDOLW\RIWKHSURSRVHGPHWKRGRORJ\LVHYDOXDWHGZLWKDFDVHVWXG\ )X]]\SHHUDVVHVVPHQW $VXUYH\RQWKHVHOHFWLRQRIWKHDVVHVVPHQWJUDGLQJW\SHQDPHO\QXPHULFDOYDOXHVRUOLQJXLVWLFWHUPVZRXOG EHILUVWO\FDUULHGRXW%RWKJUDGLQJW\SHVZHUHIRXQGDFFHSWDEOHIURPWKHUHVSRQGHQWV7KHDQDO\WLFKLHUDUFK\ SURFHVV $+3 ZRXOGWKHQEHHPSOR\HGWRGHDOZLWKWKLVGHFLVLRQPDNLQJSUREOHP$+3FODVVLILHVWKHGHFLVLRQ DVWDUJHWKLHUDUFK\DQGSHUIRUPVWKHSDLUZLVHFRPSDULVRQRIFULWHULRQVDWGLIIHUHQWOHYHOVRIWKHKLHUDUFK\7DEOH VKRZVDJUDGLQJVFDOHRISHHUDVVHVVPHQW,WLVDUHGXFHGVHWRI6DDW\¶VVFDOHDVSUHVHQWHGLQ>@ 7DEOH5HGXFHG6DDW\¶VVFDOH &RQWULEXWLRQ
5HODWLRQ
(TXDOO\FRQWULEXWH
6LJQLILFDQWO\FRQWULEXWH
+XJH6WURQJFRQWULEXWLRQ
&RQVLGHUDWHDPT aa«aQ ZKHUHaLVWKHILUVWDXWKRUaLVVHFRQGDXWKRUDQGaQLVWKHODVWDXWKRULQ DSXEOLFDWLRQ(DFKDXWKRUZRXOGEHFRPHDQDVVHVVRULQTWRSURYLGHn SDLUZLVHSUHIHUHQFHUHODWLRQV7KH SURSRVHGIX]]\SUHIHUHQFHUHODWLRQVPRGHOFDQEHREWDLQHGLQDFFRUGDQFHWRWKHVL[VWHSVDVIROORZV 6WHS &RQYHUW WKH DVVHVVPHQW JUDGHV LH OLQJXLVWLF WHUPV WR QXPHUDO YDOXHV $ IXQFWLRQ ui,j RI PXOWLSOLFDWLYHSUHIHUHQFHUHODWLRQVLVGHILQHGDVIROORZV
404
Koon Chun Lai et al. / Procedia Computer Science 91 (2016) 402 – 411
ui j
ZHDNO\ FRQWULEXWH ° OHVV VLJQLILFDQWO\ FRQWULEXWH °° HTXDOO\ FRQWULEXWH ® ° VLJQLILFDQWO\ FRQWULEXWH ° °¯ VWURQJO\ FRQWULEXWH
ZKHUH ui j > @ DQGLVWKHSUHIHUUHGUHODWLRQVRIDXWKRUaiWRDXWKRUaj1RWHWKDW u i j u j i ZKHUHij «n 6WHS>@>@&RQVWUXFWDIX]]\SDLUZLVHSUHIHUHQFHUHODWLRQPDWUL[ Pan 7KHPDWUL[ZLWKRXWLQFOXGLQJ WKHDVVHVVRUaQ¶VSDLUZLVHSUHIHUHQFHUHODWLRQLVFRPSXWHGXVLQJ
Pa n
ª p « # « « pi « « # « pn ¬
"
p j
"
"
#
"
"
pi j
"
"
#
"
" pn j "
p n º # »» pi n » » # » pn n »¼
,Q DFFRUGDQFH ZLWK >@ IRXU UHDVRQDEOH RUGHULQJ SURSHUWLHV VKRXOG EH VDWLVILHG LQ WUDQVIRUPLQJ PXOWLSOLFDWLYHSUHIHUHQFHUHODWLRQVWRWKHIX]]\SUHIHUHQFHUHODWLRQVDVIROORZV 3 pi j ORJ u i j ui j > @ 3 ,I pi j >@WKHQ pi j p j i
3 ,Ii j nWKHQ pi j p j n pn i
$V WKH UHGXFHG 6DDW\¶V VFDOH LV XVHG LQ WKLV VWXG\ LH ui j > @ 3 LV PRGLILHG WR EHFRPH 3¶ DV IROORZV 3¶ pi j ORJ ui j ui j > @ $GGLWLRQDOO\ZHUHDUUDQJH3WR3¶DVIROORZV 3¶ ,I pi j >@WKHQ pi j
p j i i j
$QGVLQFH3 pi j p j n pn i 3¶ pi n
UHDUUDQJHWRJHW pi j p j n pi n WKXV
pi j p j n i j n
6WHS> @&RPSXWHWKHDYHUDJHPDWUL[ P an XVLQJ DVIROORZV
P an
§¨ n¨ ©
n
¦P
an
· ¸ ¸ ¹
6WHS$Q n u n PDWUL[CLVFRPSXWHGXVLQJ DQG DVIROORZV
405
Koon Chun Lai et al. / Procedia Computer Science 91 (2016) 402 – 411
C
" c n º " c n »» % # » » " cn n ¼»
ª c c «c « c « # # « c c ¬« n n
n
¦p
ZKHUH ci j
i j
i j
6WHS:HLJKWDVVHVVPHQW WA RIDXWKRUZKLFKLVWKHUDWLRRIWKHHYDOXDWHGVFRUHWRWKHVXPRIWKHKLJKHVW SRVVLEOHVFRUHVLVFDOFXODWHGXVLQJ DVIROORZV n
WAi
¦c
i j
j
¦C
6WHS>@>@(DFKLQGLYLGXDOFRQWULEXWLRQIDFWRU ICF LQJURXSTLVFRPSXWHGXVLQJ )LQDOO\HDFK LQGLYLGXDO¶VPDUN IM LVFRPSXWHGXVLQJ ZKHUHWKHVFDOHIDFWRUD LVDGRSWHG DVLQGLFDWHGLQ>@ ICF
WAi $YHUDJH WAi
IM
ICF d ICF ° JRM u ® ICF ICF E ICF E ° E ICF t E ¯
ZKHUH E
D JRM JRMGHQRWHVWKHMRXUQDOUDQNPDUNVHWE\WKHXQLYHUVLW\DVVKRZQLQ7DEOH
7DEOH-RXUQDOUDQNLQJPDUN ,QGH[LQJ'DWDEDVH
JRM
:HERI6FLHQFH
6FRSXVDQGHTXLYDOHQW
,QWHUQDWLRQDOHJ,QVSHFDQGHTXLYDOHQW
5HJLRQDO
,OOXVWUDWLYHFDVH ,Q WKLV VWXG\ D FDVH VWXG\ LV FRQGXFWHG IRU LOOXVWUDWLRQ :H VHOHFWHG RQH RI WKH WHDPV QDPHO\ WHDP FRQVLVWLQJILYHDXWKRUV aaaaDQGa WRSUHVHQWWKHGHWDLOVRIWKHPHWKRGRORJ\(DFKDXWKRULQWHDP ZDVUHTXHVWHGWRSURYLGHSDLUZLVHSUHIHUHQFHUHODWLRQVUHODWHGWRHDFKTXHVWLRQQDLUHDVVKRZQLQ7DEOH)RU LQVWDQFH WKH ILUVW DXWKRU a WKLQNV a KDV QRW FRQWULEXWHG DV PXFK DV a WKXV u a KDV VWURQJHU FRQWULEXWLRQFRPSDUHGWRa WKXV u DQGaKDVVLJQLILFDQWFRQWULEXWLRQFRPSDUHGWRa WKXV u LQSUHSDULQJWKHMRXUQDO1RWHWKDWWKHnWKFROXPQDQGnWKURZDUHQRWDVVHVVDEOHE\WKHnWKDXWKRU
406
Koon Chun Lai et al. / Procedia Computer Science 91 (2016) 402 – 411 7DEOH4XHVWLRQQDLUH ,WHP
&ULWHULD
Q
3UHSDUHGGUDIWRIUHSRUWVLQJRRGTXDOLW\
Q
&RQWULEXWHGFRQVWUXFWLYHLGHDVWRGLVFXVVLRQ
Q
3DUWLFLSDWHGDQGFRRSHUDWLYHLQJURXSDFWLYLWLHV
Q
&RQWULEXWHGJRRGSUREOHPVROYLQJVNLOOVWRWDVNJLYHQ
%HVLGHVVHOIDVVHVVLQJLVQRWDSSOLFDEOH PDUNHGDV³[´LQWKHPDWUL[ 7KXVWKHSURSRVHGSHHUDVVHVVPHQW V\VWHPFRQYHUWVOLQJXLVWLFWHUPVLQWRYDOXHVLQPDWUL[ P Q a DVWKHRXWFRPHRI
P Q a
ª[ « « « « « «¬
[
º »» [ » » [ » [ »¼
:LWKWKHVDPHSURFHVVWKHGHWDLOHGUHVXOWVRIHYHU\DXWKRULQWHDPIRUTXHVWLRQQDLUHQDUHSUHVHQWHGDV IROORZV [ [
º »» » P Q a » [ » [ »¼
ª[ « « « « « «¬
º » » » » [ » [ »¼
º » » [ » P Q a » [ » [ »¼
ª[ « « « « « «¬
º » [ » [ » » [ » [ »¼
P Q a
ª[ « « « « « «¬
P Q a
ª[ « « « « « «¬
[
[
[
1RZWKHIX]]\SDLUZLVHSUHIHUHQFHUHODWLRQLVJHQHUDWHGDSSO\LQJWKHDERYHPHQWLRQHGUHDVRQDEOHRUGHULQJ SURSHUWLHVZKHUHE\ 3¶LVUHIHUUHGWKDW p
ORJ
p
ORJ
p
ORJ
Koon Chun Lai et al. / Procedia Computer Science 91 (2016) 402 – 411
407
3¶LVUHIHUUHGWKDW p
p p
p
p p
p
p p
DQG3¶LVUHIHUUHGWKDW p p ° ° p p °p ° p ® ° p p °p p ° °¯ p p
7KHIX]]\SUHIHUHQFHUHODWLRQPDWUL[ PQ a RIQLVFRQVWUXFWHGDVIROORZV
PQ a
º ª[ « [ »» « « [ » « » [ » « «¬ [ »¼
/LNHZLVHRWKHUPDWULFHVDUHH[WHQGHGDVVKRZQDVIROORZV º [ »» [ » » [ » [ »¼
PQ a
ª[ « « « « « «¬
PQ a
ª [ « [ « « [ « « «¬
PQ a
º ª [ « »» [ « « » [ « » [ » « «¬ [ »¼
PQ a
ª [ « [ « « [ « [ « «¬
º »» » » » [ [ »¼
7KHDYHUDJHPDWUL[ P an LVFRPSXWHGDVIROORZVXVLQJ
º »» » » » [ »¼
408
Koon Chun Lai et al. / Procedia Computer Science 91 (2016) 402 – 411
p ° ° p °p ° ° p ° ° p ®p ° ° p ° ° p °p ° °p ¯
DQG3¶LVUHIHUUHGWKDW p ° ° p °p ° ° p ° ° p ®p ° ° p ° ° p ° ° p °p ¯
p
p
p
p
p
p
p
p
p
p
+HQFHWKHDYHUDJHPDWUL[IRUFULWHULRQQ1LVREWDLQHG
P Q
º ª [ « [ »» « « [ » « » [ » « «¬ [ »¼
7KHRWKHUPDWULFHVDUHFRPSXWHGDVVKRZQDVIROORZV
Koon Chun Lai et al. / Procedia Computer Science 91 (2016) 402 – 411
PQ
ª [ « « « « « «¬
[ [
[
º »» » » » [ »¼
PQ
º ª [ « [ »» « « [ » « » [ » « «¬ [ »¼
PQ
ª [ « [ « « [ « [ « «¬
409
º »» » » » [ »¼
)LQDOO\WKHIX]]\SUHIHUHQFHUHODWLRQPDWUL[CIRUWHDPLVFRQVWUXFWHGDVIROORZVXVLQJ
C
ª « « « « « «¬
º »» » » » »¼
'LVFXVVLRQ 7KHZHLJKWDVVHVVPHQWVIRUHDFKDXWKRUZLWKWKHUHVSHFWLYHFRQWULEXWLRQZHUHFRPSXWHGE\ DQG 7KH UHVXOWV DUH WDEXODWHG LQ 7DEOH )RU LQVWDQFH WKH ZHLJKW DVVHVVPHQW IRU ILUVW DXWKRU a LV DYHUDJH WA LV WKXVWKHICFIRUaLVGHWHUPLQHGDV 7KHWHDPKDVSXEOLVKHGWZRMRXUQDOSXEOLFDWLRQVWKDW ZHUH LQGH[HG E\ 6FRSXV GDWDEDVH DQG ,QVSHF ,QWHUQDWLRQDO GDWDEDVH UHVSHFWLYHO\ (DFK DXWKRU ZRXOG KDYH HDUQHG DQ LGHQWLFDO LQGLYLGXDO VFRUH RI DQG IRU HDFK SDSHU EHIRUH LPSOHPHQWLQJ WKH SHHU DVVHVVPHQW +RZHYHUWKHSURSRVHGDVVHVVPHQWLVDEOHWRLGHQWLI\WKHLQGLYLGXDOFRQWULEXWLRQDQGUHIOHFWLWZLWKDSSURSULDWH VFRUH)URP7DEOHaaDQGaDUHZLWKWKHZHLJKWVORZHUWKDQWKHDYHUDJHLQERWKSDSHUVWKHUHIRUHWKH DSSURSULDWHPDUNLVFRPSXWHGXVLQJ 7DEOH:HLJKWDVVHVVPHQWDQGDFWXDOFRQWULEXWLRQ $XWKRULQWHDP
WA
ICF
6FRSXV'DWDEDVH
,QWHUQDWLRQDO'DWDEDVH
a
a
a
a
a
410
Koon Chun Lai et al. / Procedia Computer Science 91 (2016) 402 – 411
)RUWKH6FRSXVSXEOLFDWLRQWKHZHLJKWVRIaDGaDUHKLJKHUWKDQWKHDYHUDJHDQGWKHLUICFVDUHDERYHWKH WKUHVKROGRIWKHLUPDUNVDUHHTXDOO\DGMXVWHGWR DVDUHZDUGIRUWKHLUVWURQJFRQWULEXWLRQ+RZHYHU a¶V ICF GRHV QRW H[FHHG WKH WKUHVKROG RI IRU WKH ,QVSHF SXEOLFDWLRQ 7KH DSSURSULDWH PDUN IRU a LV FRPSXWHG XVLQJ DQG LW LV DGMXVWHG ORZHU WKDQ a ZKR KDV LGHQWLILHG DV D JUHDW FRQWULEXWRU WR WKH LGHD SDUWLFLSDWLRQSUREOHPVROYLQJDQGZULWHXSRIWKHSDSHUV ,Q RUGHU WR GHPRQVWUDWH WKH YLDELOLW\ RI WKH VXJJHVWHG PHWKRGRORJ\ LQ SHHU DVVHVVPHQW ZH LQFOXGH WKH RXWFRPHVIURPRWKHUWKUHHWHDPVQDPHO\WHDPWHDPDQGWHDP7KHUHVXOWVDUHLOOXVWUDWHGLQ)LJIRU WKH SXUSRVH RI YLVXDOL]DWLRQ )LJ GLVSOD\V WKH IM LQGLYLGXDO PDUN EHIRUH DQG DIWHU LPSOHPHQWLQJ WKH SURSRVHGDVVHVVPHQW,WLVREYLRXVWKDWWKHJURXSPDUNVGRQRWUHIOHFWLQGLYLGXDOFRQWULEXWLRQV+RZHYHUZLWK WKH SURSRVHG DVVHVVPHQW WKH DFWXDO FRQWULEXWLRQ RI LQGLYLGXDO DXWKRU LV GLVWLQJXLVKDEOH DQG WKH DSSURSULDWH PDUNFDQEHWKXVDVVLJQHGDFFRUGLQJO\
)LJ3HHUDVVHVVPHQWRXWFRPHVIRUIRXUWHDPVDQGDWRWDORIGLIIHUHQWDXWKRUV
&RQFOXVLRQ 7KH SURSRVHG IX]]\ SHHU DVVHVVPHQW PHWKRGRORJ\ SUHVHQWV D IDLU DSSURDFK WR DVVHVV DQG GLVWLQJXLVK WKH SHHUV¶ FRQWULEXWLRQ LQ MRXUQDO SDSHU DFKLHYHPHQW 7KH IX]]\ SUHIHUHQFH UHODWLRQV DUH FDSDEOH RI SURYLGLQJ LQGLFHV WR UHIOHFW DXWKRUV¶ FRQWULEXWLRQ LQ D WHDP DQG VXEVHTXHQWO\ UDWH WKHP DFFRUGLQJO\ ZLWK DSSURSULDWH LQGLYLGXDOPDUN7KHPDUNIRUDXWKRUVLQDWHDPLVFRPSXWHGE\WKHLUDVVRFLDWHGLQGLYLGXDOFRQWULEXWLRQIDFWRU VFRUHVDQGWKHMRXUQDOUDQNPDUNVHWE\WKHXQLYHUVLW\$UHDOFDVHVWXG\KDVEHHQFDUULHGRXWDQGWKHRXWFRPHV GHPRQVWUDWHG WKDW WKH SURSRVHG PHWKRG KDV D SRWHQWLDO LQ KDQGOLQJ WKH IX]]\ SHHU DVVHVVPHQW WDVNV ZKLFK LQYROYHPXOWLSOHDXWKRUV LQWKLVFDVHILYHDXWKRUVLQDWHDP 7KHPHWKRGGLVWLQJXLVKHVWKHDFWXDOFRQWULEXWLRQ RI HDFK DXWKRU DQG LV DEOH WR LGHQWLI\ WKH PRVW FRQWULEXWHG PHPEHUV LQ WKH WHDP 7KH PHWKRGRORJ\ FDQ EH IXUWKHU GHSOR\HG DV D VWDQGDUGL]HG PHWKRG WR TXDQWLI\ FRDXWKRU FRQWULEXWLRQV LQ PXOWLDXWKRU SDSHUV DQG VXEVHTXHQWO\EHFRPHDVXSSOHPHQWHYDOXDWLRQWRROIRUWKHXQLYHUVLW\¶VGHFLVLRQPDNHUWRJUDGHRUUHZDUGWKH
Koon Chun Lai et al. / Procedia Computer Science 91 (2016) 402 – 411
411
DXWKRUV $V IXWXUH ZRUN D FRPSUHKHQVLYH VWXG\ RQ ODUJHU VL]H RI SRSXODWLRQ ZLOO EH LQFRUSRUDWHG LQWR WKH VXJJHVWHGPHWKRGRORJ\IRUWKHSXUSRVHRIUHOLDELOLW\HQKDQFHPHQW 5HIHUHQFHV >@$XUDQHQ21LHPLQHQ08QLYHUVLW\UHVHDUFKIXQFLQJDQGSXEOLFDWLRQSHUIRUPDQFH±$QLQWHUQDWLRQDOFRPSDULVRQResearch Policy >@'RFK\)-5&6HJHUV06OXLMVPDQV'7KHXVHRIVHOISHHUDQGFRDVVHVVPHQWLQKLJKHUHGXFDWLRQ $UHYLHZStudies in Higher Education >@6WHIDQL/$-3HHUVHOIDQGWXWRUDVVHVVPHQW UHODWLYHUHOLDELOLWLHVStudies in Higher Education >@+DQUDKDQ6-,VDDFV*$VVHVVLQJVHOIDQGSHHUDVVHVVPHQW WKHVWXGHQWV¶YLHZVHigher Education Research and Development >@/LP/.<6RPHUHILQHPHQWVRQSHHUDVVHVVPHQWRIJURXSSURMHFWVAssessment & Evaluation in Higher Education >@'HVSRWLV'..RURQDNRV*6RWLURV'$PXOWLREMHFWLYHSURJUDPPLQJDSSURDFKWRQHWZRUN'($ZLWKDQDSSOLFDWLRQWRWKHDVVHVVPHQW RIWKHDFDGHPLFUHVHDUFKDFWLYLW\Procedia Computer Science >@)DOFKLNRY1,QYROYLQJVWXGHQWVLQDVVHVVPHQWPsychology Learning & Teaching >@%RXG'-+ROPHV:+6HOIDQGSHHUPDUNLQJLQDQXQGHUJUDGXDWHHQJLQHHULQJFRXUVHIEEE Transactions on Education > @/RSH]5HDO)&KDQ<353HHUDVVHVVPHQWRIDJURXSSURMHFWLQDSULPDU\PDWKHPDWLFVHGXFDWLRQFRXUVHAssessment & Evaluation in Higher Education >@7RSSLQJ.-3HHUDVVHVVPHQWTheory Into Practice >@5LFKPRQG6HWDO7KHGHYHORSPHQWRIWKH3$5,QGH[ 3HHU$VVHVVPHQW5DWLQJ UHOLDELOLW\DQGYDOLGLW\The European Journal of Orthodontics >@&KHQJ::DUUHQ00DNLQJDGLIIHUHQFH XVLQJSHHUVWRDVVHVVLQGLYLGXDOVWXGHQW¶VFRQWULEXWLRQVWRDJURXSSURMHFWTeaching in Higher Education >@+DVWLH&)DK\.3DUDWW-7KHGHYHORSPHQWRIDUXEULFIURSHHUDVVHVVPHQWRILQGLYLGXDOWHDPZRUNVNLOOVLQXQGHUJUDGXDWHPLGZLIHU\ VWXGHQWVWomen and Birth >@*LHOHQ0'H:HYHU%3HHUDVVHVVPHQWLQDZLNL 3URGXFWLPSURYHPHQWVWXGHQWV¶OHDUQLQJDQGSHUFHSWLRQUHJDUGLQJSHHUIHHGEDFN Procedia-Social and Behavioral Sciences >@'DULR%+DJUDV+7VDQJ($JHQHWLFW\SHIX]]\ORJLFEDVHGV\VWHPIRUWKHJHQHUDWLRQRIVXPPDULVHGOLQJXLVWLFSUHGLFWLYHPRGHOV IRUILQDQFLDODSSOLFDWLRQVSoft Computing >@.ZRN5&:=KRX'=KDQJ40D-$IX]]\PXOWLFULWHULDGHFLVLRQPDNLQJPRGHOIRU,6VWXGHQWJURXSSURMHFWDVVHVVPHQWGroup Decision and Negotiation >@6DOHK,.LP6,$IX]]\V\VWHPIRUHYDOXDWLQJVWXGHQW¶VOHDUQLQJDFKLHYHPHQWExpert Systems With Applications >@3LQWR$45$0DTXDOLWDWLYHRFFXSDWLRQDOVDIHW\ULVNDVVHVVPHQWPRGHOIRUWKHFRQVWUXFWLRQLQGXVWU\WKDWLQFRUSRUDWHXQFHUWDLQWLHVE\ WKHXVHRIIX]]\VHWVSafety Science > @.KDOLOL'DPJKDQL.7DYDQD06DQWRV$UWHDJD)-$FRPSUHKHQVLYHIX]]\'($PRGHOIRUHPHUJLQJPDUNHWDVVHVVPHQWDQG VHOHFWLRQGHFLVLRQVApplied Soft Computing >@6DDW\7/'HFLVLRQPDNLQJZLWKWKHDQDO\WLFKLHUDUFK\SURFHVVInternational Journal of Services Sciences >@&KLFODQD)+HUUHUD)+HUUHUD9LHGPD(,QWHJUDWLQJWKUHHUHSUHVHQWDWLRQPRGHOVLQIX]]\PXOWLSXUSRVHGHFLVLRQPDNLQJEDVHGRQ IX]]\SUHIHUHQFHUHODWLRQVFuzzy Sets and Systems >@)RGRU-5RXEHQV0)X]]\SUHIHUHQFHPRGHOOLQJDQGPXOWLFULWHULDGHFLVLRQVXSSRUW'RUGUHFKW .OXZHU'RUGUHFKW3XEOLVKHUV >@7DQLQR7)X]]\SUHIHUHQFHRUGHULQJVLQJURXSGHFLVLRQPDNLQJFuzzy Sets and Systems >@+HUUHUD9LHGPD(+HUUHUD)&KLFODQD)/XTXH06RPHLVVXHVRQFRQVLVWHQF\RIIX]]\SUHIHUHQFHUHODWLRQVEuropean Journal of Operational Research >@&KDQJ7<&KHQ<7&RRSHUDWLYHOHDUQLQJLQ(OHDUQLQJ DSHHUDVVHVVPHQWRIVWXGHQWFHQWHUHGXVLQJFRQVLVWHQWIX]]\SUHIHUHQFH Expert Systems With Applications >@1HSDO.3$QDSSURDFKWRDVVLJQLQGLYLGXDOPDUNVIURPDWHDPPDUN WKHFDVHRI$XVWUDOLDQJUDGLQJV\VWHPDWXQLYHUVLWLHV Assessment & Evaluation in Higher Education >@&RQZD\5.HPEHU'6LYDQ$:X03HHUDVVHVVPHQWRIDQLQGLYLGXDO¶VFRQWULEXWLRQWRDJURXSSURMHFWAssessment & Evaluation in Higher Education
ScienceDirect Procedia Computer Science 91 (2016) 402 – 411
,QIRUPDWLRQ7HFKQRORJ\DQG4XDQWLWDWLYH0DQDJHPHQW ,740
$VVHVVPHQWRQDXWKRUFRQWULEXWLRQLQSXEOLFDWLRQ $WRROIRU GHFLVLRQPDNHUV .RRQ&KXQ/DLD 6HH+XQJ/DXE-LDQKXL:RQJE-RVKXD3UDNDVKD E
D )DFXOW\RI(QJLQHHULQJDQG*UHHQ7HFKQRORJ\8QLYHUVLWL7XQNX$EGXO5DKPDQ.DPSDU&DPSXV 3HUDN0DOD\VLD LKC Faculty of Engineering and Science, Universiti Tunku Abdul Rahman, Sungai Long Campus, 43000 Selangor, Malaysia
$EVWUDFW ,QWKLVSDSHUDQDVVHVVPHQWPRGHOWKDWLQFRUSRUDWHGZLWKIX]]\SUHIHUHQFHUHODWLRQVLVSURSRVHGWRDVVHVVWKHFRQWULEXWLRQ RIHDFKDXWKRUWKDWLVLQYROYHGLQSXEOLFDWLRQZRUN$FDVHVWXG\LVFRQGXFWHGWRGHPRQVWUDWHWKHDELOLW\RIWKHSURSRVHG PHWKRGRORJ\LQGLVWLQJXLVKLQJDQGUHIOHFWLQJWKHDFWXDOFRQWULEXWLRQRILQGLYLGXDODXWKRUWKURXJKSHHUDVVHVVPHQW5HVXOWV UHYHDOHG WKH IX]]\ SUHIHUHQFH UHODWLRQV DUH FDSDEOH WR SURYLGH LQGLFHV WR UHIOHFW DXWKRUV¶ FRQWULEXWLRQ LQ D WHDP DQG VXEVHTXHQWO\UDWHWKHPDFFRUGLQJO\ZLWKDSSURSULDWHLQGLYLGXDOPDUN7KHPDUNIRUDXWKRUVLQDWHDPLVFRPSXWHGE\WKHLU DVVRFLDWHGLQGLYLGXDOFRQWULEXWLRQIDFWRUVFRUHVDQGWKHMRXUQDOUDQNPDUNVHWE\WKHXQLYHUVLW\7KHPHWKRGRORJ\FDQEH IXUWKHUGHSOR\HGDVDVWDQGDUGL]HGPHWKRGWRTXDQWLI\FRDXWKRUV¶FRQWULEXWLRQVLQPXOWLDXWKRUSDSHUVDQGVXEVHTXHQWO\ EHFRPHDVXSSOHPHQWHYDOXDWLRQWRROIRUWKHXQLYHUVLW\¶VGHFLVLRQPDNHUWRJUDGHRUUHZDUGWKHDXWKRUV
© 2016 The Authors. Published by Elsevier B.V. This is an open access article under the CC BY-NC-ND license 7KH$XWKRUV3XEOLVKHGE\(OVHYLHU%9 (http://creativecommons.org/licenses/by-nc-nd/4.0/). 6HOHFWLRQDQGRUSHHUUHYLHZXQGHUUHVSRQVLELOLW\RIWKHRUJDQL]HUVRI,740 Peer-review under responsibility of the Organizing Committee of ITQM 2016 Keywords IX]]\SUHIHUHQFHUHODWLRQV SHHUDVVHVVPHQW MRXUQDOUDQNPDUN DXWKRUFRQWULEXWLRQ
,QWURGXFWLRQ 3XEOLFDWLRQLVDQLPSRUWDQWWDVNIRUERWKDFDGHPLFVDQGXQLYHUVLWLHVDVLWDSSHDUVDVDQLQGH[RISHUIRUPDQFH >@ $VVHVVPHQW LQ SXEOLFDWLRQ DFKLHYHPHQW LV JHQHUDOO\ FODVVLILHG DV D FRPELQHG MXGJPHQW RQ TXDOLW\ RI WKH SXEOLFDWLRQDQGH[WHQWRILQYROYHPHQWRUFRQWULEXWLRQRIWKHDXWKRU7KHTXDOLW\RIWKHSXEOLFDWLRQFDQEHGXHWR VHYHUDO PHWULFV HJ MRXUQDO LPSDFW IDFWRU MRXUQDO UDQN DQG QXPEHU RI FLWDWLRQV KRZHYHU LW LV GLIILFXOW WR DVVHVVWKHLQGLYLGXDOLQYROYHGLQDWHDP>@$FFRUGLQJWR>@DWHDPVFRUHLVRIWHQDVVLJQHGWRDOOWKHDXWKRUV ZKHUHDVLQ>@VLQJOHDXWKRUHGHTXLYDOHQW 6$( QXPEHULVFUHGLWHGWRHDFKLQGLYLGXDODXWKRU6$(QXPEHULV FRXQWHGE\GLYLGLQJHDFKSXEOLFDWLRQE\WKHQXPEHURIDXWKRUV
&RUUHVSRQGLQJDXWKRU7HO ID[ E-mail address:ODLNF#XWDUHGXP\
1877-0509 © 2016 The Authors. Published by Elsevier B.V. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/). Peer-review under responsibility of the Organizing Committee of ITQM 2016 doi:10.1016/j.procs.2016.07.104
Koon Chun Lai et al. / Procedia Computer Science 91 (2016) 402 – 411
403
1HYHUWKHOHVVERWKPHWKRGVGRQRWSURYLGHDIDLUUHIOHFWLRQRIHDFKPHPEHU¶VHIIRUW3HHUDVVHVVPHQW 3$ FRXOGEHDVROXWLRQWRWDFNOHWKHFKDOOHQJH,WLVDPHWKRGLQHYDOXDWLQJDQGSURYLGLQJIHHGEDFNRQWKHZRUNRI SHHUV >@ 9DULRXV UHVHDUFKHUV KDG UHSRUWHG WKH XVH RI SHHU DVVHVVPHQW PHWKRG WR HYDOXDWH LQGLYLGXDO FRQWULEXWLRQ LQ D WHDP >@ +DVWLH HW DO SURSRVHG D UXEULF PRGHO ZLWK SHHU DVVHVVPHQW WR HYDOXDWH WKH HIIHFWLYHWHDPZRUNVNLOOVRIWKHVWXGHQWV7KH\DVVXPHGWKHVNLOOVFDQKHOSVWXGHQWVWRFXOWLYDWHDJRRGSHUVRQDO EHKDYLRU>@*LHOHQDQG'H:HYHUUHSRUWHGDSHHUDVVHVVPHQWLQDFRPSXWHUVXSSRUWHGFROODERUDWLYHOHDUQLQJ HQYLURQPHQW LQ KLJKHU HGXFDWLRQ 3UHWHVW DQG SRVWWHVW ZHUH FRPSOHWHG E\ WKH VWXGHQWV EHIRUH DQG DIWHU WKH DVVHVVPHQWIRUFRPSDULVRQ>@ )X]]\VHWWKHRU\FDQEHXVHGWRGHDOZLWKOLQJXLVWLFWHUPVLQWKHSHHUJUDGLQJDVVHVVPHQW>@,WKDVEHHQ FRPPRQO\ LQWHJUDWHG LQWR YDULRXV DVVHVVPHQW WDVNV VXFK DV IX]]\ PXOWLFULWHULD GHFLVLRQ PDNLQJ PRGHO IRU FULWHULRQUHIHUHQFHG DVVHVVPHQW >@ SHHU DVVHVVPHQW RQ VWXGHQWVFHQWHUHG OHDUQLQJ DVVLJQPHQWV >@ RFFXSDWLRQDOVDIHW\ULVNDVVHVVPHQWRQFRQVWUXFWLRQVLWHV>@DQGUHFHQWO\LQGDWDHQYHORSPHQWDQDO\VLV '($ WR FRPSDUH WKH LQSXWVRXWSXWV DQG HYDOXDWH WKHLU UHODWLYH HIILFLHQF\ > @ 1HYHUWKHOHVV WKHUH LV D ODFN RI GHWDLOHG IX]]\ UHVHDUFK RQ LQGLYLGXDO DXWKRU FRQWULEXWLRQ LQ PXOWLDXWKRUHG SXEOLFDWLRQV ,Q WKLV SDSHU DQ DVVHVVPHQW PRGHOXVLQJ IX]]\ SUHIHUHQFHUHODWLRQ LV VXJJHVWHG WR LQYHVWLJDWH WKH FRQWULEXWLRQ RI HDFKDXWKRU $OO DXWKRUV ZKR FRQWULEXWHG LQ WKH SXEOLFDWLRQ DUH UHTXHVWHG WR SDUWLFLSDWH LQ D TXHVWLRQQDLUH 7KH ZHLJKWLQJ WKDW PHDVXUHV WKH LQGLYLGXDO FRQWULEXWLRQ LV FRPSXWHG XVLQJ IX]]\ SUHIHUHQFH UHODWLRQV (YHQWXDOO\ WKH SUDFWLFDOLW\RIWKHSURSRVHGPHWKRGRORJ\LVHYDOXDWHGZLWKDFDVHVWXG\ )X]]\SHHUDVVHVVPHQW $VXUYH\RQWKHVHOHFWLRQRIWKHDVVHVVPHQWJUDGLQJW\SHQDPHO\QXPHULFDOYDOXHVRUOLQJXLVWLFWHUPVZRXOG EHILUVWO\FDUULHGRXW%RWKJUDGLQJW\SHVZHUHIRXQGDFFHSWDEOHIURPWKHUHVSRQGHQWV7KHDQDO\WLFKLHUDUFK\ SURFHVV $+3 ZRXOGWKHQEHHPSOR\HGWRGHDOZLWKWKLVGHFLVLRQPDNLQJSUREOHP$+3FODVVLILHVWKHGHFLVLRQ DVWDUJHWKLHUDUFK\DQGSHUIRUPVWKHSDLUZLVHFRPSDULVRQRIFULWHULRQVDWGLIIHUHQWOHYHOVRIWKHKLHUDUFK\7DEOH VKRZVDJUDGLQJVFDOHRISHHUDVVHVVPHQW,WLVDUHGXFHGVHWRI6DDW\¶VVFDOHDVSUHVHQWHGLQ>@ 7DEOH5HGXFHG6DDW\¶VVFDOH &RQWULEXWLRQ
5HODWLRQ
(TXDOO\FRQWULEXWH
6LJQLILFDQWO\FRQWULEXWH
+XJH6WURQJFRQWULEXWLRQ
&RQVLGHUDWHDPT aa«aQ ZKHUHaLVWKHILUVWDXWKRUaLVVHFRQGDXWKRUDQGaQLVWKHODVWDXWKRULQ DSXEOLFDWLRQ(DFKDXWKRUZRXOGEHFRPHDQDVVHVVRULQTWRSURYLGHn SDLUZLVHSUHIHUHQFHUHODWLRQV7KH SURSRVHGIX]]\SUHIHUHQFHUHODWLRQVPRGHOFDQEHREWDLQHGLQDFFRUGDQFHWRWKHVL[VWHSVDVIROORZV 6WHS &RQYHUW WKH DVVHVVPHQW JUDGHV LH OLQJXLVWLF WHUPV WR QXPHUDO YDOXHV $ IXQFWLRQ ui,j RI PXOWLSOLFDWLYHSUHIHUHQFHUHODWLRQVLVGHILQHGDVIROORZV
404
Koon Chun Lai et al. / Procedia Computer Science 91 (2016) 402 – 411
ui j
ZHDNO\ FRQWULEXWH ° OHVV VLJQLILFDQWO\ FRQWULEXWH °° HTXDOO\ FRQWULEXWH ® ° VLJQLILFDQWO\ FRQWULEXWH ° °¯ VWURQJO\ FRQWULEXWH
ZKHUH ui j > @ DQGLVWKHSUHIHUUHGUHODWLRQVRIDXWKRUaiWRDXWKRUaj1RWHWKDW u i j u j i ZKHUHij «n 6WHS>@>@&RQVWUXFWDIX]]\SDLUZLVHSUHIHUHQFHUHODWLRQPDWUL[ Pan 7KHPDWUL[ZLWKRXWLQFOXGLQJ WKHDVVHVVRUaQ¶VSDLUZLVHSUHIHUHQFHUHODWLRQLVFRPSXWHGXVLQJ
Pa n
ª p « # « « pi « « # « pn ¬
"
p j
"
"
#
"
"
pi j
"
"
#
"
" pn j "
p n º # »» pi n » » # » pn n »¼
,Q DFFRUGDQFH ZLWK >@ IRXU UHDVRQDEOH RUGHULQJ SURSHUWLHV VKRXOG EH VDWLVILHG LQ WUDQVIRUPLQJ PXOWLSOLFDWLYHSUHIHUHQFHUHODWLRQVWRWKHIX]]\SUHIHUHQFHUHODWLRQVDVIROORZV 3 pi j ORJ u i j ui j > @ 3 ,I pi j >@WKHQ pi j p j i
3 ,Ii j nWKHQ pi j p j n pn i
$V WKH UHGXFHG 6DDW\¶V VFDOH LV XVHG LQ WKLV VWXG\ LH ui j > @ 3 LV PRGLILHG WR EHFRPH 3¶ DV IROORZV 3¶ pi j ORJ ui j ui j > @ $GGLWLRQDOO\ZHUHDUUDQJH3WR3¶DVIROORZV 3¶ ,I pi j >@WKHQ pi j
p j i i j
$QGVLQFH3 pi j p j n pn i 3¶ pi n
UHDUUDQJHWRJHW pi j p j n pi n WKXV
pi j p j n i j n
6WHS> @&RPSXWHWKHDYHUDJHPDWUL[ P an XVLQJ DVIROORZV
P an
§¨ n¨ ©
n
¦P
an
· ¸ ¸ ¹
6WHS$Q n u n PDWUL[CLVFRPSXWHGXVLQJ DQG DVIROORZV
405
Koon Chun Lai et al. / Procedia Computer Science 91 (2016) 402 – 411
C
" c n º " c n »» % # » » " cn n ¼»
ª c c «c « c « # # « c c ¬« n n
n
¦p
ZKHUH ci j
i j
i j
6WHS:HLJKWDVVHVVPHQW WA RIDXWKRUZKLFKLVWKHUDWLRRIWKHHYDOXDWHGVFRUHWRWKHVXPRIWKHKLJKHVW SRVVLEOHVFRUHVLVFDOFXODWHGXVLQJ DVIROORZV n
WAi
¦c
i j
j
¦C
6WHS>@>@(DFKLQGLYLGXDOFRQWULEXWLRQIDFWRU ICF LQJURXSTLVFRPSXWHGXVLQJ )LQDOO\HDFK LQGLYLGXDO¶VPDUN IM LVFRPSXWHGXVLQJ ZKHUHWKHVFDOHIDFWRUD LVDGRSWHG DVLQGLFDWHGLQ>@ ICF
WAi $YHUDJH WAi
IM
ICF d ICF ° JRM u ® ICF ICF E ICF E ° E ICF t E ¯
ZKHUH E
D JRM JRMGHQRWHVWKHMRXUQDOUDQNPDUNVHWE\WKHXQLYHUVLW\DVVKRZQLQ7DEOH
7DEOH-RXUQDOUDQNLQJPDUN ,QGH[LQJ'DWDEDVH
JRM
:HERI6FLHQFH
6FRSXVDQGHTXLYDOHQW
,QWHUQDWLRQDOHJ,QVSHFDQGHTXLYDOHQW
5HJLRQDO
,OOXVWUDWLYHFDVH ,Q WKLV VWXG\ D FDVH VWXG\ LV FRQGXFWHG IRU LOOXVWUDWLRQ :H VHOHFWHG RQH RI WKH WHDPV QDPHO\ WHDP FRQVLVWLQJILYHDXWKRUV aaaaDQGa WRSUHVHQWWKHGHWDLOVRIWKHPHWKRGRORJ\(DFKDXWKRULQWHDP ZDVUHTXHVWHGWRSURYLGHSDLUZLVHSUHIHUHQFHUHODWLRQVUHODWHGWRHDFKTXHVWLRQQDLUHDVVKRZQLQ7DEOH)RU LQVWDQFH WKH ILUVW DXWKRU a WKLQNV a KDV QRW FRQWULEXWHG DV PXFK DV a WKXV u a KDV VWURQJHU FRQWULEXWLRQFRPSDUHGWRa WKXV u DQGaKDVVLJQLILFDQWFRQWULEXWLRQFRPSDUHGWRa WKXV u LQSUHSDULQJWKHMRXUQDO1RWHWKDWWKHnWKFROXPQDQGnWKURZDUHQRWDVVHVVDEOHE\WKHnWKDXWKRU
406
Koon Chun Lai et al. / Procedia Computer Science 91 (2016) 402 – 411 7DEOH4XHVWLRQQDLUH ,WHP
&ULWHULD
Q
3UHSDUHGGUDIWRIUHSRUWVLQJRRGTXDOLW\
Q
&RQWULEXWHGFRQVWUXFWLYHLGHDVWRGLVFXVVLRQ
Q
3DUWLFLSDWHGDQGFRRSHUDWLYHLQJURXSDFWLYLWLHV
Q
&RQWULEXWHGJRRGSUREOHPVROYLQJVNLOOVWRWDVNJLYHQ
%HVLGHVVHOIDVVHVVLQJLVQRWDSSOLFDEOH PDUNHGDV³[´LQWKHPDWUL[ 7KXVWKHSURSRVHGSHHUDVVHVVPHQW V\VWHPFRQYHUWVOLQJXLVWLFWHUPVLQWRYDOXHVLQPDWUL[ P Q a DVWKHRXWFRPHRI
P Q a
ª[ « « « « « «¬
[
º »» [ » » [ » [ »¼
:LWKWKHVDPHSURFHVVWKHGHWDLOHGUHVXOWVRIHYHU\DXWKRULQWHDPIRUTXHVWLRQQDLUHQDUHSUHVHQWHGDV IROORZV [ [
º »» » P Q a » [ » [ »¼
ª[ « « « « « «¬
º » » » » [ » [ »¼
º » » [ » P Q a » [ » [ »¼
ª[ « « « « « «¬
º » [ » [ » » [ » [ »¼
P Q a
ª[ « « « « « «¬
P Q a
ª[ « « « « « «¬
[
[
[
1RZWKHIX]]\SDLUZLVHSUHIHUHQFHUHODWLRQLVJHQHUDWHGDSSO\LQJWKHDERYHPHQWLRQHGUHDVRQDEOHRUGHULQJ SURSHUWLHVZKHUHE\ 3¶LVUHIHUUHGWKDW p
ORJ
p
ORJ
p
ORJ
Koon Chun Lai et al. / Procedia Computer Science 91 (2016) 402 – 411
407
3¶LVUHIHUUHGWKDW p
p p
p
p p
p
p p
DQG3¶LVUHIHUUHGWKDW p p ° ° p p °p ° p ® ° p p °p p ° °¯ p p
7KHIX]]\SUHIHUHQFHUHODWLRQPDWUL[ PQ a RIQLVFRQVWUXFWHGDVIROORZV
PQ a
º ª[ « [ »» « « [ » « » [ » « «¬ [ »¼
/LNHZLVHRWKHUPDWULFHVDUHH[WHQGHGDVVKRZQDVIROORZV º [ »» [ » » [ » [ »¼
PQ a
ª[ « « « « « «¬
PQ a
ª [ « [ « « [ « « «¬
PQ a
º ª [ « »» [ « « » [ « » [ » « «¬ [ »¼
PQ a
ª [ « [ « « [ « [ « «¬
º »» » » » [ [ »¼
7KHDYHUDJHPDWUL[ P an LVFRPSXWHGDVIROORZVXVLQJ
º »» » » » [ »¼
408
Koon Chun Lai et al. / Procedia Computer Science 91 (2016) 402 – 411
p ° ° p °p ° ° p ° ° p ®p ° ° p ° ° p °p ° °p ¯
DQG3¶LVUHIHUUHGWKDW p ° ° p °p ° ° p ° ° p ®p ° ° p ° ° p ° ° p °p ¯
p
p
p
p
p
p
p
p
p
p
+HQFHWKHDYHUDJHPDWUL[IRUFULWHULRQQ1LVREWDLQHG
P Q
º ª [ « [ »» « « [ » « » [ » « «¬ [ »¼
7KHRWKHUPDWULFHVDUHFRPSXWHGDVVKRZQDVIROORZV
Koon Chun Lai et al. / Procedia Computer Science 91 (2016) 402 – 411
PQ
ª [ « « « « « «¬
[ [
[
º »» » » » [ »¼
PQ
º ª [ « [ »» « « [ » « » [ » « «¬ [ »¼
PQ
ª [ « [ « « [ « [ « «¬
409
º »» » » » [ »¼
)LQDOO\WKHIX]]\SUHIHUHQFHUHODWLRQPDWUL[CIRUWHDPLVFRQVWUXFWHGDVIROORZVXVLQJ
C
ª « « « « « «¬
º »» » » » »¼
'LVFXVVLRQ 7KHZHLJKWDVVHVVPHQWVIRUHDFKDXWKRUZLWKWKHUHVSHFWLYHFRQWULEXWLRQZHUHFRPSXWHGE\ DQG 7KH UHVXOWV DUH WDEXODWHG LQ 7DEOH )RU LQVWDQFH WKH ZHLJKW DVVHVVPHQW IRU ILUVW DXWKRU a LV DYHUDJH WA LV WKXVWKHICFIRUaLVGHWHUPLQHGDV 7KHWHDPKDVSXEOLVKHGWZRMRXUQDOSXEOLFDWLRQVWKDW ZHUH LQGH[HG E\ 6FRSXV GDWDEDVH DQG ,QVSHF ,QWHUQDWLRQDO GDWDEDVH UHVSHFWLYHO\ (DFK DXWKRU ZRXOG KDYH HDUQHG DQ LGHQWLFDO LQGLYLGXDO VFRUH RI DQG IRU HDFK SDSHU EHIRUH LPSOHPHQWLQJ WKH SHHU DVVHVVPHQW +RZHYHUWKHSURSRVHGDVVHVVPHQWLVDEOHWRLGHQWLI\WKHLQGLYLGXDOFRQWULEXWLRQDQGUHIOHFWLWZLWKDSSURSULDWH VFRUH)URP7DEOHaaDQGaDUHZLWKWKHZHLJKWVORZHUWKDQWKHDYHUDJHLQERWKSDSHUVWKHUHIRUHWKH DSSURSULDWHPDUNLVFRPSXWHGXVLQJ 7DEOH:HLJKWDVVHVVPHQWDQGDFWXDOFRQWULEXWLRQ $XWKRULQWHDP
WA
ICF
6FRSXV'DWDEDVH
,QWHUQDWLRQDO'DWDEDVH
a
a
a
a
a
410
Koon Chun Lai et al. / Procedia Computer Science 91 (2016) 402 – 411
)RUWKH6FRSXVSXEOLFDWLRQWKHZHLJKWVRIaDGaDUHKLJKHUWKDQWKHDYHUDJHDQGWKHLUICFVDUHDERYHWKH WKUHVKROGRIWKHLUPDUNVDUHHTXDOO\DGMXVWHGWR DVDUHZDUGIRUWKHLUVWURQJFRQWULEXWLRQ+RZHYHU a¶V ICF GRHV QRW H[FHHG WKH WKUHVKROG RI IRU WKH ,QVSHF SXEOLFDWLRQ 7KH DSSURSULDWH PDUN IRU a LV FRPSXWHG XVLQJ DQG LW LV DGMXVWHG ORZHU WKDQ a ZKR KDV LGHQWLILHG DV D JUHDW FRQWULEXWRU WR WKH LGHD SDUWLFLSDWLRQSUREOHPVROYLQJDQGZULWHXSRIWKHSDSHUV ,Q RUGHU WR GHPRQVWUDWH WKH YLDELOLW\ RI WKH VXJJHVWHG PHWKRGRORJ\ LQ SHHU DVVHVVPHQW ZH LQFOXGH WKH RXWFRPHVIURPRWKHUWKUHHWHDPVQDPHO\WHDPWHDPDQGWHDP7KHUHVXOWVDUHLOOXVWUDWHGLQ)LJIRU WKH SXUSRVH RI YLVXDOL]DWLRQ )LJ GLVSOD\V WKH IM LQGLYLGXDO PDUN EHIRUH DQG DIWHU LPSOHPHQWLQJ WKH SURSRVHGDVVHVVPHQW,WLVREYLRXVWKDWWKHJURXSPDUNVGRQRWUHIOHFWLQGLYLGXDOFRQWULEXWLRQV+RZHYHUZLWK WKH SURSRVHG DVVHVVPHQW WKH DFWXDO FRQWULEXWLRQ RI LQGLYLGXDO DXWKRU LV GLVWLQJXLVKDEOH DQG WKH DSSURSULDWH PDUNFDQEHWKXVDVVLJQHGDFFRUGLQJO\
)LJ3HHUDVVHVVPHQWRXWFRPHVIRUIRXUWHDPVDQGDWRWDORIGLIIHUHQWDXWKRUV
&RQFOXVLRQ 7KH SURSRVHG IX]]\ SHHU DVVHVVPHQW PHWKRGRORJ\ SUHVHQWV D IDLU DSSURDFK WR DVVHVV DQG GLVWLQJXLVK WKH SHHUV¶ FRQWULEXWLRQ LQ MRXUQDO SDSHU DFKLHYHPHQW 7KH IX]]\ SUHIHUHQFH UHODWLRQV DUH FDSDEOH RI SURYLGLQJ LQGLFHV WR UHIOHFW DXWKRUV¶ FRQWULEXWLRQ LQ D WHDP DQG VXEVHTXHQWO\ UDWH WKHP DFFRUGLQJO\ ZLWK DSSURSULDWH LQGLYLGXDOPDUN7KHPDUNIRUDXWKRUVLQDWHDPLVFRPSXWHGE\WKHLUDVVRFLDWHGLQGLYLGXDOFRQWULEXWLRQIDFWRU VFRUHVDQGWKHMRXUQDOUDQNPDUNVHWE\WKHXQLYHUVLW\$UHDOFDVHVWXG\KDVEHHQFDUULHGRXWDQGWKHRXWFRPHV GHPRQVWUDWHG WKDW WKH SURSRVHG PHWKRG KDV D SRWHQWLDO LQ KDQGOLQJ WKH IX]]\ SHHU DVVHVVPHQW WDVNV ZKLFK LQYROYHPXOWLSOHDXWKRUV LQWKLVFDVHILYHDXWKRUVLQDWHDP 7KHPHWKRGGLVWLQJXLVKHVWKHDFWXDOFRQWULEXWLRQ RI HDFK DXWKRU DQG LV DEOH WR LGHQWLI\ WKH PRVW FRQWULEXWHG PHPEHUV LQ WKH WHDP 7KH PHWKRGRORJ\ FDQ EH IXUWKHU GHSOR\HG DV D VWDQGDUGL]HG PHWKRG WR TXDQWLI\ FRDXWKRU FRQWULEXWLRQV LQ PXOWLDXWKRU SDSHUV DQG VXEVHTXHQWO\EHFRPHDVXSSOHPHQWHYDOXDWLRQWRROIRUWKHXQLYHUVLW\¶VGHFLVLRQPDNHUWRJUDGHRUUHZDUGWKH
Koon Chun Lai et al. / Procedia Computer Science 91 (2016) 402 – 411
411
DXWKRUV $V IXWXUH ZRUN D FRPSUHKHQVLYH VWXG\ RQ ODUJHU VL]H RI SRSXODWLRQ ZLOO EH LQFRUSRUDWHG LQWR WKH VXJJHVWHGPHWKRGRORJ\IRUWKHSXUSRVHRIUHOLDELOLW\HQKDQFHPHQW 5HIHUHQFHV >@$XUDQHQ21LHPLQHQ08QLYHUVLW\UHVHDUFKIXQFLQJDQGSXEOLFDWLRQSHUIRUPDQFH±$QLQWHUQDWLRQDOFRPSDULVRQResearch Policy >@'RFK\)-5&6HJHUV06OXLMVPDQV'7KHXVHRIVHOISHHUDQGFRDVVHVVPHQWLQKLJKHUHGXFDWLRQ $UHYLHZStudies in Higher Education >@6WHIDQL/$-3HHUVHOIDQGWXWRUDVVHVVPHQW UHODWLYHUHOLDELOLWLHVStudies in Higher Education >@+DQUDKDQ6-,VDDFV*$VVHVVLQJVHOIDQGSHHUDVVHVVPHQW WKHVWXGHQWV¶YLHZVHigher Education Research and Development >@/LP/.<6RPHUHILQHPHQWVRQSHHUDVVHVVPHQWRIJURXSSURMHFWVAssessment & Evaluation in Higher Education >@'HVSRWLV'..RURQDNRV*6RWLURV'$PXOWLREMHFWLYHSURJUDPPLQJDSSURDFKWRQHWZRUN'($ZLWKDQDSSOLFDWLRQWRWKHDVVHVVPHQW RIWKHDFDGHPLFUHVHDUFKDFWLYLW\Procedia Computer Science >@)DOFKLNRY1,QYROYLQJVWXGHQWVLQDVVHVVPHQWPsychology Learning & Teaching >@%RXG'-+ROPHV:+6HOIDQGSHHUPDUNLQJLQDQXQGHUJUDGXDWHHQJLQHHULQJFRXUVHIEEE Transactions on Education > @/RSH]5HDO)&KDQ<353HHUDVVHVVPHQWRIDJURXSSURMHFWLQDSULPDU\PDWKHPDWLFVHGXFDWLRQFRXUVHAssessment & Evaluation in Higher Education >@7RSSLQJ.-3HHUDVVHVVPHQWTheory Into Practice >@5LFKPRQG6HWDO7KHGHYHORSPHQWRIWKH3$5,QGH[ 3HHU$VVHVVPHQW5DWLQJ UHOLDELOLW\DQGYDOLGLW\The European Journal of Orthodontics >@&KHQJ::DUUHQ00DNLQJDGLIIHUHQFH XVLQJSHHUVWRDVVHVVLQGLYLGXDOVWXGHQW¶VFRQWULEXWLRQVWRDJURXSSURMHFWTeaching in Higher Education >@+DVWLH&)DK\.3DUDWW-7KHGHYHORSPHQWRIDUXEULFIURSHHUDVVHVVPHQWRILQGLYLGXDOWHDPZRUNVNLOOVLQXQGHUJUDGXDWHPLGZLIHU\ VWXGHQWVWomen and Birth >@*LHOHQ0'H:HYHU%3HHUDVVHVVPHQWLQDZLNL 3URGXFWLPSURYHPHQWVWXGHQWV¶OHDUQLQJDQGSHUFHSWLRQUHJDUGLQJSHHUIHHGEDFN Procedia-Social and Behavioral Sciences >@'DULR%+DJUDV+7VDQJ($JHQHWLFW\SHIX]]\ORJLFEDVHGV\VWHPIRUWKHJHQHUDWLRQRIVXPPDULVHGOLQJXLVWLFSUHGLFWLYHPRGHOV IRUILQDQFLDODSSOLFDWLRQVSoft Computing >@.ZRN5&:=KRX'=KDQJ40D-$IX]]\PXOWLFULWHULDGHFLVLRQPDNLQJPRGHOIRU,6VWXGHQWJURXSSURMHFWDVVHVVPHQWGroup Decision and Negotiation >@6DOHK,.LP6,$IX]]\V\VWHPIRUHYDOXDWLQJVWXGHQW¶VOHDUQLQJDFKLHYHPHQWExpert Systems With Applications >@3LQWR$45$0DTXDOLWDWLYHRFFXSDWLRQDOVDIHW\ULVNDVVHVVPHQWPRGHOIRUWKHFRQVWUXFWLRQLQGXVWU\WKDWLQFRUSRUDWHXQFHUWDLQWLHVE\ WKHXVHRIIX]]\VHWVSafety Science > @.KDOLOL'DPJKDQL.7DYDQD06DQWRV$UWHDJD)-$FRPSUHKHQVLYHIX]]\'($PRGHOIRUHPHUJLQJPDUNHWDVVHVVPHQWDQG VHOHFWLRQGHFLVLRQVApplied Soft Computing >@6DDW\7/'HFLVLRQPDNLQJZLWKWKHDQDO\WLFKLHUDUFK\SURFHVVInternational Journal of Services Sciences >@&KLFODQD)+HUUHUD)+HUUHUD9LHGPD(,QWHJUDWLQJWKUHHUHSUHVHQWDWLRQPRGHOVLQIX]]\PXOWLSXUSRVHGHFLVLRQPDNLQJEDVHGRQ IX]]\SUHIHUHQFHUHODWLRQVFuzzy Sets and Systems >@)RGRU-5RXEHQV0)X]]\SUHIHUHQFHPRGHOOLQJDQGPXOWLFULWHULDGHFLVLRQVXSSRUW'RUGUHFKW .OXZHU'RUGUHFKW3XEOLVKHUV >@7DQLQR7)X]]\SUHIHUHQFHRUGHULQJVLQJURXSGHFLVLRQPDNLQJFuzzy Sets and Systems >@+HUUHUD9LHGPD(+HUUHUD)&KLFODQD)/XTXH06RPHLVVXHVRQFRQVLVWHQF\RIIX]]\SUHIHUHQFHUHODWLRQVEuropean Journal of Operational Research >@&KDQJ7<&KHQ<7&RRSHUDWLYHOHDUQLQJLQ(OHDUQLQJ DSHHUDVVHVVPHQWRIVWXGHQWFHQWHUHGXVLQJFRQVLVWHQWIX]]\SUHIHUHQFH Expert Systems With Applications >@1HSDO.3$QDSSURDFKWRDVVLJQLQGLYLGXDOPDUNVIURPDWHDPPDUN WKHFDVHRI$XVWUDOLDQJUDGLQJV\VWHPDWXQLYHUVLWLHV Assessment & Evaluation in Higher Education >@&RQZD\5.HPEHU'6LYDQ$:X03HHUDVVHVVPHQWRIDQLQGLYLGXDO¶VFRQWULEXWLRQWRDJURXSSURMHFWAssessment & Evaluation in Higher Education