An Application of the UTAUT Model for Analysis of Adoption of Integrated License Service Information System

Available online at www.sciencedirect.com

ScienceDirect ScienceDirect

Procedia Computer Science 00 (2019) 000–000 Available online at www.sciencedirect.com Procedia Computer Science 00 (2019) 000–000

ScienceDirect

www.elsevier.com/locate/procedia www.elsevier.com/locate/procedia

Procedia Computer Science 161 (2019) 57–65

The Fifth Information Systems International Conference 2019 The Fifth Information Systems International Conference 2019

An Application of the UTAUT Model for Analysis of Adoption of An Application of the UTAUT Model for Analysis of Adoption of Integrated License Service Information System Integrated License Service Information System

Novianti Puspitasari*, Muhammad Bambang Firdaus, Celine Aloyshima Haris, Hario Jati Novianti Puspitasari*, Muhammad Bambang Firdaus, Celine Aloyshima Haris, Hario Jati Setyadi Setyadi Universitas Mulawarman, Jalan Kuaro, Samarinda and 75119, Indonesia Universitas Mulawarman, Jalan Kuaro, Samarinda and 75119, Indonesia

Abstract Abstract The use of information technology, especially information systems in government agencies is very important to improve public services. The Integrated technology, Licensing Service Information System is a computerized thatisperforms licensing processing The use of information especially information systems in governmentsystem agencies very important to data improve public services. The Integrated Licensing Serviceinformation InformationtoSystem is a to computerized thatthe performs licensing data processing and produces a collection of interacting be given all levels ofsystem users in Samarinda City Investment and and produces a collection of But interacting besystem given to all levels Samarinda City or Investment and Integrated One-Stop Service. since theinformation issuance oftothis in 2013 thereofhasusers beeninnothe system evaluation development. This study One-Stop uses the Unified Theory of Acceptance andofUse Technology (UTAUT) Performance Expectancy, Effort Integrated Service. But since the issuance thisofsystem in 2013 there hasmethod been nowith system evaluation or development. This study uses the Unified Theory of Acceptance and Use of Technology (UTAUT) method and withAge Performance Effort Expectancy, Social Influence, Facilitating Conditions, Behavioral Intention to Use, Gender, variables.Expectancy, This research was Expectancy, Influence, Facilitating Conditions, Intention to Use, Gender, and Age variables.System This research was conducted to Social determine the variables that affect users inBehavioral utilizing the Integrated Licensing Service Information and then to provide input and suggestions for Samarinda City Investment andthe Integrated One-Stop Service in the future implementation of the conducted to determine the variables that affect users in utilizing Integrated Licensing Service Information System and then to provide input suggestions foraccepted Samarinda City Investment and of Integrated in the implementation ofthat the system can beand better and can be according to the needs its users.One-Stop Based onService the results offuture the study, the variables system be better can be accepted according to the needs of its users.are Based on the results of the study, the the variables that greatly can influence the and acceptance and utilization of this information system performance expectations. Where Integrated Licensing Servicethe Information can improve theinformation quality of public especiallyexpectations. licensing services system greatly influence acceptanceSystem and utilization of this systemservices, are performance Whereand thethis Integrated Licensing System improve theeffectiveness. quality of public services, especially licensing services and this system becomes a Service necessityInformation in supporting workcan efficiency and becomes a necessity in supporting work efficiency and effectiveness. © 2019 The Authors. Published by Elsevier B.V. © 2019 The Authors. Published by Elsevier B.V. © 2019 The Authors. by Elsevier B.V. This is an open accessPublished article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/) This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/) This is an open access article under CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/) Peer-review under responsibility ofthe thescientific scientific committee The Fifth Information Systems International Conference 2019 Peer-review under responsibility of committee ofofThe Fifth Information Systems International Conference 2019. Peer-review under responsibility of the scientific committee of The Fifth Information Systems International Conference 2019 Keywords: Integrated Licensing Service Information System; UTAUT; Samarinda City Investment and Integrated One-Stop Service Keywords: Integrated Licensing Service Information System; UTAUT; Samarinda City Investment and Integrated One-Stop Service

* Corresponding author. Tel.: +62-54-175-3133. address:author. [email protected] * E-mail Corresponding Tel.: +62-54-175-3133. E-mail address: [email protected] 1877-0509 © 2019 The Authors. Published by Elsevier B.V. This is an open access under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/) 1877-0509 © 2019 Thearticle Authors. Published by Elsevier B.V. Peer-review under responsibility of the scientific committee of The Fifth Information Systems International Conference 2019 This is an open access article under CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/) Peer-review under responsibility of the scientific committee of The Fifth Information Systems International Conference 2019 1877-0509 © 2019 The Authors. Published by Elsevier B.V. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/) Peer-review under responsibility of the scientific committee of The Fifth Information Systems International Conference 2019. 10.1016/j.procs.2019.11.099

58 2

Novianti Puspitasari et al. / Procedia Computer Science 161 (2019) 57–65 Author name / Procedia Computer Science 00 (2019) 000–000

1. Introduction The government began to apply information technology to support work efficiency and effectiveness, but in reality, so far, that most government agencies are still not effective in implementing information technology, especially in public service information systems. Use of information technology among government agencies is still less attention and is still not optimal. utilization of information technology it must also be balanced with training for its use for employees and information systems that are formed must provide changes that can really be needed for the government institutions in order to increase efficiency and effectiveness in public services. Samarinda City Investment and Integrated One-Stop Service is one of the government agencies that utilize information technology. The Unified Theory Of Acceptance And Use Of Technology (UTAUT) method is a method of user acceptance of information technology [1]. However, the implementation of the system in this service is not optimal. UTAUT Method there are 4 concepts [2], namely performance expectancy, effort expectancy, social influence, and facilitating conditions for behavioral intention and use behavior [3]. And there are four moderator variables, namely gender, age, experience, and voluntariness of use [4,5]. Therefore, in this study using the utaut method to analyze the acceptance and use of users of the integrated licensing service information system. The variables used are performance expectancy, effort expectancy, social influence, facilitating conditions, behavioral intention to use, gender, and age [6]. Furthermore, the results of this study are expected to be able to provide recommendations to relevant parties Integrated One-Stop Service in improving the application of information technology in their institutions so that the implementation becomes optimal. 2. Literature review 2.1. Integrated licensing service information system The Integrated Licensing Service Information System is a computerized system that performs licensing data processing and produces a collection of interacting information to be given to all levels of users in the Samarinda City Investment and Integrated One-Stop Service came into use in 2013 until now. Accordance with the Law of the Republic of Indonesia Number 25 of 2009 about investment planting intended to improve the quality of public services and Government Regulation Number 24 of 2018 concerning licensing services trying to be integrated electronically. This Integrated Licensing Service Information System is divided into 5 levels of users namely Front Office, Back Office, Production, Regional Retribution Assessment Letter, and Validation. Front Office, employees receive and check the completeness of documents submitting permit applications, then if the file is complete, the employee will input data for the purpose of registering a permit application through the system if the file is incomplete and returned to the applicant. The next stage in the Back Office that will verify and validate the data / document for the permission request, if the file is invalid, it will be returned with an attachment to the lack of the file. If the file is valid, it will be forwarded to the Production section. It is in the Production section that will print the Permit Issuance Decree in accordance with the provisions and formats available. If there is a letter of permit application that is collected, a Regional Retribution Assessment Letter will be made which will then be paid by the applicant. Continue in the Validation stage, namely the approval stage or initial decision of the permit in stages. Starting from initial Section Head and Head of Division, Secretary, and Head of Service. The Integrated Licensing Service Information System display, there is a Routing Search, Inbox, Outbox, Recapitulation, Annual Recapitulation of Permits, Recapitulation of Print Yearly Decree, File Reports, Change Password, and Logout.  Routing Search is intended to find files through the Registration Number or Applicant's Name or Business Name.  Inbox contains a form for the new permit application data to be entered by the Front Office section.  Outbox contains a form that has been entered recently and will be verified in the Back-Office section.  Recapitulation contains data that is ready to be printed by the Production section which is then printed into a Decree.  Annual permit recapitulation, in this feature contains a joint recapitulation of permits issued by Samarinda City Investment and Integrated One-Stop Service in the year search.  Recapitulation of the Annual Decree Print, in this feature contains a decree (Decree) that has been issued for printing using a search per year.



Novianti Puspitasari et al. / Procedia Computer Science 161 (2019) 57–65 Author name / Procedia Computer Science 00 (2019) 000–000

59 3

 File Report, this feature can only be seen after being validated and reported by the Section Head and Head of Division, Secretary, and Head of Service. This feature is accessed to view reports of permit application files that have been processed.  Change Password, this feature is for changing employee passwords.  Logout, this feature is used when going out of the information system. 2.2. Model unified theory of acceptance and use of technology The Unified Theory of Acceptance and Use of Technology (UTAUT) is a research method based on psychology and sociology [1]. UTAUT is one of the latest technology acceptance models developed from previous models commonly used to conduct research on user acceptance of information technology. The UTAUT method aims to explain the user's intent to use information systems and subsequent usage behavior [7]. The division of Unified Theory of Acceptance and Use of Technology (UTAUT) into four concepts that can be observed and measured (construct) by playing an important role in the use of concepts from behavioral intention and use behavior, namely Performance Expectancy, Effort Expectancy, Social Influence, and Facilitating Condition. Not only that, there are also four key moderators in the UTAUT model, the four key moderators for the UTAUT model include gender, age, experience, and voluntariness of use. The UTAUT Research Model can be seen in Fig. 1 [1].

Fig. 1. UTAUT Model.

2.3. Results testing and analysis techniques Validity test states that the instrument used to obtain data in the study can be used or not. According to Firdaus [8] that valid means the instrument can be used to measure what should be measured to find the validity value on an item correlate the item score with the total items. If an item does not meet the requirements, the item will not be further investigated. These conditions must be fulfilled, namely, must have the following criteria.  If rcount > rtable, then the item is a valid question.  If rcount < rtable, then the question item is invalid. Measurement instrument (eg a questionnaire) is said to be reliable when giving a consistent score on each measurement. Reliability shows consistency and stability of a measurement scale using the value of Cronbach Alpha. Reliability can be known by the Cronbach Alpha equation (𝛼𝛼). A construct or variable is said to be reliable if it gives a Cronbach Alpha value> 0.60 [9]. Analysis The results in this study used the Spearman Rank Correlation (Spear's rank correlation) to test the H1-H5 hypothesis relating to 4 main variables. This Spearman rank correlation is used to measure the relationship between two variables where both variables form rank. As a reference for correlation assessment criteria, it can be guided by Table 1. The results analysis in this study uses the Moderation Regression Test to test the hypothesis H6-H9 which is related to 2 moderator variables. Regression analysis is one of the data analysis techniques in statistics that is often used to

Novianti Puspitasari et al. / Procedia Computer Science 161 (2019) 57–65 Author name / Procedia Computer Science 00 (2019) 000–000

60 4

examine the relationship between several variables and predict a variable [9]. Find out each statement of the proposed hypothesis is accepted or not, then the value of the risk of errors submitted is 5% (α = 5%). If the significance value is Sig. <0.05 then the hypothesis is accepted, and vice versa. We find out the correlation relationship uses an assessment based on Table 1. Table 1. Correlation assessment criteria. Coefficient interval

Level of relation

0,00 – 0,199

Very Weak

0,20 – 0,399

Weak

0,40 – 0,599

Middle

0,60 – 0,799

Strength

0,80 – 1,000

Very Strengh

3. Method 3.1. Variable Independent variables or independent variables in this study are performance expectations (Performance Expectancy), business expectations (Effort Expectancy), influence of social conditions (Social Influence), and facilitation conditions (Facilitating Conditions). The dependent variable or dependent variable in this study is interest in utilization (Behavioral Intention). The influence of interest in use (Behavioral Intention) on use (Use Behavioral) is ignored, based on the consideration that interest in use (Behavioral Intention) as a predictor of use (Use Behavioral) has been widely accepted in various user acceptance models [1]. Table 2. Indicator of research variables. Variable

Performance Expectancy (PE)

Effort Expectancy (EE)

Social Influence (SI)

Facilitating Conditions (FC) Gender (G) Age (A) Behavioral Intention to Use (BIUS)

Indicator PE1

Utilization of Perception

PE2

Increasing Effectiveness

PE3

Productivity

PE4

Ease of Getting Information

EE1

Ease of interaction

EE2

Ease of Learning

EE3

Ease of Use

EE4

Ease To Become An Expert

SI1

Co-worker Factor

SI2

Support from influential people

SI3

Assistance in Use

FC1

Facilitating Conditions

FC2

Compatible Devices

G1

Difference between men or women

A1

Age difference

BIUS1

Planning to Use Long-Term

BIUS2

Use More Often

The moderator variables in this study were gender (gender) and age (age). Two other moderator variables in the Unified Theory of Acceptance and Use of Technology (UTAUT) method were ignored in this study. This is based on several considerations. First, experience (Experience); the experience of official staff who use the Integrated Licensing



Novianti Puspitasari et al. / Procedia Computer Science 161 (2019) 57–65 Author name / Procedia Computer Science 00 (2019) 000–000

61 5

Service Information System is seen to be relatively the same because these employees constitute transfers from various offices, sub-districts or sub-districts that were previously familiar with the use of the system and because prior to the launch of the system training was always held first. Therefore, this study ignores experience (Experience) variables from moderator variables. Second, voluntary use (Voluntariness of Use); in certain conditions, such as filling in the initial data for submitting permit documents is a mandatory use of a system to accelerate the process of public service. But in other conditions the use of an Integrated Licensing Service Information System is voluntary because this system is used to facilitate services. Avoid the possible ambiguity, this study removes the Voluntariness of Use from the moderator variable. The indicators of each research variable can be seen in Table 2. 3.2. Research model This research using the modified Unified Theory of Acceptance and Use of Technology (UTAUT) method and the variables used are performance expectations (Performance Expectancy), business expectations (Effort Expectancy), influence of social conditions (Social Influence), facilitating conditions ( Facilitating Conditions), technology utilization (Behavioral Intentions), usage behavior (Use Behavioral), gender (gender) and age (age) because the framework of the model is in accordance with the conditions at the Samarinda City Investment and Integrated Services Office. From the explanation above, the model framework in this study is in Fig. 2 as follows.

Fig. 2. Research model.

3.3. Hypothesis The hypothesis is interpreted as a temporary answer to a problem that is still a presumption because it must be verified. In this study there are several hypotheses that appear to explain what variables influence the use of information technology in licensing service information systems in Samarinda's One Stop Investment and Service Office (See Table 3). Table 3. Hypothesis. No.

Hyphotesis

Novianti Puspitasari et al. / Procedia Computer Science 161 (2019) 57–65 Author name / Procedia Computer Science 00 (2019) 000–000

62 6

H1

Performance expectations have an influence on the interest in the use and use of the Integrated Licensing Service Information System.

H2

Business Expectations have an influence on the Interest in the Use and Use of the Integrated Licensing Service Information System.

H3

Business Expectations have an influence on Performance Expectations in the application of information technology.

H4

Social Factors have an influence on the Interest in the Use and Use of Integrated Licensing Services Information Systems.

H5

Facilitating conditions have an influence on the interest in the use and use of the Integrated Licensing Service Information System.

H6

Performance Expectations have an influence on the Interest in Utilizing and Using Integrated Licensing Service Information Systems which are moderated by Gender.

H7

Social Factors have an influence on the Interest in Utilizing and Using Integrated Licensing Service Information Systems which are moderated by Gender.

H8

Performance Expectations have an influence on the Interest in Utilizing and Using Integrated Licensing Services Information Systems which are moderated by Age.

H9

Business Expectations have an influence on the Interest in the Use and Use of Integrated Licensing Services Information Systems which are moderated by Age.

4. Result and discussion 4.1. Data The research data was obtained by distributing questionnaires to Samarinda City Investment Services and Integrated One-Stop Service staff using the Integrated Licensing Service Information System. The questionnaires were distributed as many as 70 copies for 3 weeks and the return of the questionnaire reached 89%, namely as many as 62 copies. The remaining 8 copies of the questionnaire were not filled because the employees who were given the questionnaire were doing official work outside the office and there were also employees who were outside the city. The distribution of questionnaires was addressed to 2 sub-sections and 5 fields in Samarinda City's DPMPTSP namely sub-program and planning and general and staffing, investment, data and information processing, promotion and investment, licensing services (which are divided into 3 namely front office, back office, and production), as well as the fields of control and supervision. The research data is also obtained from interviews, namely with the head of the field and staff from the data and information processing and licensing services as many as 7 people. Interviews were conducted after distributing questionnaires for 3 weeks. 4.2. Discussion This research conducted testing instrument, namely the validity (see Table 4) and reliability (see Table 5). Test instrument by comparing rhitung with rtabel value in this test the number of samples used (n) = 62 and alpha = 0.05, obtained rtabel = 0.250. Indicators rhitung be valid if the value is greater than the value rtabel. In the validity test, all variables that have an indicator declared valid. However, the gender and age variables cannot test the validity for these variables consists of only one statement. The next test is a test instrument realiabilitas, is said to be reliable if the value of Cronbach Alpha > 0.60. All the variables have been reliable so it unfit for use. However, the gender and age variables cannot be done because of the reliability test on the variable consists of only one statement. Further testing of the hypothesis (See Table 6). For the first hypothesis (H1) is accepted with a significance value of 0.000. The second hypothesis (H2) is received by the significant value of 0.316. The third hypothesis (H3) is received by the significant value of 0.290. The fourth hypothesis (H4) is received by the significant value of 0.318. The fifth hypothesis (H5) was accepted with a significance value of 0.006. The sixth hypothesis (H6) is received by the significant value of 0.041. Seventh hypothesis (H7) was rejected by the significant value of 0.112. Eighth hypothesis (H8) were received with significant value 0,010. And ninth hypothesis (H9) was rejected by the significant value of 0,559.



Novianti Puspitasari et al. / Procedia Computer Science 161 (2019) 57–65 Author name / Procedia Computer Science 00 (2019) 000–000

63 7

Table 4. Results validity. No.

variables

1. performance Expectancy (PE)

2. effort Expectancy (EE)

3. Social Influence (SI) 4.

facilitating Conditions (FC)

Indicator

R-Count

R-Table

Information

PE1

0.678

.250

valid

PE2

0.704

.250

valid

PE3

0.743

.250

valid

PE4

0,702

.250

valid

EE1

0.617

.250

valid

EE2

0.691

.250

valid

EE3

.654

.250

valid

EE4

0.772

.250

valid

SI1

0.698

.250

valid

SI2

.737

.250

valid

Si3

0.854

.250

valid

FC1

0.858

.250

valid

FC2

.863

.250

valid

5.

gender (G)

G1

-

.250

Cannot Be Tested

6.

Age (A)

A1

-

.250

Cannot Be Tested

7.

Behavioral Intention to Use (BIUS)

BIUS1

.896

.250

valid

BIUS2

0.843

.250

valid

The results of this study the most influential variable is the variable expectations of performance (Performance Expectancy) were categorized as being against the use and acceptance of Information Systems at the Integrated Licensing Services Office of the City Investment and Integrated Services Samarinda. It is also supported by empirical evidence [1,2,6] which showed the same results that affect the performance expectations of an interest in the use and acceptance of the technology. Based on interviews with seven people interviewed or 11% of the respondents said that the existence of this system is very supportive, faster, and efficient in processing the permit. This system will be the need to improve the quality of public services in accordance with the Law of the Republic of Indonesia Number 25 of 2007 on the investment. Table 5. Results of test reliability. No.

Variables

Cronbach Alpha

Information

1.

performance Expectancy (PE)

.652

reliable

2.

effort Expectancy (EE)

0.617

reliable

3.

Social Influence (SI)

0,646

reliable

4.

facilitating Conditions (FC)

.650

reliable

5.

gender (G)

-

Cannot Be Tested

6.

Age (A)

-

Cannot Be Tested

7.

Behavioral Intention to Use (BIUS)

0.657

reliable

The most influential variable next is the expectation of performance (Performance Expectancy) received by the variable moderate gender (gender) and age (Age), which is supported by empirical evidence [6], [7] and [10] are obtained research results the same gender differences have an impact on the performance of the use and the use of technology. Based on interviews with four people who were interviewed or 6% of respondents said that the age of the individual have an influence on the use of the system, the older a person is, the slower it will be to learn the system and the more young people will understand the use of the system.

64 8

Novianti Puspitasari et al. / Procedia Computer Science 161 (2019) 57–65 Author name / Procedia Computer Science 00 (2019) 000–000

This study also found business expectation variables, social factors, and facilitation conditions that have an impact on the low use of Integrated Licensing Service Information Systems in Integrated Investment Services and One Stop Service Services in Samarinda. This is evidenced by interviews with five people interviewed or 8% of respondents said that the ease of use of this system is relatively easy for some parts and sometimes there are system difficulties or errors in other parts. Therefore, the level of ease of use which is relatively low for specific conditions users experience difficulties in using the system. Like the ease of entering retribution values, sometimes the calculated value has an error. If a coworker or IT team is in the office, it can help solve problems quickly, but if not, then repairs will be hampered. And also the condition of facilities is low because facilities are very influential in supporting this system but in certain areas there are adequate facilities and also in other areas there are obstacles such as lack of procurement for scanners and printers, and slow internet networks. Likewise, social factors are in certain conditions when a system error occurs and ask for help from colleagues. Variables that do not affect or rejected by the moderating variable is the social factor of gender moderated the utilization and acceptance of Information Systems Integrated Licensing Service in Samarinda Investment and Integrated Services One Stop. It is also supported by empirical evidence [7]. In which, research shows the same results that the influence of social factors on the interest in the use and use of the system is not moderated by gender due to the important role of national culture in the context of this theory and supported by empirical evidence [9] that the relationship of social influences on behavior intention not moderated by gender. Based on interviews with seven people interviewed or 11% of the respondents, all say that there is no influence between men and women. The difference lies in the duties and responsibilities of the job. Table 6. Results of hypothesis. Hypothesis

Value significance

Information

1.

0,000

BE ACCEPTED

2.

0,012

BE ACCEPTED

3.

0,022

BE ACCEPTED

4.

0,012

BE ACCEPTED

5.

0,006

BE ACCEPTED

6.

.0041

BE ACCEPTED

7.

0.112

REJECTED

8.

0,010

BE ACCEPTED

9.

0,559

REJECTED

The next variable that does not affect or rejected by moderating variables, namely the expansion of Age (Expectancy Expectancy) (Age) on the utilization and acceptance of Information Systems Integrated Licensing Service in Samarinda Investment and Services One Stop. It is also supported by empirical evidence [9] which showed the same results that the effect of the relationship on the business expectations behavioral intention to adopt the Digital Home Service in Surabaya is not supported by the variable moderated by age. And also, in the study [11] which showed the same results that the relationship with the business expectations of behavioral intention is not moderated by age. Based on interviews with four people who were interviewed or 6% of respondents, all say that age has no impact on the level of convenience to learn the system or operating system. 5. Conclusion Based on the results of research and discussion on the acceptance and use of the Integrated Licensing Service Information System, the most influential variable is performance expectations. Because this variable has an influence in improving the quality of public services. This system has become a necessity in supporting work efficiency and effectiveness in Samarinda City Investment and Integrated One-Stop Service. Future research is expected to conduct



Novianti Puspitasari et al. / Procedia Computer Science 161 (2019) 57–65 Author name / Procedia Computer Science 00 (2019) 000–000

65 9

research by involving other variables in the UTAUT method that were not included in this study and can use different analysis models and applications. Acknowledgement Thank you to Samarinda City Investment and Integrated One-Stop Service which is the place for research. References [1] Venkatesh ,V, MG Morris, GB Davis, and FD Davis. (2003) “User Acceptance of Information Technology: Toward a Unified View.” MIS Q 27 (3): 425–478. [2] Venkatesh , V, T. A. Sykes, and X. Zhang. (2011) “‘Just what the doctor ordered’: A revised UTAUT for EMR system adoption and use by doctors”, in Proc. Annu. Hawaii Int. Conf. Syst. Sci. 1–10. [3] Carlsson , C, J. Carlsson, K. Hyvönen, J. Puhakainen, and P. Walden. (2006) “Adoption of mobile devices/services - Searching for answers with the UTAUT”, in Proc. Annu. Hawaii Int. Conf. Syst. Sci. 6 (c) : 1–10. [4] Seddon, KD, IC Barnett, and LP de Ambrosis. (1984) “Use of Large Scale Load Tests in Foundation Design and Construction”, in Natl. Conf. Publ. - Inst. Eng. Aust. 1–11. [5] Thong, JYL, V Venkatesh, X Xu, SJ Hong, and KY Tam. (2011) “Consumer acceptance of personal information and communication technology services.” IEEE Transactions on Engineering Management 58 (4) : 613–625. [6] Min, Q, S Ji, and G Qu. (2008) “Mobile Commerce User Acceptance Study in China: A Revised UTAUT Model.” Tsinghua Sci. Technology 13 (3) : 257–264. [7] Puspitasari, N. (2013) “Analisis Penerapan Sistem Informasi Manajemen Rumah Sakit Menggunakan Metode UTAUT dan TTF [Title in English: Analyzing the Implementation of UTAUT Model in Hospital Management Information Systems].” Jnteti 2 (4): 225–232. [8] Firdaus, MB. (2017) “Pengembangan Alat Ukur Keterbukaan Informasi Publik pada Situs Web Pemerintah Studi Kasus Kabupaten Kutai Kartanegara [Title in English: Developing a Tool to Measure Public Information Openness on Government Website, Case Study: Kutai Kartanegara Regency].” J. Ilm. Ilmu Komput 3 (1) : 7–13. [9] Arum, D Nirmala Janie. Statistik Deskriptif & Regresi Linier Berganda dengan SPSS [Title in English: Descriptive Statistics and Multiple Linear Regressions Using SPSS], Semarang University Press. [10] Zhang, H, H Su, X Ma, and D Huang. (2010) “MBA education teaching evaluation based on SPSS”, 2nd Int. Work. Educ. Technol. Comput. Sci. ETCS 2010. 2 : 516–519. [11] Prasetyo, DY, and Program, (2017) “Penerapan Metode UTAUT (Unified Theory of Acceptance and Use of Technology) Dalam Memahami Penerimaan dan Penggunaan Website KKN LPPM UNISI [Title in English: UTAUT Model Implementation to Understand the Acceptance and Usage of a University Unit Website: KKN LPPM UNISI].” J. Sistemasi 6 (2) : 26–34.