Newspaper Ad Submission and Payment Website Measurement Analysis Using McCall and PIECES
DOI:
https://doi.org/10.26555/jiteki.v11i2.30355Keywords:
Software Quality, McCall, PIECES, Newspaper Ad, Payment, WebsiteAbstract
The transition to digital platforms in the media industry requires robust systems to ensure efficiency and user satisfaction. As with Digital Iklan Radar Banjarmasin, the Newspaper ad submission and payment website, there is a need for evaluation to comprehensively ensure software feasibility and quality. This research evaluates the quality of the Newspaper ad submission and payment website using the McCall and PIECES frameworks, comparing their strengths and identifying areas for improvement. This research contributes to determining the most suitable evaluation methods for such types of websites while offering actionable insights for developers to improve the quality of systems and services. Data collection involved online surveys with 106 respondents and 38 Likert-scale questions mapped to McCall and PIECES frameworks. Statistical tests, including validity, reliability, and an independent t-test, were applied to compare results. McCall's evaluation rated the system at 68% (Good), with low scores in Usability (38.5%), Reliability (36.77%), and Efficiency (38.15%), indicating areas needing significant improvement. PIECES evaluation scored 80.4% (Good), with Performance (81%) and Service (82.39%) rated Very Good, though Control and Security (78.55%) required enhancement. Statistical analysis with independent t-test confirmed significant differences between the two methods, indicating that both methods measure aspects of software quality from different perspectives, thus providing complementary insights for evaluation. The study highlights the complementary nature of McCall and PIECES in software quality evaluation. Recommendations include improving usability, system stability, and security for better user experiences. Future research should involve broader demographic samples and different system types to validate findings and enhance generalizability.
References
[1] M. Kans and J. Campos, “Digital capabilities driving industry 4.0 and 5.0 transformation: Insights from an interview study in the maintenance domain,” Journal of Open Innovation: Technology, Market, and Complexity, vol. 10, no. 4, Dec. 2024, https://doi.org//10.1016/j.joitmc.2024.100384.
[2] R. Busulwa, M. Pickering, and N. W. Pathiranage, “Readiness of hospitality and tourism curricula for digital transformation,” J Hosp Leis Sport Tour Educ, vol. 35, Nov. 2024, https://doi.org//10.1016/j.jhlste.2024.100519.
[3] C. Yang, M. Gu, and K. Albitar, “Government in the digital age: Exploring the impact of digital transformation on governmental efficiency,” Technol Forecast Soc Change, vol. 208, Nov. 2024, https://doi.org//10.1016/j.techfore.2024.123722.
[4] J. Crusoe, J. Magnusson, and J. Eklund, “Digital transformation decoupling: The impact of willful ignorance on public sector digital transformation,” Gov Inf Q, vol. 41, no. 3, Sep. 2024, https://doi.org//10.1016/j.giq.2024.101958.
[5] P. Saha, A. Sengupta, and P. Gupta, “Influence of personality traits on generation Z consumers’ click-through intentions towards personalized advertisements: A mixed-methods study,” Heliyon, vol. 10, no. 15, Aug. 2024, https://doi.org//10.1016/j.heliyon.2024.e34559.
[6] V. Pijlman and A. Burgmeijer, “Using A/B testing to study engagement with Snapchat advertisements promoting help-seeking after image-based sexual harassment and abuse victimization,” Comput Human Behav, vol. 158, Sep. 2024, https://doi.org//10.1016/j.chb.2024.108312.
[7] I. Dogaru, A. Furnham, and A. McClelland, “Understanding how the presence of music in advertisements influences consumer behaviour,” Acta Psychol (Amst), vol. 248, Aug. 2024, https://doi.org//10.1016/j.actpsy.2024.104333.
[8] N. Kuratomo, H. Miyakawa, S. Masuko, T. Yamanaka, and K. Zempo, “Effects of acoustic comfort and advertisement recallability on digital signage with on-demand pinpoint audio system,” Applied Acoustics, vol. 184, Dec. 2021, https://doi.org//10.1016/j.apacoust.2021.108359.
[9] F. Du, H. Yue, and J. Zhang, “Influence of advertisement control to residential energy savings in large networks,” Appl Energy, vol. 333, Mar. 2023, https://doi.org//10.1016/j.apenergy.2023.120661.
[10] M. Aljabri and R. M. A. Mohammad, “Click fraud detection for online advertising using machine learning,” Egyptian Informatics Journal, vol. 24, no. 2, pp. 341–350, Jul. 2023, https://doi.org//10.1016/j.eij.2023.05.006.
[11] Y. Xu, D. He, and M. Fan, “Antecedent research on cross-border E-commerce consumer purchase decision-making: The moderating role of platform-recommended advertisement characteristics,” Heliyon, vol. 10, no. 18, Sep. 2024, https://doi.org//10.1016/j.heliyon.2024.e37627.
[12] M. V. Ferrari, “The platformisation of digital payments: The fabrication of consumer interest in the EU FinTech agenda,” Computer Law and Security Review, vol. 45, Jul. 2022, https://doi.org//10.1016/j.clsr.2022.105687.
[13] F. Liébana-Cabanillas, Z. Kalinic, F. Muñoz-Leiva, and E. Higueras-Castillo, “Biometric m-payment systems: A multi-analytical approach to determining use intention,” Information and Management, vol. 61, no. 2, Mar. 2024, https://doi.org//10.1016/j.im.2023.103907.
[14] R. Rian Putra, N. A. Putri, C. Wadisman, and P. Pancabudi, “Village Fund Allocation Information System For Community Empowerment In Klambir Lima Kebun Village,” J. Appl, vol. 3, no. 2, pp. 98-104, 2022, https://doi.org//doi.org/10.37385/jaets.v3i2.681.
[15] M. Tito Ramadhan, Y. Gunawan, K. Manaf, H. Purwanto, R. S. Perdana, and B. Subaeki, “Testing the Autxhentication Platform System Using the Mccall Model,” CoreID Journal, vol. 2, no. 1, pp. 20–26, Mar. 2024, https://doi.org//10.60005/coreid.v2i1.26.
[16] S. Budi, W. Gata, M. Noor, S. Pangabean, and C. Sri Rahayu, “News Portal Website Measurement Analysis Using Iso/Iec 25010 And Mccall Methods,” J. Appl. Eng. Technol. Sci, vol. 4, no. 1, pp. 273-285. Oct. 2022, https://doi.org//10.37385/jaets.v4i1.1094.
[17] F. P. Juniawan et al., “E-Voting Software Quality Analysis with McCall’s Method,” in 8th International Conference on Cyber and IT Service Management, CITSM, pp. 1-5, Oct. 2020. https://doi.org//10.1109/CITSM50537.2020.9268854.
[18] Y. Chinchay, J. Gomez, and G. Montoro, “Unlocking inclusive education: A quality assessment of software design in applications for children with autism,” Journal of Systems and Software, vol. 217, Nov. 2024, https://doi.org//10.1016/j.jss.2024.112164.
[19] A. A. Zulfahmi, R. Sadikin, and E. H. Hermaliani, “Hybrid Between Pieces Framework And Technology Acceptance Model (Tam) In Quality Testing Of Mobile Application Office Automation System (Kemenkeu),” J. Appl. Eng. Technol. Sci. vol. 4, no. 1, pp. 286-306, Oct. 2022, https://doi.org//10.37385/jaets.v4i1.1087.
[20] D. M. Dyah, J. Karaman, and A. F. Cobantoro, “Analysis of A Pieces Framework of A Localhost Web-Based Income Statement EPOSAL Application,” INTENSIF: Jurnal Ilmiah Penelitian dan Penerapan Teknologi Sistem Informasi, vol. 6, no. 2, pp. 271–284, Aug. 2022, https://doi.org//10.29407/intensif.v6i2.17465.
[21] N. A. Pratiwi, A. Triayudi, E. Tri, and E. Handayani, “Analysis And Design Of Mobile Web-Based Menu E-Order Systems Using The Pieces Method (Case Study: Café 50/50 Coffee),” Jurnal Riset Informatika, vol. 4, no. 1, 2021, https://doi.org//10.34288/jri.v4i1.134.
[22] A. Fatoni, K. Adi, and A. P. Widodo, “PIECES Framework and Importance Performance Analysis Method to Evaluate the Implementation of Information Systems,” in E3S Web of Conferences, vol. 202, p. 15007, Nov. 2020. https://doi.org//10.1051/e3sconf/202020215007.
[23] S. Ramadhani, N. Eltivia, and N. I. Riwajanti, “Analysis of User Needs in Designing Boarding House Accounting Information Systems Using the PIECES Framework,” Jurnal Ekonomi dan Bisnis Digital, vol. 3, no. 2, pp. 1–14, Apr. 2024, https://doi.org//10.55927/ministal.v3i2.8982.
[24] E. J. Muflihanto and K. D. Hartomo, “Implementation of the PIECES Framework as an Evaluation of Student Satisfaction Levels with the Use of STARS UKSW,” Journal of Information Systems and Informatics, vol. 6, no. 2, pp. 797–809, Jun. 2024, https://doi.org//10.51519/journalisi.v6i2.726.
[25] J. K. Mulia and R. Sutomo, “Evaluation Of The Quality Of The Online Sales Application Of Light Steel Material Using The Mccall Quality Factors Method,” International Journal of Science, Technology & Management, vol. 4, no. 5, pp. 1244-1250, Sep. 2023, https://doi.org//https://doi.org/10.46729/ijstm.v4i5.930.
[26] S. Andini, H. Marfalino, and R. L. Gema, “Measurement Of Inlis Application Quality Using Mccall Method,” Research of Applied Science and Education V15.i2, 2021, https://doi.org//10.22216/jit.v15i2.346.
[27] E. Tusliyanti and F. Wibowo, “Software Testing Based on McCall’s Quality Theory on Academic Information System Study Plan Cards, University of Muhammadiyah Purwokerto,” Jurnal Inovatif : Inovasi Teknologi Informasi dan Informatika, vol. 5, no. 1, pp. 7–21, 2022, https://doi.org//10.32832/inovatif.
[28] S. Bernardo et al., “Software Quality Assurance as a Service: Encompassing the quality assessment of software and services,” Future Generation Computer Systems, vol. 156, pp. 254–268, Jul. 2024, https://doi.org//10.1016/j.future.2024.03.024.
[29] N. Doorn, T. E. J. Vos, and B. Marín, “Towards understanding students’ sensemaking of test case design,” Data Knowl Eng, vol. 146, Jul. 2023, https://doi.org//10.1016/j.datak.2023.102199.
[30] L. Giamattei, A. Guerriero, R. Pietrantuono, and S. Russo, “Causal reasoning in Software Quality Assurance: A systematic review,” Inf Softw Technol, p. 107599, Oct. 2024, https://doi.org//10.1016/j.infsof.2024.107599.
[31] J. D. Saborido-Moral et al., “Free automatic software for quality assurance of computed tomography calibration, edges and radiomics metrics reproducibility,” Physica Medica, vol. 114, Oct. 2023, https://doi.org//10.1016/j.ejmp.2023.103153.
[32] R. Yang and H. Yagi, “Evaluating occupational values in Japan’s urban farming: A comparison between the Likert scale and Best-Worst Scaling methods,” Cities, vol. 155, Dec. 2024, https://doi.org//10.1016/j.cities.2024.105485.
[33] C. Cheng, K. L. Lay, Y. F. Hsu, and Y. M. Tsai, “Can Likert scales predict choices? Testing the congruence between using Likert scale and comparative judgment on measuring attribution,” Methods in Psychology, vol. 5, Dec. 2021, https://doi.org//10.1016/j.metip.2021.100081.
[34] A. Hatia et al., “Accuracy and Completeness of ChatGPT-Generated Information on Interceptive Orthodontics: A Multicenter Collaborative Study,” J Clin Med, vol. 13, no. 3, Feb. 2024, https://doi.org//10.3390/jcm13030735.
[35] N. S. Mahmood et al., “Modeling energy management sustainability: Smart integrated framework for future trends,” Energy Reports, vol. 8, pp. 8027–8045, Nov. 2022, https://doi.org//10.1016/j.egyr.2022.06.023.
[36] R. D. Sugiarta, F. Arofiati, and E. M. Rosa, “Validity and Reliability of Research Instruments on the Effect of Motivation on Nurse Performance in Moderation with Nurse Credentials,” JMMR (Jurnal Medicoeticolegal dan Manajemen Rumah Sakit), vol. 12, no. 1, Apr. 2023, https://doi.org//10.18196/jmmr.v12i1.6.
[37] I. P. A. E. Y. Cipta, M. W. A. Kesiman, and I. G. A. Gunadi, “Analysis of User Satisfaction with E-Learning Services During the Covid-19 Pandemic Using the PIECES Framework,” Journal of Computer Networks, Architecture and High Performance Computing, vol. 5, no. 2, pp. 579–589, Jul. 2023, https://doi.org//10.47709/cnahpc.v5i2.2557.
[38] L. Sürücü and A. Maslakçi, “Validity And Reliability In Quantitative Research,” Business & Management Studies: An International Journal, vol. 8, no. 3, pp. 2694–2726, Sep. 2020, https://doi.org//10.15295/bmij.v8i3.1540.
[39] D. M. Bond, J. Hammond, A. W. Shand, and N. Nassar, “Comparing a mobile phone automated system with a paper and email data collection system: Substudy within a randomized controlled trial,” JMIR Mhealth Uhealth, vol. 8, no. 8, Aug. 2020, https://doi.org//10.2196/15284.
[40] P. V. Munuera-Martínez, P. Távara-Vidalón, M. A. Monge-Vera, A. Sáez-Díaz, and G. Lafuente-Sotillos, “The validity and reliability of a new simple instrument for the measurement of first ray mobility,” Sensors (Switzerland), vol. 20, no. 8, Apr. 2020, https://doi.org//10.3390/s20082207.
[41] A. Martalisa, S. Wahyu Saputro, D. Turianto Nugrahadi, F. Abadi, and I. Budiman, “Evaluation of User Experience in the Banjarbaru Disdukcapil Public Service Application Using User Experience Questionnaire and System Usability Scale,” Scientific Journal of Informatics, vol. 11, no. 4, pp. 925–936, Dec. 2024, https://doi.org//10.15294/sji.v11i4.13780.
[42] A. Bayındır-Gümüş, E. Öztürk, and M. Soós, “Adaptation Of The Scale Of Effects Of Social Media On Eating Behavior In Hungarian University Students,” Roczniki Panstwowego Zakladu Higieny / Annals of the National Institute of Hygiene, vol. 75, no. 1, pp. 59–65, 2024, https://doi.org//10.32394/rpzh.2024.0295.
[43] J. Rahmadoni, R. Akbar, and R. Ulya, “Analysis Of Nagari Management Information System Evaluation (Simnag) Using Pieces And Uat Methods,” Dec. 2022. https://doi.org//10.37385/jaets.v4i1.1326.
[44] S. Yadav, “Analysis and Assessment of Existing Software Quality Models to Predict the Reliability of Component-Based Software,” International Journal of Emerging Trends in Engineering Research, vol. 8, no. 6, pp. 2824–2840, Jun. 2020, https://doi.org//10.30534/ijeter/2020/96862020.
[45] U. Nugraha, I. Rijayana, Murnawan, R. A. E. V. T. Sapanji, R. Samihardjo, and S. Lestari, “Analysis with the Pieces Framework in the Xyz Village Service Information System,” Review of International Geographical Education Online, vol. 11, no. 6, pp. 132–137, 2021, https://doi.org//10.48047/rigeo.11.06.16.
[46] S. Ariyani, M. Sudarma, and P. A. Wicaksana, “Analysis of Functional Suitability and Usability in Sales Order Procedure to Determine Management Information System Quality,” INTENSIF: Jurnal Ilmiah Penelitian dan Penerapan Teknologi Sistem Informasi, vol. 5, no. 2, pp. 234–248, Aug. 2021, https://doi.org//10.29407/intensif.v5i2.15537.
[47] N. Doğan, C. GündeğeR, and M. Yurtçu, “Examining the Effect of Differently Labeled Likert-Type Scales on Measurement Invariance,” Ankara University Journal of Faculty of Educational Sciences, Jul. 2023, https://doi.org//10.30964/auebfd.1280498.
[48] H. Lee, S. Lee, C. Kim, and K. Jeon, “A Comparison of Contractile Properties and Acute Muscle Fatigue Response in Adult Females with Non-Specific Chronic Low Back Pain,” Bioengineering, vol. 11, no. 12, Dec. 2024, https://doi.org//10.3390/bioengineering11121202.
[49] J. Thimmapuram et al., “Effect of heartfulness meditation on mental health, gene expression, and functional MRI of the brain,” 2024, London, UK. https://doi.org//10.1186/ISRCTN82860715.
[50] X. Yan, X.-H. Zhou, and T.-H. Kim, “The Effects of a Complex Shoulder Exercise Program with Respiratory Training on Muscle Activity and Posture in Individuals Exhibiting Scapular Internal Rotation,” Applied Sciences, vol. 15, no. 1, p. 313, Dec. 2024, https://doi.org//10.3390/app15010313.
[51] K. Draper et al., “Identification of Inflammatory Biomarkers for Predicting Peripheral Arterial Disease Prognosis in Patients with Diabetes,” Diabetology, vol. 6, no. 1, p. 2, Dec. 2024, https://doi.org//10.3390/diabetology6010002.
[52] D. S. Perdana and L. Y. Banowosari, “Evaluating the Bibit App: The HEART Framework Approach in UX Design,” Jurnal RESTI (Rekayasa Sistem dan Teknologi Informasi), vol. 8, no. 2, pp. 250–257, Apr. 2024, https://doi.org//10.29207/resti.v8i2.5714.
[53] S. Andishe, M. J. Jafari, F. F. Ramandi, S. Khodakarim, and A. Salehi, “Psychometrics of Questionnaires Designed for the Evaluation of Safety Levels and Safety Culture Case Study: Power Plant Generator Manufacturing Company,” International Journal of Occupational Hygiene, vol. 13, no. 4, pp. 337-346, Jan. 2022, https://doi.org//10.18502/ijoh.v13i4.8428.
[54] H. Desky, B. Thaver, and S. Rijal, “Analysis of Tourist Satisfaction with Halal Tourism in Aceh,” Indonesian Journal of Halal Research, vol. 4, no. 1, pp. 1–8, Feb. 2022, https://doi.org//10.15575/ijhar.v4i1.14479.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Muhammad Nazar Gunawan, Friska Abadi, Dodon Turianto Nugrahadi, Irwan Budiman, Setyo Wahyu Saputro
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Authors who publish with JITEKI agree to the following terms:
- Authors retain copyright and grant the journal the right of first publication with the work simultaneously licensed under a Creative Commons Attribution License (CC BY-SA 4.0) that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work.
This work is licensed under a Creative Commons Attribution 4.0 International License
