Analysis of the Effectiveness of Manual Deployment and CI/CD Github Actions in the Braisee Application

Nenda Alfadil Seputra; Odi Nurdiawan; Arif Rinaldi Dikananda; Denni Pratama; Dian Ade Kurnia

doi:10.59934/jaiea.v5i2.1916

Authors

Nenda Alfadil Seputra STMIK IKMI Cirebon
Odi Nurdiawan STMIK IKMI CIREBON
Arif Rinaldi Dikananda STMIK IKMI CIREBON
Denni Pratama STMIK IKMI CIREBON
Dian Ade Kurnia STMIK IKMI CIREBON

DOI:

https://doi.org/10.59934/jaiea.v5i2.1916

Keywords:

CI/CD, Github Action, Deployment, Cloud Run, efficiency

Abstract

In the modern cloud-based software development ecosystem, the speed and reliability of the deployment process are critical elements. This study aims to evaluate the effectiveness of implementing Continuous Integration/Continuous Deployment (CI/CD) using GitHub Actions compared to manual methods for the machine learning API of the Braisee application hosted on Google Cloud Run. Using a quantitative approach with a comparative experimental design across ten testing iterations, this research measures deployment time efficiency, error rates, and system stability. The experimental results show a significant performance disparity, where the automated method based on GitHub Actions is considerably more efficient, with an average total duration of 111–167 seconds, reducing operational time by 40–60% compared to the manual method, which requires 297–364 seconds. In terms of reliability, the automated method achieves a 100% success rate with high consistency, whereas the manual method demonstrates substantial vulnerability to human errors such as mistyped project IDs and inconsistent image tagging. It is concluded that implementing CI/CD through GitHub Actions is a superior solution that improves time efficiency and ensures the stability of cloud-based applications compared to manual procedures.

Downloads

Download data is not yet available.

References

I.-C. Donca, M. Misaros, D. Gota, and L. Miclea, “Method for continuous integration and deployment using a pipeline generator for Agile software projects,” Sensors, vol. 22, no. 12, p. 4637, 2022, doi: 10.3390/s22124637.

B. Erdenebat, B. Bud, T. Batsuren, and T. Kozsik, “Multi-project multi-environment approach—An enhancement to existing DevOps and CI/CD tools,” Computers, vol. 12, no. 12, p. 254, 2023, doi: 10.3390/computers12120254.

J. Dobaj, A. Riel, G. Macher, and M. Egretzberger, “Towards DevOps for cyber-physical systems facilitated by digital twins,” Machines, vol. 11, no. 10, p. 973, 2023, doi: 10.3390/machines11100973.

L.-N. Lévy, J. Bosom, G. Guerard, S. B. Amor, M. Bui, and H. Tran, “DevOps model approach for monitoring smart energy systems,” Energies, vol. 15, no. 15, p. 5516, 2022, doi: 10.3390/en15155516.

J. Lin, D. Xie, J. Huang, Z. Liao, and L. Ye, “A multi-dimensional extensible cloud-native service stack for enterprises,” J. Cloud Comput., vol. 11, p. 83, 2022, doi: 10.1186/s13677-022-00366-7.

A. D. Setyoko and A. Zahra, “Perbandingan efisiensi proses CI/CD multi-lingkungan melalui implementasi paralel dan berurutan,” MALCOM Indones. J. Mach. Learn. Comput. Sci., vol. 4, no. 3, pp. 911–925, 2024.

A. M. Buttar, “Optimization of DevOps transformation for cloud-based applications,” Electronics, vol. 12, no. 2, p. 357, 2023, doi: 10.3390/electronics12020357.

M. Wessel, J. Vargovich, M. A. Gerosa, and C. Treude, “GitHub Actions: The impact on the pull request process,” Empir. Softw. Eng., vol. 28, p. 131, 2023, doi: 10.1007/s10664-023-10369-w.

R. Bagai, A. Masrani, P. Ranjan, and M. Najana, “Implementing continuous integration and deployment (CI/CD) for machine learning models on AWS,” Int. J. Glob. Innov. Solut., 2024.

A. Farid and I. Gita Anugrah, “Implementasi CI/CD pipeline pada framework Androbase menggunakan Jenkins (studi kasus: PT. Andromedia),” J. Nas. Komputasi dan Teknol. Inf., vol. 4, no. 6, 2021.

R. Setiabudi, “Analisis efektivitas CI/CD dan manual (tradisional) dalam pengembangan website Rakyatweb.com,” ISMETEK, vol. 17, no. 2, 2024.