Reproducibility assessment of research code repositories
tarafından
 
Akdeniz, Eyüp Kaan, author.

Başlık
Reproducibility assessment of research code repositories

Yazar
Akdeniz, Eyüp Kaan, author.

Yazar Ek Girişi
Akdeniz, Eyüp Kaan, author.

Fiziksel Tanımlama
x, 59 leaves: + 1 computer laser optical disc.

Özet
The growth in machine learning research has not been accompanied by a corresponding improvement in the reproducibility of the results. This thesis presents a novel, fully-automated end-to-end system that evaluates the reproducibility of machine learning studies based on the content of the associated GitHub project’s Readme fle. This evaluation relies on a readme template derived from an analysis of popular repositories. The template suggests a structure that promotes reproducibility. Our system generates a reproducibility score for each Readme fle assessed, and it employs two distinct models, one based on section classifcation and the other on hierarchical transformers. The experimental outcomes indicate that the system based on section similarity outperforms the hierarchical transformer model. Furthermore, it has a superior edge concerning explainability, as it allows for a direct correlation of the scores with the respective sections of the Readme fles. The proposed framework provides an important tool for improving the quality of code sharing and ultimately helps to increase reproducibility in machine learning research.

Konu Başlığı
Natural language processing (Computer science)

Yazar Ek Girişi
Tekir, Selma,

Tüzel Kişi Ek Girişi
İzmir Institute of Technology. Computer Engineering.

Tek Biçim Eser Adı
Thesis (Master)--İzmir Institute of Technology:Computer Engineering.
 
İzmir Institute of Technology: Computer Engineering--Thesis (Master).

Elektronik Erişim
Access to Electronic Versiyon.


LibraryMateryal TürüDemirbaş NumarasıYer NumarasıDurumu/İade Tarihi
IYTE LibraryTezT002758QA76.9.N38 A31 2023Tez Koleksiyonu