Skip to content
Snippets Groups Projects

Repository graph

You can move around the graph by using the arrow keys.
Select Git revision
  • adapt_model
  • evaluation
  • main default protected
  • model
  • slides
  • training
6 results
Created with Raphaël 2.2.019Dec181715121110223Nov15109Add train impl to slidesslidesslidesUpdate slides title and ToCUpdate model diagramAdd slideshowAdd gitignoremainmainfix(adapt_model): changed batch sizeadapt_modeladapt_modelfix(adapt_model): changes to paramsfix(adapt_model): changed pathfix(adapt_model): added pos to evaluatedebug: add mask and debug dim probAdd slidev sample slideshowfix(adapt_model): fixed issue with pos_indicesfeat(adapt_model): new potential model architecturemodif: save model with name of run in itmodif: change sequence size to reduce training timeadd + modif: add generate files + modif model because of low perfdebugadd entity wandbadd num_layersmodif traning and add scriptMerge branch 'evaluation' of gitlab.unige.ch:Malik.Algelly1/large-small-language-modelmerge(training->main)update evaluation.pyevaluationevaluationfeat(training): made changes to the model, dataset loading and the training loop. Added code for future validation and masking in model.pytrainingtrainingRevert "Add basic model"Add basic modelmodelmodeladd: architecture of the projectcreate: dataset class for tokenizationmodif readme fileadd initial filesInitial commit