Skip to content

Commit

Permalink
Remove unused variables
Browse files Browse the repository at this point in the history
  • Loading branch information
certik committed Mar 21, 2023
1 parent 8f4165e commit 372963d
Showing 1 changed file with 0 additions and 1 deletion.
1 change: 0 additions & 1 deletion tokenizer.f90
Original file line number Diff line number Diff line change
Expand Up @@ -151,7 151,6 @@ function bpe(token, vocab_idx, vocab_txt) result(tokens)
type(string), allocatable :: tokens(:)
integer, allocatable :: pair_scores(:)
integer :: not_found, merge_pair_idx
type(string) :: s, s2
integer :: i
not_found = size(vocab_idx) 10
allocate(tokens(len(token)))
Expand Down

0 comments on commit 372963d

Please sign in to comment.