batch_size,num_tokens,varlen
1,4096,False
1,8192,False
1,16384,False
1,32768,False