Join the conversation

Join the community of Machine Learners and AI enthusiasts.

Sign Up
Banaxi-Tech 
posted an update 1 day ago
Post
2442
We're going to release our BananaMind 2.1 models very soon!
We're also announcing 2 new models.

All of our models we will train are:
BananaMind 2.1 Flash Lite, 10M parameters with 8M in transformer and 2M in n-gram. 50B pretraining tokens.
BananaMind 2.1 Lite with 25M parameters, 5M in n-gram and 20M in transformer. 75B pretraining tokens.
BananaMind 2.1 Flash with 50M parameters, with undecided n-gram count yet. 100B pretraining tokens.
BananaMind 2.1 Pro with 145M parameters, with undecided n-gram count yet. 150-200B pretraining tokens.
BananaMind 2.1 Coder with 149M parameters with undecided n-gram count yet.
We're now announcing BananaMind 2.1 NanoCoder, a 10M parameter model focused specifically on coding and BananaMind 2.1 MiniCoder which is a 25M parameter model focused on coding.


Follow us:
BananaMind

@Banaxi-Tech
@vovaRL
@DedeProGames
bananamind-research-community

@Banaxi-Tech is Luna Labs your new thing?

·

in like 2 years maybe but right now no

It's great to see further adoption of n-gram! I think it really helps a lot.