Hugging Face's logo
Pankaj Singh's picture
🔄 In a Training Loop

Pankaj Singh

Pankaj8922
15 4 33
kaushik-harsh-99's profile picture MaxNpl's profile picture webbrain-one-644557's profile picture
·

AI & ML interests

Datasets

Recent Activity

updated a model 6 days ago
Pankaj8922/experiment
published a model 6 days ago
Pankaj8922/experiment
repliedto Hoglet-33's post 2 months ago
Today, we planned to release Pebble-50M and Pebble-50M-Chat to the world. Unfortunately, due to a few issues, that didn't go quite as planned. What happened: - Some data and benchmark results were lost or corrupted - The models performed worse on benchmarks than our other Pebble models Despite that, you can still find both models here: Pebble-50M-beta: https://huggingface.co/basically-experimental/Pebble-50M-beta Pebble-50M-Chat-beta: https://huggingface.co/basically-experimental/Pebble-50M-Chat-beta There are still some interesting improvements in these models: - Compatible with non-CUDA devices - Vocabulary increased to 16K tokens - Context length increased to 16K tokens For now, there won't be any more Pebble releases for a while. We're going to take some time to experiment with other approaches and hopefully make the next generation a monumental leap over this one. Follow for updates: @Hoglet-33 https://huggingface.co/basically-ai https://huggingface.co/basically-experimental
View all activity

Organizations

Small Scale's profile picture Just Better's profile picture