Hugging Face's logo
AbstractPhila's picture
🤝 Open to Collab

AbstractPhila PRO

AbstractPhil
AbstractPowered
19 6 28
otterpupp's profile picture wnjai's profile picture mike-ravkine's profile picture
·
https://civitai.com/user/AbstractPhila

AI & ML interests

datasets, research papers, experimentation, vision, classification, text encoders, tokenization, llms, diffusion, distillation, and more.

Recent Activity

repliedto their post about 11 hours ago
After a week of failures and invalid hypothesis with bytelex using generic structures, I found a highly successful aleph prototypical structure that conforms to the needs. This structure conforms to standard transformer, FFN, and RNN with some minor tweaks. https://huggingface.co/AbstractPhil/alephllm-mini-beatrix-training/tree/main/mini-beatrix-2s/arms/btx_e003 All the weights of the week are stored here and in various nearby directories. * We've managed to overlap multiple arms to train multiple simultaneous templates. * Introduce new tokens as composite tokens from multiple teachers. * Retrain existing tokens into the behavior of one teacher or another. * Extend new chains and new behaviors from training in combination. * Properly instantiate and reinforce behavior using Aleph RNN to reinforce training from raw data. The EMA Relay. The code has been pushed to both beatrix repos. https://huggingface.co/AbstractPhil/mini-beatrix-2s/blob/main/relay.py The structure itself is built specifically as a solidification unit to extensible arms, allowing more composite structures to build. EMA structures aren't new, but when applied correctly at just such a methodology, the models begin to behave as though the extension relays are in fact the original model. The chains and behavior form naturally and the substructure begins to conform with the token fragments from much more complex structures like combined token differences of T5, Qwen, and CLIP as unified teachers. The cross-token noise is mitigated using a series of principles and the blueprints are showing both solidity and failure simultaneously, both proving many new utilizable states and disproving multiple theoretical pathologies utilized in current running modern papers as the methodologies tested in the specific formats. The next article will be fully dedicated to the week of failures leading to the first successes, so stay tuned.
updated a model about 16 hours ago
AbstractPhil/alephllm-mini-beatrix-training
updated a model about 18 hours ago
AbstractPhil/geolip-bytelex
View all activity

Organizations

DeepGHS's profile picture Blog-explorers's profile picture BangumiBase's profile picture Abstract Powered Research's profile picture