Article
Geometric Manifold Walking: Stable High-Accuracy Multi-Encoder Fusion Without Backbone Training
•
3
AbstractPhila PRO
AbstractPhil
AI & ML interests
datasets, research papers, experimentation, vision, classification, text encoders, tokenization, llms, diffusion, distillation, and more.
Recent Activity
updated
a model
about 9 hours ago
AbstractPhil/tiny-flux-deep
updated
a dataset
about 17 hours ago
AbstractPhil/synthetic-characters
replied to
their
post
about 23 hours ago
https://huggingface.co/AbstractPhil/tinyflux-experts
Introducing the "blot" expert, sd15-flow-sol. The twin sister flow-matching experts for tinyflux-lailah; sd15-flow-lune AND sd15-flow-sol will be used in tandem to train tinyflux-Lailah. sd15-flow-sol never managed to reach full flow-matching prediction, so epsilon vpred conversion is required. All experts will exist within the tinyflux-experts repo, including all the critical checkpoint sets.
Lune was heavily finetuned in the sd3-style and adapted shift timestep system after David's interpolation converted sd15 into geometric basis.
Sol was left abandoned after 50 epochs with David and was considered overcooked and rigid, until I noticed the geometric structure today. Lune doesn't produce geometric structure as solid as Sol, not even close. Lune produces improved fidelity and detail, but Sol produces something very very different, aligned to sd15's behavior, and fully representative of the 5point 4simplex structure that David brought to the table.
Sol is essentially a nearly perfect blob-forming geometric blotter. Sol is SD15, and yet SOL was trained using a specific pattern recognizing and timestep aligned David model. David was tasked with classifying timesteps and patterns using complex deep-recognition structural analysis layer-by-layer, determining full-scale opinions after watching the entirety of sd15's structure during training.
Even though the sd15-flow-sol was left abandoned, the structure of Sol is HIGHLY effective at understanding TIMESTEP blotting interpolation. I didn't realize how crucially important this was until Lailah started to show rigidity and compartmentalized behavior with sequence - which likely happens to ALL flow matching models.
https://huggingface.co/AbstractPhil/sd15-flow-matching/blob/main/sd15_flowmatch_david_weighted_efinal.pt
https://huggingface.co/AbstractPhil/geo-david-collective-sd15-distilled
https://huggingface.co/AbstractPhil/geo-david-collective-sd15-base-e40
Organizations
published
an
article
about 1 month ago
published
an
article
4 months ago
Article
Moving foward with fixated vocabularies aimed at general, symbolic, and medical.
published
an
article
5 months ago
Article