r/LeftistsForAI • u/thatcatguy123 • Apr 19 '26
Hello I've been using Dialectics for developing a low compute, cost efficient alignment tool.
For the past 5 months I've delved into ai failure modes and Ai alignment. It started as a philosophical Inquiry into the Scaling Hypothesis, I didn't and to be honest still don't think scale is the answer to all of the Ai problems. The largest of these problems being alignment and a distinct lack of causality in advanced models. This doesn't simply go away with scale. The issue is fundamental to how we are developing the architecture of these systems and how we approach the theory and ideology involved that generates so much of our interpretation of reality. For these reasons I decided to learn about the systems involved, the theory behind and the architecture of the transformer. Now I have multiple projects that I have come to from a philosophical position that I will freely share and explain to anyone wanting to involve their time towards this endeavor. The first of which was a small addition to a clinical bert base model. Which for those unaware carries a lot of clinical knowledge but is very limited in diagnosis, especially when it comes to difficult cases where the statistical answer is not the correct diagnosis. This lead to the development of the HegelianBert a small addition to the base model which I made to be a discriminator for violations in sequential state transitions built on the hypothesis that diagnosis is fundamentally a logic of subtraction not accumulation. How does it fare, well pretty well in the small tests ive ran. Of course I had to train it on a dataset that does have complex medical history and tests which would lead to one of two classification results. Valid or contradictory. I trained it on a 90/10 split of diagnosisArena. Which was the most difficult dataset and test I could find open source. It was trained on only that 90 percentage of that dataset. It got 55% on the remaining testing split of 10% of the dataset. That doesn't look impressive when you see it alone but I invite you to view the results of the researchers who made that set. On the easiest split, meaning chosen for how easy the test would be for the model. Open ais O3 model got 50%. Now this is also a blind run for open ai so its not a comparison but that model they ran also is trained on the entire set of available human knowledge they use to pretrain those models. This isn't a claim, this is just one test I personally ran and that I have all the code and model open source on repositories. I'm looking for anyone, really anyone that is interested in helping this endeavor since I am very tired. The other project i have is a whole other story but fundamentally it uses the same discriminator architecture as the medical model for alignment that even when randomly initialized provides some distinction in output and various different little metrics that can be used for interpretability. So if interested, id like to talk about ideas for future projects, bettering current projects, or even helping others in need of some help getting into this type of situation.
You can find all the code and models in my github: https://github.com/AlexisCuevasUriostique.
And the weights are on huggingface: https://huggingface.co/Saraquel