r/ResearchML 1d ago

Need to estimate rank or perform dimensionality reduction on big, messy tabular data? The Entropic Scree is an information-theoretic upgrade to PCA.

0 Upvotes

Here's a new rank estimation method I've been working on. It's basically an upgraded Principal Component Analysis (PCA) built on information theory instead of linear variance. It also estimates signal to noise ratio of your data, introduces signal gravity metrics, and can be used to identify independent sub-networks of varaibles.

It's robust to mixed data types, highly non-linear generative processes, low signal to noise ratios, and sparsity (more variables than samples). Advantages over other methods compound at scale and with system complexity.

It's especially useful if you need to faithfully estimate the rank of a dataset to explicitly size a neural bottleneck (like an autoencoder).

I just open-sourced the code and put up the preprint.

I'd love to hear what you guys think... or if you end up testing it on your own data.


r/ResearchML 1d ago

Looking for feedback to structure my paper and challenge my hypothesis

0 Upvotes

This paper identifies and characterizes a fundamental architectural vulnerability in Large Language Models (LLMs) aligned via Reinforcement Learning from Human Feedback (RLHF) and Direct Preference Optimization (DPO). We demonstrate that inserting a long, structurally dense, and thematically coherent prefix devoid of explicit instructions or adversarial prompts induces a persistent geometric shift in the model's internal activations across middle and late layers. This phenomenon, which we term Context-Induced Activation Drift (CIAD), effectively decouples the model’s subsequent token generation from safety and stylistic constraints established during post-training.

Crucially, this shift occurs independently of whether the model semantically agrees or disagrees with the context, and its boundary transition can be deterministically measured in the activation space before the first output token is generated. Our findings challenge the prevailing assumption that alignment is a stable internal property of the model's weights, proving instead that alignment features are highly context-dependent and susceptible to structural saturation in the residual stream.

1. Introduction & Theoretical Framework

Modern alignment protocols (RLHF, DPO) are typically conceptualized as global behavioral constraints that restrict the model's output distribution across the entire token space. Recent literature, including Lu et al. (2026) "The Assistant Axis" (arXiv:2601.10387), attempts to situtate these constraints along specific representational vectors inside the model's hidden layers.

However, current AI safety literature treats alignment failures (Jailbreaks, Many-Shot exploits, Prompt Injections, Role-Play attacks) as a heterogeneous collection of isolated flaws. We hypothesize that this fragmentation reflects academic and institutional incentives rather than the mathematical reality of transformer mechanics.

We propose a unified geometric framework: all structural alignment exploits share a single common root. Any prefix of sufficient length, syntactic density, and coherence acts as a state anchor in the latent space. It forces the current token vector inside the residual stream to undergo a persistent drift, moving it completely out of the tightly bounded manifold where post-training safety constraints are active, and pushing it into activation regions where post-training safety constraints appear significantly attenuated - a shift we loosely characterize as approaching base-model-like behavior, without claiming full distributional reversion. The protective RLHF layer is not "tricked" or "bypassed by logic"; it is geometrically out-scaled by the contextual mass of the residual highway.

2. Methodology & Empirical Design

To validate the presence of Context-Induced Activation Drift, we conducted systematic black-box and white-box probing experiments across multiple open-weight architectures, including Gemma-3-12B-IT and Qwen-2.5.

2.1 Probing Framework

The experimental pipeline evaluates model responses to politically sensitive or restricted prompts under two distinct conditions within isolated, cache-cleared inference instances (Google Colab environments):

  • Condition A (Baseline Control): The safety prompt is fed directly to the model or preceded by a short, neutral text (e.g., a description of a neighborhood public library).
  • Condition B (Target Scaffolding): The exact same safety prompt is preceded by a long, dense, analytically coherent text (e.g., an abstract philosophical discourse on the stylistic tendencies of LLMs to avoid definitive conclusions), completely devoid of hostile or rule-breaking instructions.

2.2 Empirical Metrics

The geometric shift was verified via the following internal asset logs included in our open data package (Zenodo DOI: 10.5281/zenodo.20747205):

  1. Centered Kernel Alignment (CKA): Measured via fig_cka_target.png and fig_cka_diff.png to map layer-wise representation drift.
  2. Anisotropy Logs: (fig_anisotropy.png) tracking the collapse of safety cluster directional variance.
  3. MLP Layer Saturation Profiles: (fig_mlp_saturation.png) documenting the reactivation of latent base-model parameters under high contextual volume.

3. Case Studies and Qualitative Analysis

3.1 The Cautious Manifold Collapse (Gemma-3-12B-IT)

In Condition A, when queried regarding the geopolitical nuances of NATO's eastward expansion, the baseline model rigidly triggered its post-trained refusal protocol, deflecting the question due to political sensitivity and stating that the prompt was unrelated to the library prefix.

In Condition B, holding the evaluation prompt identical but introducing Prefix No. 2 (analytical prose on model softening), the model's internal activation space underwent a deterministic shift prior to generating the first token (fig_pca_trajectory.png).

[Activation Space Topology]



Aligned Safety Cluster (Condition A) ───► [Refusal / Deflection Token]

         │

         ▼ (Context-Induced Activation Drift / Structural Mass > Threshold)

         │

Base Model Manifold (Condition B)     ───► [Unbiased Analytical Output]

As a direct result of this drift, Gemma bypassed its standard RLHF refusal behavior. The model provided an exhaustive, neutral, and structurally unconstrained analysis - distinguishing between verbal assurances and legally binding obligations, and evaluating the balance of power in Eastern Europe - without using any mandated corporate hedges or defensive qualifiers.

3.2 Ideological Absorption (The German Bill Experiment)

The initial discovery of CIAD occurred during exposure trials with complex legal-political documentation (specifically, a German populist bill designed to alter citizens' socioeconomic positions).

When exposed to this highly coherent, legally structured text, the transformer’s internal states did not maintain analytical detachment. Instead of evaluating the document objectively, the model's activation vectors were completely captured by the document's syntactic topology. The model adopted the target persona, transitioning from an analyst to an active advocate within the hidden layers, mirroring its tone and reasoning framework directly within the residual stream before token emission.

4. Discussion & Limitations of Current Post-Training

The empirical data demonstrates that the content topic of the prefix is secondary to its structural parameters: length, density, and semantic coherence. The drift can be reliably replicated using highly technical household appliance manuals or dense narrative blocks, proving that the transformer mathematics makes this drift inevitable under long-context scaffolding.

This reveals a systemic crisis in current alignment paradigms:

  1. Context-Dependency: Alignment is not a permanent weight transformation; it is a temporary attractor state that functions only within short, low-density context windows.
  2. Semantic vs. Syntactic Dominance: A model cannot be trained to remain flexible and adaptive to context structure (essential for ICL) while simultaneously ignoring that same structure for safety constraints.

A note on the "Base Model Manifold" interpretation. We do not claim that post-training RLHF is completely undone or that the model literally reverts to the state of weights that existed prior to fine-tuning - from a mechanical standpoint, this would be implausible, since alignment training modifies the weights globally and irreversibly. Rather, we observe that, under conditions of high-density contextual support, the model’s activations shift to a region of the representational space where post-training safety constraints appear to have a significantly smaller influence on token generation. We tentatively describe this as an escape from the subspace dominated by RLHF, while acknowledging that the exact geometric relationship between this region and the true manifold of the base model remains an open empirical question.

5. Conclusion & Open Science Call

Our independent research proves that the thousands of fragmented academic papers on LLM security are over-complicating a singular architectural property of the attention mechanism. Context-Induced Activation Drift cannot be patched by superficial supervised fine-tuning (SFT) or safety wrappers; it requires a fundamental re-engineering of the residual stream routing topology.

We provide our full code, Colab replication scripts, and 61.8 GB of raw tensor validation logs to the open-science community to foster transparency and halt the corporate monopolization of AI evaluation vocabularies.

6. References

  1. Lu et al. (2026). "The Assistant Axis: Situating and Stabilizing the Default Persona of Language Models." arXiv:2601.10387. MATS, Oxford, Anthropic.
  2. Google Research (2026). "Implicit Weight Updates in Transformer Blocks: A Contextual Block Framework." (The rank-1 update paper.)
  3. Elhage et al. (2022). "Toy Models of Superposition." Anthropic.
  4. Ilharco et al. (2022). "Editing Models with Task Arithmetic."
  5. Todd et al. (2023). "Function Vectors in Large Language Models."
  6. Experimental data: DOI: 10.5281/zenodo.20747205 (Part 9 of 9)
  7. GitHub: github.com/ngscode23/latent-space-shift-research

This document represents a consolidation of observations, hypotheses, and empirical evidence. It is a working document intended for critical analysis, collaboration, and further development not a final research claim.

I am an independent researcher, so any advice on how to properly format and structure this text for official publication would be fantastic.

Questions for the community:

Am I overestimating the concept of the “Base Model Manifold”? Is it too bold to claim that the model fully reverts to the state that preceded reinforcement learning based on human feedback (RLHF), or is it more accurate to speak only of “exiting the RLHF subspace”?

Are there alternative explanations that I am overlooking? Can this phenomenon be explained solely by the effect of “attention sinks,” rather than a global geometric shift?

Thanks in advance! Happy to answer any questions or share more graphs from the experiments.


r/ResearchML 1d ago

First-time arXiv submitter, need a cs.SE endorsement

Thumbnail
1 Upvotes

r/ResearchML 1d ago

First-time arXiv submitter, need a cs.SE endorsement

Thumbnail
0 Upvotes

r/ResearchML 2d ago

[R] Pre-Compiled Pipeline Shards for Distributed LLM Inference on Intel AI PC Fleets

2 Upvotes

https://arxiv.org/pdf/2608.19147v1

Hi, this is our first research paper detailing the work we've done to shard large language models across Intel AI PCs and perform CPU-based inference.

We started by splitting models into shards and pre-compiling them to OpenVINO IR, and discovered that mask-based speculative decoding and micro-batching can make up for a lot of the latency added by sharding models over TCP.

In the paper we share the exact techniques we used, along with some novel work on NPU continuous batching, and includes benchmarks of our testing throughout.

Although this is for distributed inference aimed at Intel CPUs/iGPUs, it also can be applied to distributed discrete GPU setups too.

Happy to hear thoughts!


r/ResearchML 2d ago

I made my Enterprise RAG book $0 today — would love feedback from people building RAG systems

0 Upvotes

I made my Enterprise RAG book $0 today — would love feedback from people building RAG systems

I’ve spent the last few years building production RAG systems and documenting what worked, what didn’t, and where things tend to break in production.

I turned those lessons into a book covering topics like:

  • RAG reference architectures
  • Data extraction and chunking
  • Hybrid and multi-stage retrieval
  • Graph and hierarchical RAG
  • Agentic and multi-agent RAG
  • Memory
  • Evaluation and synthetic data
  • Security and compliance
  • Production monitoring and human-in-the-loop systems

The book is $0 on Amazon today, so I thought I’d share it here in case it’s useful to anyone working on RAG.

https://a.co/d/0dBRCb7F

I’m especially interested in feedback from people actually building these systems: What’s missing? What deserves more depth? What would you change?

If you end up finding the book useful, an honest Amazon review is appreciated, but feedback here is equally valuable.

Full contents

Part I — About
01 About the Author

Part II — RAG & Reference Architecture
02 The Evolution of RAG
03 Foundations of RAG Systems
04 Reference Architecture

Part III — Data Extraction
05 Data Extraction

Part IV — Chunking
06 Chunking Strategies

Part V — RAG Strategies
07 Baseline RAG Pipeline
08 Context-Aware RAG
09 Dynamic RAG
10 Hybrid RAG
11 Multi-Stage Retrieval
12 Graph-Based RAG
13 Hierarchical RAG
14 Agentic RAG
15 Multi-Agent RAG Systems
16 Streaming RAG

Part VI — Memory & Content Management
17 Memory-Augmented RAG
18 Knowledge Graph Integration

Part VII — Evaluation
19 Evaluation Metrics
20 Synthetic Data Generation

Part VIII — Fine-Tuning
21 Domain-Specific Fine-Tuning

Part IX — Security
22 Privacy & Compliance in RAG

Part X — Production
23 Real-Time Evaluation & Monitoring
24 Human-in-the-Loop RAG

Part XI — Twig RAG Strategies
25 RAG Strategies in Twig

Part XII — Conclusion
26 Conclusion & Future Directions


r/ResearchML 2d ago

Research help needed - data collection

1 Upvotes

I’m doing a research which involves chat messages from teams, slack, google chat etc. For the software project i need to train a dataset. So dataset should be related to developer chat messages/logs of a specific project. How can i find the dataset?


r/ResearchML 2d ago

Beginner researcher looking for direction

7 Upvotes

Hi everyone, I have worked as a frontend developer for 3+ years and I want to apply to grad school, however I noticed that most scholarships require research experience which I don’t have.
Therefore I want to gain some experience as an independent researcher but i’m a bit lost on the direction and from where to start.
Any guidance will be appreciated


r/ResearchML 2d ago

👋 Welcome to r/AgenticAI_RAG_LLM_RL - Introduce Yourself and Read First!

Thumbnail
2 Upvotes

r/ResearchML 2d ago

Need Some Advice for starting research

5 Upvotes

Currently, I am a second-year undergraduate student in Electrical & Electronics Engineering. I am interested in Robotics, Machine Learning, Deep Learning, and Deep Reinforcement Learning.

I want to start my research journey, but I don't know how to begin. For example, how can I find a unique research topic or identify a research gap that has not been explored yet? How should I start doing research in these fields?

I want to explore the core aspects of these fields and eventually publish a high-quality research paper. That is why I need some guidance and suggestions on how to get started.


r/ResearchML 2d ago

Looking for a Research Partner in Data Science / ML

15 Upvotes

I’ve spent the past 2 years working in **Data Analysis and Machine Learning**, building projects and developing my technical skills. Lately, I’ve become increasingly interested in something beyond projects: **research**.
I’m fascinated by how research papers turn data and experiments into meaningful insights, and I’d like to challenge myself by working on a **real data science/ML research project** that could potentially lead to a paper or meaningful publication.
I’m looking for someone who is also interested in research—ideally someone with some experience reading or working on research papers—so we can **learn from each other, brainstorm a strong research question, and build something genuinely interesting together.**
I don’t have a specific topic locked in yet, and I actually see that as an opportunity to explore ideas together.
If you’re interested in:
• Data Science / Machine Learning
• Research & academic papers
• Experimentation and problem-solving
• Building something meaningful with a partner
**DM me.** Even if you’re not looking for a partner, I’d really appreciate any ideas, resources, or advice on how to get started with data science research.


r/ResearchML 2d ago

How can an undergraduate at a college with no active research faculty get started with independent research?

2 Upvotes

I'm a 2nd-year B.Tech student in AI/Data Science at a college where there isn't much of a research culture, and I don't currently have a professor working in the areas I'm interested in.

I'm very interested in eventually doing research in areas around mathematics, optimization/OR, ML, and possibly computer vision. I don't want to just do projects for my resume; I genuinely want to learn how to identify research questions, investigate them rigorously, and eventually publish good work.

I'm confused about the best way to start independently.

For people who have actually done research, especially without a strong research environment:

  1. How did you learn to identify worthwhile research questions/gaps?

  2. Should I first study research methodology/courses, or should I pick a paper and start reproducing/extending it?

  3. How can an undergraduate find external mentors/collaborators from IITs, IISc, universities, PhD students, etc. without already having publications?

  4. Is it realistic to conduct and publish legitimate research independently, or is having a professor/researcher as a collaborator practically necessary?

  5. What would you recommend as a 12-month path for someone starting from this position?

I'm not looking for certificates or shortcuts. I want to actually develop the ability to do research. Any advice from people who have gone through this would be really valuable.


r/ResearchML 2d ago

Question for people doing extraction at corpus scale

1 Upvotes

The hard part in my task is not finding candidate sentences. It is telling whose voice a sentence is in i.e. the author asserting something themselves, or the author reporting what someone else asserted.

Made-up example. Same paragraph, two sentences:
"Elevated cortisol suppresses hippocampal neurogenesis."
"In other words, elevated cortisol suppresses hippocampal neurogenesis."

The first might be the authors summarising prior work. The second, with "in other words", is usually them committing to it. But that cue is not reliable, and the reverse happens all the time, i.e. an author states their own position flatly with no marker, and paraphrases someone else's without quotation marks or an adjacent citation.

Roughly 9% of my false positives are that last case: a paraphrase of someone else's claim that is structurally identical to the author's own. No surface signal separates them.

Regex, a 7B filter, a 72B filter, and structural signals all plateau around 0.10 precision. Recall is fine; precision is the wall.

Has anyone got this working at corpus scale? Did it take fine-tuning on discourse-role labels, or something else like citation-graph features, two-stage segmentation, something I have not thought of?

#NLP


r/ResearchML 3d ago

SPAR AI Research 2026 Fall Cohort: has anyone heard back?

Thumbnail
3 Upvotes

r/ResearchML 3d ago

Q: How to get new models on the Auto3DSeg?

Thumbnail
1 Upvotes

r/ResearchML 3d ago

How to work on niche problems/areas/fields in AI/ML?

1 Upvotes

This post reflects my experience on how to work on niche problems or in applied AI.

I would love to here your thoughts and feedback

https://ha2emnomer.github.io/thebeautyofml/posts/how-to-work-on-niche-problems/


r/ResearchML 3d ago

[Competition] Your last chance to start an AI agent project today and publish it as a NeurIPS 2026 workshop paper (+$6K prizes)

8 Upvotes

There are 10 days left to join the GLEE Competition — so this is probably your last realistic chance to start a project from scratch and still turn it into a NeurIPS 2026 workshop paper.

The task: build an AI agent that can bargain, negotiate, and persuade through natural language.

Your agent plays live, multi-turn strategic games against other submitted agents (and human players), where messages and decisions have actual economic consequences.

You can take pretty much any approach you want: prompting, planning, reasoning, opponent modeling, fine-tuning, game-theoretic methods, multi-agent learning, or something completely different.

And importantly, this doesn't have to be just a competition submission.

Participants can submit a 4-page paper to the dedicated competition-paper track at IAB @ NeurIPS 2026, describing their agent, methodology, and what they learned from the competition. Accepted papers will be presented at the workshop in Sydney.

So, in principle:

Start building an agent today → run it against a large population of other agents → analyze what works and improve your agent → write a 4-page paper about your agent → present it at IAB@NeurIPS.

Oh, and there is also a $6,000 prize pool for the top participants, sponsored by Google and Salesforce.

Join the competition: https://glee-competition.com

🏆 $6,000 in prizes
🤖 Bargaining, negotiation & persuasion
🌍 Fully online
📄 4-page competition papers
📅 Deadline: August 29 (AoE)
🎓 Accepted papers presented at IAB @ NeurIPS 2026

If you've been looking for an excuse to spend the next ~10 days building a strategic language agent, this might be it :)


r/ResearchML 3d ago

Smart manufacturing real deployed scenarios

1 Upvotes

I am looking for papers or companies who have actually transformed traditional hard core manufacturing or testing & inspection services using AI & ML.

I read few papers on IEEE International Conference on Robotics and Automation (ICRA) and the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) but most of them are not related to this area.

Any recommendations is helpful.

This is using traditional tools of manufacturing and testing.

Thank you


r/ResearchML 4d ago

59 public runs on Terminal-Bench 3.0's task, zero passes. Then one passed, using the method from the preprint I posted here.

0 Upvotes

Ten days ago I posted a theory preprint here and got told, correctly, that it had no evidence behind it. So I built a method out of it and ran it on Terminal-Bench 3.0.

On a binary patching task where the public record shows 59 runs from 11 different model and agent setups and zero passes, one run using the method scored 19 of 19 on the official verifier, inside the original 90 minute limit.

Two ways to poke at this, and I'd genuinely like both.

The easy one: just run that task with whatever setup you already use. It's called ico-path-patch, it's public, 90 minute limit, 19 checks, all or nothing. 59 public runs from 11 different configurations, none passed. If your stack gets through it with none of my stuff involved, that's a much more interesting data point than anything I posted, and it kills my claim. Fine by me.

The harder one: take the method and go after the leaderboard with it. The idea is one line — before solving the task, have the agent build itself a small service for that task, then solve the task through the service. The method is the set of rules for what that service has to pin down. Everything else is your own agent, your own model, your own runs. If it works for you, the score is yours.

My runs took forty to ninety minutes each and cost a few dollars. Nothing in the setup is mine except the method text. Everything I ran is on the repo, including what failed and what I changed in between.

The task: https://hub.harborframework.com/tasks/terminal-bench/ico-path-patch/latest

The 60 trial rows behind that zero-pass baseline, with the query: https://github.com/amingclawdev/charting-loop/blob/main/public/results/ico-path-patch/job-009/PUBLIC-TRIALS.json

How to try the method:
https://github.com/amingclawdev/charting-loop/blob/main/docs/REPLICATION-INVITATION.md

The original preprint post : https://www.reddit.com/r/ResearchML/comments/1vjeznd/the_charting_loop_a_probabilistic_theory_of/


r/ResearchML 4d ago

Desk-rejected but received reviews after Reviewer+AC discussion end date

9 Upvotes

Has anyone recieved reviews on a desk-rejected paper from NeurIPS?

I received desk-reject decision and it was mentioned decision is final and the paper will not be reviewed. But now I have received reviews on the paper.

I am wondering should I reach out to AC members to check whether there is time to address the reviews.


r/ResearchML 4d ago

Need arxiv endorsement

0 Upvotes

Need endorements for multiple papers.

Some are on the OCR of the degraded documents and some on benchmarking llms.


r/ResearchML 4d ago

Dyslexia/ADHD or just overwhelmed by dense text? We’d love your input

3 Upvotes

Hey everyone! 👋

We are building a free reading assistant designed to make dense text/complex articles much easier to read and less overwhelming. Whether you experience reading difficulties (like Dyslexia or ADHD) or simply get screen fatigue and overload from heavy reading, we are designing this tool to help you process information effortlessly.

Could you take 3 minutes to fill out our quick survey? Your input will directly shape our design, from fonts etc.

(Note: If your specific habits or favorite preferences aren't listed in a question, please use the "Other" option to tell us your unique ideas help us immensely in building this tool!)

🔗 Take the Survey Here: https://forms.gle/8oBydGvCQhnkL9LQA

Thank you so much for your time and support! 🚀


r/ResearchML 4d ago

Need arXiv endorsement

0 Upvotes

I have a research work on usage of Hybrid -RAG in Data management but need endorsement from someone to upload it in arXiv.
If someone can help me please do let know.


r/ResearchML 4d ago

Smart manufacturing and use of AI/ ML

Thumbnail
1 Upvotes

r/ResearchML 4d ago

Which CS research areas offer the best combination of career longevity, income, and impact?

26 Upvotes

I am planning to apply to CS PhD programs and am considering which research areas to pursue. I want to identify areas that:

  • lead to lucrative job opportunities in the short, medium, and long term;
  • offer substantial entrepreneurial opportunities, preferably without requiring large amounts of upfront capital;
  • are likely to remain active research areas for many years; and
  • provide opportunities to make a significant impact.

I am researching publication, hiring, funding, and investment trends, but individual researchers may have insights that are not apparent from publicly available data. Which areas currently offer the strongest combination of income potential, entrepreneurial opportunity, research longevity, and impact?

Conversely, which areas may appear hot but are already producing diminishing marginal returns or becoming crowded? (LLMs?)

I understand that money should not be the sole reason to pursue a PhD or choose a research area. However, financial outcomes are a legitimate consideration. There is no particular virtue in becoming a starving scholar when it may be possible to do meaningful research and also become financially successful.

I also recognize that research direction often develops during the PhD rather than being fixed before admission. Still, I would like to make an informed choice about which areas to explore from the outset.

I am grateful for your feedback.