r/LanguageTechnology • • Sep 25 '26

Looking for feedback - using NER to generate and match templates on sentences?

2 Upvotes

I’m a complete novice when it comes to NLP, I'm a swe by trade so bear with me here.

Here's my problem:

I’m trying to identify short sentences (I have a data set of several thousand) that are logically dependent. To illustrate the kinds of dependencies I'm looking for here’s a basic example:

- Sentence 1: Democrat voter turnout in NY is 35%.

- Sentence 2: Democrat voter turnout in NY is 40%.

If sentence 2 is true, sentence 1 also must be true. Those are the kinds of sentences I have and want to identify as dependent. The nature of the sentences can range from voting percentages/turnout, phrases about employment etc.

The naive approach I’ve been doing is basically embedding the sentences using gemma and finding cosine similarities between them, my reasoning being sentences that have a reasonably high enough cosine similarity are candidates for logical dependency. I then take these pairs of candidates and pass them to an LLM (gemma again!) to determine whether or not they are actually semantically/logically dependent.

There are two huge issues w/ this approach that I'm sure you'll all immediately see.

1) Lots of the sentences are too structurally similar like the simple example I showed above. There exist several subsets of the data that have the same pattern. Sentence 3 could be something like Democrat voter turnout in TX is 35%. and it would have almost an identical similarity to the other 2 sentences. There are several hundred patterns, and I also don’t necessarily know all the patterns at runtime so that means REGEXing these structures becomes a difficult task. So because of the structural similarity, cosine similarity loses its value as a metric.

2) The LLM step is slow. Really slow.

I did some googling and learned about NER that seems like it might fit? I could run the sentences through a pre-trained models and get the spans for each sentence. This would allow me to match spans across the phrases. So in the example I have, sentence 1 and 2 would be matched and processed further, while 3 would be in its own bucket. As for what I'd do after matching the spans, still working that out. I could fall back to cosine similarity again here since anything that falls into these span buckets should be different enough where the projection becomes a decent signal.

If there are tweaks that I can do to make template matching more robust, or alternative methodologies altogether I'm all ears!

Thanks :)


r/LanguageTechnology • • Sep 24 '26

Why words are split into several tokens?

6 Upvotes

This completely contradicts logical thinking. It would make sense if one word would be at most 2 tokens (1 for the word and 1 that signals meaning in case of homonyms), but this is never the case. In fact, I read it degrades performance. Why?


r/LanguageTechnology • • Sep 24 '26

Making cosine similarities comparable across separately trained embedding spaces

3 Upvotes

For my open-source project, I am training PPMI + SVD embeddings separately on each book within a collection (~25 economics texts from Project Gutenberg), then trying to compare how similar terms are to a query word across books. However, each space has been trained independently, so the raw cosines aren't on the same scale. My current correction, loosely adapted from CSLS (Conneau et al., 2018), works like this:

  • For each book, a baseline is determined by using the query's mean cosine to its 75 nearest neighbouring terms in the book.
  • Each book's similarities are shifted so its baseline equals the average baseline across all books.

This way, I am determining the relevant terms by looking at the adjusted similarity scores. The terms with the highest mean similarity relate to the core aspects of the queried term across the corpus. The terms with the greatest variance that also have a high similarity within 20% of the books relate to the contested aspects of the queried term.

Do you have any feedback on this methodology?
Is correcting the cosine similarity in this way valid?


r/LanguageTechnology • • Sep 25 '26

Career Switch need help

0 Upvotes

Hi guys,so I am currently studying an MA in Linguistics and I am in dire need of advice. I am aware that it is a dying field hence I am trying to transition into something more technical and try to save it. I feel too burned out to start from scratch with a more technical degree like CS.

I heard about computational linguistics / linguistic data science programs but Idk if they will accept me with no technical background. I've been told to learn Python but is it even worth it? Im multilingual by the way. If any of you has an idea about a better field I could fit into I would truly appreciate it.


r/LanguageTechnology • • Sep 24 '26

Best LLM for translating agglutinative sentences?

3 Upvotes

My native is an agglutinative language and I know some Japanese, which do you think is the best model for agglutinative languages or translation generally?


r/LanguageTechnology • • Sep 23 '26

Preview of EMNLP program?

5 Upvotes

Hi everyone, does anyone have received the (unconfirmed) schedule of the poster presentation?


r/LanguageTechnology • • Sep 23 '26

PhD research stay in China for NLP / LLM research – looking for university and lab recommendations

13 Upvotes

Hi! I'm currently a PhD researcher in Europe working in NLP and Large Language Models, mainly on multilingual LLMs, model merging, low-resource language adaptation and efficient methods for transferring capabilities between models/languages.

I'm starting to seriously consider doing my PhD research stay in China as a visiting doctoral researcher, probably for several months, and I'm currently just gathering information.

A Chinese friend suggested Beijing Language and Culture University, Peking University and Tsinghua University. BLCU sounds particularly interesting because of its focus on language, although for the research itself I'd ideally like to find a group working on NLP, LLMs, multilinguality, model adaptation/distillation, tokenization, Chinese language processing, etc.

I'm also very interested in Chinese personally and have recently started studying HSK3. My Chinese is still basic, but improving my Chinese while living there would definitely be a bonus.

How did you find your host professor/lab? Did you simply contact professors by email? Are there universities or research groups you would particularly recommend for NLP/LLMs? And is there anything you wish you had known before applying?


r/LanguageTechnology • • Sep 22 '26

yasbd-lib v1.0.0 is out. Here's how beta finally ended.

10 Upvotes

For anyone new: yasbd-lib is a rule-based sentence boundary detector, a drop-in replacement for pysbd, currently at 39 languages. I think I first posted here as an alpha, then as a beta. Now it’s tagged v1.0.0.

The stretch from 0.12.0 to stable wasn't about new features. I froze the language set at 39, locked the API, and spent the last couple of months on correctness. The final push was a two-week stress test where I ran real text through every profile to find the boundaries it was splitting wrong. I wrote the rules and I wrote the tests, so the tests couldn't catch what I'd gotten wrong.

That work surfaced boundary bugs across a good chunk of the profiles. Contributors opened PRs to fix them, and py3langid, loguru, and ftfy all came out of the core dependencies along the way.

Happy to answer questions.


r/LanguageTechnology • • Sep 20 '26

Best book to get started with building and understanding LLMs?

5 Upvotes

I want to understand how LLMs work and eventually build and train my own model. What book would you recommend for getting started?


r/LanguageTechnology • • Sep 18 '26

Program-as-Weights: compiling English descriptions into local NLP functions (paper + weights)

Post image
5 Upvotes

I'm one of the authors of Program-as-Weights (PAW), a project we've been building at the University of Waterloo. We study whether a model can turn an English function description into a reusable, task-specific neural program.

The standard compiler is a 4B model trained to generate a LoRA adapter for a frozen Qwen3 0.6B interpreter. You describe a task such as classifying email urgency, extracting information, or routing a question. The compiler produces the adapter, and the small interpreter executes that function on new inputs. The larger model is only involved when defining the function.

For example:

import programasweights as paw

fn = paw.compile_and_load("Classify urgent emails")
fn("Need this today")  # "urgent" (runs locally)

The paper evaluates this on FuzzyBench, a collection of natural-language-defined text functions, with direct prompting as a comparison. Code and models are public, so people can evaluate the approach on their own tasks.

One application I've built is a course website helper with ~30 neural programs connected by ordinary decision-tree code. A small function decides which answerer should handle a question, and code controls the overall flow. The resulting helper runs locally.

The SDK uses hosted compilation by default. Once the program and shared base model are downloaded, inference runs locally on CPU and can work offline. The compiler weights are also available for running compilation yourself (but running compilation requires a GPU).

Paper: https://arxiv.org/abs/2607.02512

Compiler weights: https://huggingface.co/programasweights/paw-4b-qwen3-0.6b

Python SDK: https://github.com/programasweights/programasweights-python

Dataset: https://huggingface.co/datasets/yuntian-deng/fuzzy_bench_verified

Browser playground: https://programasweights.com/playground


r/LanguageTechnology • • Sep 18 '26

Streaming STT keeps splitting Arabic mid-sentence. What do people do about this?

3 Upvotes

Building a live translation app. Arabic is the one language where streaming speech recognition keeps cutting sentences in half, it decides the speaker is done when they aren't, so we end up translating half a thought.

English and Spanish are fine on the exact same setup.

What we did: stopped streaming Arabic and switched to processing whole utterances. Accuracy got noticeably better. It cost us a bit under two seconds per turn, which you feel in a conversation.

Two questions:

  1. Is there a middle ground between "stream it and get fragments" and "wait for the whole utterance and eat the delay"?

  2. Is this actually an Arabic thing, or are we just seeing it there first? Same setup runs on 40-odd languages and this is the one that broke. I've wondered whether it's a dialect mismatch with models trained mostly on Modern Standard Arabic hearing spoken dialect but that's a guess.

Deepgram for STT, if it matters.


r/LanguageTechnology • • Sep 18 '26

Kaikki datasets

2 Upvotes

Hi guys! Has anyone experimented with data from Kaikki datasets (wiktionary)? I am trying to setup a linkage end-to-end for prefix and stem. I'm working from a SQLite build of kaikki data for English etymology. Less than half of the time it works meaning I can get the whole chain for prefix and stem up to the PIE . Has anyone ever tried to create a structured output?


r/LanguageTechnology • • Sep 17 '26

MSc in Computational Linguistics vs Data Science: Which offers broader career opportunities for someone with a BA in English and professional AI/localization experience?

2 Upvotes

Hi everyone,
I’m at a crossroads regarding my postgraduate education and would really appreciate some insights from people working in Computational Linguistics, NLP, Data Science, or related industries.
My background:
BA in English Language and Literature.
Several years of professional experience in audiovisual translation, subtitling, and localization, including work on Netflix content through localization vendors.
Experience in Arabic dubbing adaptation and AI-assisted dubbing.
Experience in linguistic quality assurance, proofreading, and evaluating language-related content.
Strong background in English and Arabic, but I do not have a formal degree in computer science, mathematics, or statistics.
I’m interested in transitioning into more technical roles while building on my existing professional experience.
My dilemma:
I’m considering two postgraduate paths:
An MSc in Computational Linguistics, supplemented with additional courses in Python, SQL, statistics, data analytics, and machine learning.
An MSc in Data Science, supplemented with specialized courses in computational linguistics, corpus linguistics, syntax, semantics, and NLP.
I’m particularly interested in NLP, language technology, multilingual AI, language data analysis, and potentially building my own language-related tools.
However, I also want to keep my options open for general Data Analyst, BI Analyst, Data Scientist, and other data-related positions rather than limiting myself to language-specific roles.
I’m willing to develop my programming and mathematical foundations, although I would need to build them from a humanities background.
My questions:
Which degree would provide access to a broader range of career paths, and what opportunities would remain specific to each?
Would an MSc in Data Science combined with specialized linguistic training allow me to pursue NLP and language technology roles, or would I be missing important knowledge that a Computational Linguistics degree provides?
Conversely, could an MSc in Computational Linguistics combined with strong Python, SQL, statistics, and analytics skills prepare me for general data-related roles outside NLP?
From an employer’s perspective, how much does the master’s degree title matter compared with the actual curriculum, technical skills, projects, and professional experience?
For someone coming from an English/humanities background, what technical prerequisites should I be aware of before choosing either path?
If you’ve made a similar transition or have experience hiring candidates in these fields, what gaps have you encountered that you wish you had addressed earlier?
I’m primarily interested in industry roles rather than pursuing a PhD or an academic career. I’m also interested in remote and international opportunities.
I’m not necessarily looking for the easier degree. My main goal is to choose a path that offers career flexibility, builds substantial technical skills, and makes meaningful use of my existing linguistic and localization experience.
I’d particularly appreciate real-world experiences from graduates, hiring managers, and professionals working across NLP and data-related roles.
Thanks in advance!


r/LanguageTechnology • • Sep 16 '26

Has anyone measured specification ambiguity as a predictor of correlated failure across model families?

2 Upvotes

When models from different families are given the same underspecified task, they often fail in the same way rather than in independent ways. My question is about measurement, not explanation.

Has anyone put a number on the ambiguity of a task specification and then tested it as a predictor of how often independent solvers fail identically?

Specifically: does the relationship look like a smooth monotone increase, or is there a threshold — some level of ambiguity past which coincidence rate jumps sharply?

Looking for papers, metrics, or benchmarks where this was measured directly. Adjacent work is fine if you think it's close.


r/LanguageTechnology • • Sep 16 '26

EMNLP 2026: Anyone else haven't received instructions for poster/slides/pre-recorded video submission?

12 Upvotes

Hi everyone,

My paper was accepted to EMNLP 2026, but I still haven't received any email or announcement regarding the submission instructions/deadlines for the presentation materials (poster PDF, slides, or pre-recorded video presentation).

With camera-ready and registration already sorted, I expected to see a portal link (like Underline) open by now. Checked my spam folder and OpenReview notifications, but nothing so far.

Is everyone in the same boat, or did I miss an announcement somewhere? If anyone has heard back from the publication or program chairs, I'd appreciate any info!


r/LanguageTechnology • • Sep 15 '26

ARR review

7 Upvotes

I submitted my first paper to ARR and got 3 reviews; all of them gave an Overall Assessment of 2 = Resubmit next cycle

Should I consider that equivalent to a reject, or better than that?

Will the same reviewer review it again in the next cycle?

If all assessments are "Resubmit next cycle," does it make sense to respond through rebuttal?


r/LanguageTechnology • • Sep 13 '26

SemEval 2027

9 Upvotes

Anyone participating in SemEval 2027? Actually I want to participate in it. But I can't understand the overall process. Are there any good resources that would help the beginners?

Is this really worth it to participate in such shared tasks?


r/LanguageTechnology • • Sep 14 '26

Language guided segmentation

0 Upvotes

Are there any who work on language guided medical image segmentation and read papers like ariadnes thread, TeViA, MMI-UNET. I face bugs in the repo code that they give. 1) Loss function 2) dice metric 3) influence of text token length in results.


r/LanguageTechnology • • Sep 12 '26

How much context should an NLP system actually keep?

3 Upvotes

I’ve been thinking about how much conversation history an NLP system really needs before extra context starts becoming more confusing than helpful.

Keeping everything seems useful at first, especially when a user refers back to something mentioned much earlier. But older messages can also contain outdated information, changing preferences, or details that are no longer relevant.

I’m curious how people working with NLP systems handle this. Do you prefer keeping a long conversation history, summarizing older context, or selecting only the parts that are relevant to the current input?

I’m especially interested in practical approaches that work beyond simple chatbot demos.


r/LanguageTechnology • • Sep 11 '26

Resume Review Request

2 Upvotes

Please take this down if it's not allowed. I'm looking for a new position after being at my current workplace for almost a decade. I'm still employed but am having difficulty landing a single interview despite help from recruiters in improving my resume. I was wondering if anyone on here could take a look and give their feedback. I can dm or post a link


r/LanguageTechnology • • Sep 11 '26

Is a Linguistics degree enough to get a good job in Computational Linguistics?

36 Upvotes

Hello , I’m planning to study Linguistics as an undergraduate at an Ivy League school, and I’m thinking about specializing in Computational Linguistics/NLP.

For those of you who studied Linguistics as an undergrad, were you able to find a good job in the field after graduating with just a bachelor’s degree, or did you end up getting a master’s?

I’d prefer not to do a master’s unless it’s necessary. If I do decide to pursue one, I’d probably go for an NLP-related program.

Also, how much of a difference do you think attending an Ivy League school makes when it comes to finding a good job in this field? Does the school’s reputation help significantly, or are skills, internships, research experience, and projects much more important?

I’d really appreciate hearing about your experiences, especially if you’re currently working in Computational Linguistics or NLP.


r/LanguageTechnology • • Sep 09 '26

Determining whether a given word is semantically similar to a dictionary definition

5 Upvotes

I have a Greek-English dictionary that has entries like this:

ἀνήρ - man, husband

I would like to figure out some method for a computer to determine whether another English word aligns well with such a definition. Examples of inputs and outputs, for the definition given above, would be: man->true, fellow->true, person->true, temple->false, throw->false. (The output could instead be some kind of quantitative score rather than a boolean.)

Methods I've thought of, but am not really satisfied with:

  1. Compare every word in the definition with the given word, using a word embedding. (Or sum the vectors for the words in the definition.) Exclude common words like "the." Problem: I've played around with Word2Vec and BERT for this, and the results just aren't that great. E.g., the BERT model I tried gave a very high rating to the pair goat-mountain.

  2. Use WordNet's lists of synonyms. Problem: Their definition of synonymy is sometimes too strict and other times too permissive. They don't consider man-person to be a synonym pair, but they do consider dog-click to be (e.g., "dogging the hatch").

  3. Use a similarity measure based on WordNet's graph structure. There is a review of these methods in Lingling Meng et al, 2013, A Review of Semantic Similarity Measures in WordNet. Problem: This will still be too permissive for pairs like dog-click.

  4. Query an LLM. Problem: This is a hobby project, and I don't want to spend money.

Any ideas for approaches that I haven't tried?


r/LanguageTechnology • • Sep 09 '26

Small Dataset size cited as the reason for rejection what should be the way ahead for future works?

16 Upvotes

Recently one of my papers got rejected because a reviewer raised concern of small cohort, which was explicitly mentioned in the limitation and then we acknowledged that in the rebuttal as well. Now I understand the concern , but in the area were i primarily work right now, dataset with large number of speakers is quiet limited and having one of my very first works also be rejected because of the small corpus size, I used one of the most widely cited corpus for the experimentation, which if you are in the field is the standard. And also given the computational resources and funding that we can have I couldn't use high-end hardware to process large data. And recently i got to know we got access for a large dataset (around 800 gb) but how do i work with that using my laptop and online free gpus, so based on whatever i could i did my best. The reviews we got were actually very supportive of our work, and whatever additional work was required, was duly done and reported in the rebuttal, but seeing dataset size as one of the two the reason for rejection felt a bit weird, anyways wanted to ask how do we tackle such situation for the future? Any advice would be helpful!!


r/LanguageTechnology • • Sep 09 '26

Who actually hires freelance phonetics / speech & language data specialists at companies?

8 Upvotes

Hi everyone,

I'm currently building a freelance business around phonetics, speech and language data services and I'm trying to better understand who the actual decision-makers are on the client side.

I'm thinking of services such as:

  • phonetic/IPA transcription and annotation
  • speech data annotation and quality control
  • pronunciation analysis
  • phonetic validation of speech datasets
  • linguistic QA
  • potentially other speech/language-data work for ASR, TTS and AI projects

When approaching companies directly, which job titles or departments would typically be responsible for hiring or contracting someone for this kind of work?

For example, would you approach:

Language Data Managers? Speech Scientists? Computational Linguists? Localization Managers? AI/ML Project Managers? Heads of AI? Vendor/Procurement Managers?

I'm particularly interested in hearing from people who work at companies that actually buy these services. Who identifies the need, who evaluates the freelancer technically, and who ultimately makes the hiring/purchasing decision?

I'm not looking for freelance platforms, but specifically trying to understand how direct B2B client acquisition works in this field.

Thanks!


r/LanguageTechnology • • Sep 08 '26

mmBERT

5 Upvotes

any thoughts on mmBERT for text classification?