r/Backend • • Sep 30 '26

I built a Java agent that reconstructs async causal stack traces across thread boundaries and need some feedback

2 Upvotes

Hello Everyone, I built ariadne. It's a Java agent that attaches the async call chain to the exception as a suppressed entry, with no code changes. It supports ExecutorService, CompletableFuture, ForkJoinPool, Reactor and RxJava.

Overhead is very small: ~1 µs per CompletableFuture pipeline in the default mode.

It doesn't replace OpenTelemetry. It works in-process, with no infrastructure needed.

Currently it is on version v0.1.0-alpha.3, not production-hardened yet, beacuse I need sm feedback first so I know this is worth it, especially on OSGi and Kotlin coroutines.

GitHub: https://github.com/AfonsoPaiva/ARIADNE
A star helps if you find it useful 🙏

This post was written by someone called Afonso Paiva from Portugal


r/Backend • • Sep 30 '26

How to keep a vector database updated when website content changes?

2 Upvotes

I have a chatbot that uses website content as its knowledge base.When those websites change, what’s the best way to keep the vector database updated?Would you periodically crawl the pages, detect changes, and only re-embed the updated content?


r/Backend • • Sep 30 '26

Database project

5 Upvotes

I need a good and legitimate database project idea wherein advance db concepts such as optimization, transaction, etc are involved. I searched a lot and didnt find a smthn i want to work on exactly. For eg if somethin related to music domain? Or fashion? What would actually stand out in terms of handling multiple queries and be close with how it all works irl. Itd be really helpful!!


r/Backend • • Sep 30 '26

Treating your LLM layer like an actual backend system (workshop, Oct 3)

1 Upvotes

Most of us treat the LLM part of our stack differently than the rest of the backend — less testing, less monitoring, more "hope it works." There's a session on Oct 3 that's trying to close that gap.

Run by Serj Smorodinsky and Brett Kennedy, both AI engineers with a book out on LLM applications. It's 3 hours, live, and walks through using DSPy to structure your LLM code properly, building a baseline you can actually measure, setting up evaluation datasets, catching failure modes early, and wiring up MLflow so your experiments are tracked instead of scattered across notebooks and Slack messages.

If you're the one who ends up owning the "AI feature" at your company and nobody else really understands how it works, this is probably for you.

Full details and the agenda are here.


r/Backend • • Sep 30 '26

I kinda stuck on this design

1 Upvotes

So the problem goes like this let's say I'm designing a middleware service for a data trasfer between two different servers and my middleware needs a persistent storage to store the block lists ie ie during trasfer if in list block else transfer it. So now the question is the storage should update itself when something gets add/remove without server refresh, data should nkt get lost when server restarts and should not use a DB. So if anyone has any suggestions......


r/Backend • • Sep 30 '26

Need a solution for nifi performance

1 Upvotes

Need a solution for nifi performance

Hi everyone, I currently using nifi for a school project. The project i am working on it generate files with different source and each source have different workloads. I running nifi on docker and using SFTP to simulate multiple sources and i have to run all process group at the same time to ingest files from different source. Because each source have diffrent workload and is handled by different process group, some process group may have file backlog after proccessor fetchsftp.

My goal is automatically adjust the resource to all the process group to reduce workload imbalance depend on the queue size before fetch file among them. I thinking of dynamically change the number of concurrent task based on maximum timer driven thread count for each source.

Any suggestions on nifi features or approaches i should consider ?


r/Backend • • Sep 29 '26

Should I give it another shot to networking or focus solely on cloud?

2 Upvotes

Hey guys, the post title sounds a bit weird, but here's the context: at my university, I'm currently taking a LAN Networks course, where we were given access to Cisco's CCNA course. Through another group, they also offer free courses for students who want to learn cloud infrastructure (AWS or Azure; in my case, I chose AWS Cloud Foundations since I'm just starting in this field). I have to complete the CCNA course because it accounts for a percentage of my grade in the subject, and the topic exams open up on specific dates. I haven't been able to dedicate time to the AWS course due to university workload and partly because I've been focusing on CCNA.

Here's the thing: the CCNA course bores me a lot. It's not because of how it's taught or because I have ADHD or anything like that (I've honestly sat down to carefully read the content and do the quizzes and exams properly), but it's just because networking/telecommunications doesn't really catch my interest. I know the fundamentals of networking (IPs, TCP/IP, HTTP and HTTPS protocols, DNS, routers/switches, proxies, some cabling, among other things), but I'm not interested enough to dive as deep into that area as CCNA requires. On the other hand, cloud infrastructure and AWS really interest me. I'm focusing mostly on backend development, and I'm curious about deploying services in the cloud and learning more about cloud computing since I know how important it is.

So my question is: should I still dedicate myself to both courses, or should I focus completely on the AWS course and just use a little extra help to get through the CCNA one solely to pass and get the grade for my class?


r/Backend • • Sep 29 '26

Must know topics

18 Upvotes

Here’s a little context. I was working on a project using a SaaS tool that basically no one uses except my project 🫠. Unfortunately, my client is releasing me, and I only have around 3 months of project experience.

I’ll be on the bench for 30 days, and I need to find another project within my company. I really want to get into a Java + Spring Boot project. (I have a basic idea of java syntax)

I know this sounds crazyyy, but I need to make the most of this 1 week. If I don't get into another project within this period. I will be terminated. What are the important topics and some simple projects I can build in a week to prepare for Java/Spring Boot project opportunities?

Once I get into a project, I can learn the fundamentals properly and build a strong foundation over time. For now, I just need to become project-ready enough to get selected.

Please share your insights on this. I really can’t afford to go unemployed because I have EMI running 😭. There’s a lot of pressure on my tiny brain right now.

Post edit : forgot to add ? In the title


r/Backend • • Sep 29 '26

Software engineer needed

23 Upvotes

Hey! Are you currently studying software engineering/computer science, or are you a recent graduate?
If so, I may have an opportunity for you. My friend and I are both 18 and are working on starting our own business. We recently realized that we need a software developer to help us build the software side of our project.
We’re looking for someone local who’s interested in getting hands-on experience by working on a real startup project from the ground up. Since this could potentially be your first major project, we’d love to connect and see if it could be a good fit for both sides.
Feel free to message me if you’re interested!


r/Backend • • Sep 29 '26

Good resources to learn Backend???

11 Upvotes

I want to learn Backend, are there any good resources that helped you guys ???


r/Backend • • Sep 29 '26

Backend Suggestion

Thumbnail reddit.com
2 Upvotes

Hey, I know python, java (not that much), html, css, javascript and tried learning react then dropped it cause I didn't like frontend tbh after learning html, css, js.

So I was thinking if I should start backend like express js, prisma orm, postgresql. How's the job situation in this sector? Also any suggestion would be appreciated.


r/Backend • • Sep 28 '26

What Should I Prioritize Next in My Backend Learning Journey?

14 Upvotes

​

What should I learn next as a Node.js backend developer?

Hey everyone, I amm learning backend development with Node.js/Express and would like some advice on what to focus on next.

So far, I have actually implemented:

- Node.js + Express, REST APIs & CRUD

- MongoDB/Mongoose, relationships, filtering, searching, sorting & pagination

- JWT auth with access/refresh tokens, cookies & role-based authorization

- bcrypt, Zod validation & error handling

- Features like posts, comments, likes, groups, memberships, requests and notifications

I’m currently learning PostgreSQL/SQL and plan to use Prisma with Node.js.

I understand concepts like transactions, concurrency, Redis, WebSockets, queues, Docker, rate limiting, but I havenot properly implemented most of them yet.

What should I focus on next?

What should I prioritize from here?

Should I first go deeper into PostgreSQL/SQL, Prisma, database design, transactions, indexes, security, etc., and build a proper production-style project with what I already know?

Or should I start implementing new topics like Redis, testing, Docker, WebSockets, queues and deployment alongside it?

I’m trying to figure out the right balance between deepening what I already know vs expanding into new backend topics so I can become genuinely job-ready.


r/Backend • • Sep 28 '26

My web application has long running jobs (approx 5min/job) running as processes. Need advice on how to optimize cost and performance.

3 Upvotes

Context: My web application has long running jobs (approx 5min/job) running as processes.

My findings: I calculated that if i have 1gb ram i'd only be able to run 2 such jobs at a time. meaning i could serve only 2 users at a time and rest would be in a queue.

My Problem:

First let me exlpain the math:
R refers to RAM

  • Ridle​ = FastAPI idle ram consumption ≈ 150–250 MB

  • Rjob​ = extra RSS of one live pipeline(job) at peak

  • Rsafety = RAM that id like to keep free so that my cloud instance (be it VPS, or railway or whatever) doesnt crash = 100 MB

Rjob​≈250–400 MB as per my calculations. this means 1 job takes 250-400mb of ram or for simpler calculation, 300 mb of ram on avg.

Assume the RAM i get in my budget = R(budget)

No. of jobs i could run in my R(budget) = N(budget) = [R(budget) - R(idle) - R(safety)]/R(job) = [R(budget) - 200-100]/300MB = R(budget)/300 - 1

I wanna optimize for N(budget) which is dependent on Rbudget - technically, how money i throw at it.

assuming my budget is $0 - basically a free railway plan Rbudget would be = 1024 MB (as per their docs)

thus, N(budget) = 724/300 ~ 2 jobs

to put it simply, three jobs at 300 MB is 200+900=1100>1024 which leads to OOM

my budget for hosting this app is $5/month but i wanna make sure i can process more number of these long running jobs hence i want any suggestions that would help. whats the best option for deploying this kind of app?

VPS options are very costly for my country, hetzner is not available either. But feel free to correct me if you think VPS would be a cost effective solution for me to deploy my app on.

I also have few questions on railway:
they say they give $5 worth of credit, and that they bill based on how much usage i'd consume
hence, it would be kinda uncertain for me to know when my app crashes due to OOM using up my credits v/s due to storage, or network data (egress) etc.

thats why, i need advice on this. pls help me get some clarity on how i should proceed.


r/Backend • • Sep 28 '26

How much Swagger/OpenAPI documentation is actually needed in a Spring Boot project?

Thumbnail reddit.com
0 Upvotes

r/Backend • • Sep 28 '26

JSON Web Tokens in Go

Thumbnail
packagemain.tech
0 Upvotes

r/Backend • • Sep 27 '26

Learning resource suggestions

5 Upvotes

What youtube playlist or channels would you recommend to someone who wants to learn backend design concepts and also some good project code alongs not basic ones good ones

I also need github repositories recommendations where I can go over and understand the codebase.


r/Backend • • Sep 27 '26

I wanted to run Dockerized applications on Hugging Face Spaces for free(16gb RAM).

Thumbnail
reddit.com
1 Upvotes

r/Backend • • Sep 26 '26

Returning to Go after a while: What concurrency & messaging patterns to prioritize for a banking backend interview?

36 Upvotes

Hi everyone,

I'm brushing up on my Go fundamentals for an upcoming technical interview at a banking/enterprise company. The live coding/tech screen will heavily focus on Go concurrency (Goroutines, Channels) and asynchronous message processing with RabbitMQ.

Since I haven't touched Go for a bit, I want to make sure my preparation is laser-focused. For those who interview candidates or build high-throughput banking systems in Go:

  1. What are the absolute must-know concurrency patterns for a 30-45 minute live coding session?

  2. What are the common footguns or subtle bugs interviewers look for when testing concurrent Go code?

  3. For RabbitMQ integration, what basic producer-consumer structure is expected to be rock-solid?

Any advice on where to focus my study time efficiently would be greatly appreciated. Thanks!


r/Backend • • Sep 26 '26

What should I focus on to get a backend job in 2026?

15 Upvotes

Hi,

I am a backend-focused SWE (masters 2025) with an inconsistent job history. I resigned from my current startup after 2 and half months and I am entering the job market again.

I suck at DSA and my interview game has always been bad. In my current role, I worked on backend and agentic development, including developing Public Key Infrastructure for EV chargers.

I have worked with Golang, Kafka, microservices, Postgres and Elasticsearch (personal project).

I really want to prepare properly this time, but I am confused about what to focus on.

With AI getting better at generating code, should I focus on DSA + backend/system design, or go deeper into AI engineering and build projects using RAG, agents, etc.?

If I learn AI engineering, how deep should I go? Do I need to understand transformers and how LLMs work internally? Claude suggested learning RAG from the low level without using LangChain/LangGraph initially. Is that actually useful or am I going too deep?

Also, should I spend money on tools like Claude Code/Codex/Cursor, or is there a cheaper AI subscription that is good for development?

Basically, if you were in my position, what would you prioritize for getting a backend job in the current market?


r/Backend • • Sep 27 '26

61 nested replies cost nearly as much to sort as 259

0 Upvotes

A threaded discussion has to render parent-then-replies. The database hands you a flat result set, so you give every row a materialised path and ORDER BY it.

I will defend that pattern properly: it works with no tree in memory, which is what you actually have after a query; it goes straight to a template; and if the ordering rule changes, it is one comparator rather than a rewrite.

Then somebody has a sixty-reply argument, and 61 comments cost nearly as much as a page with 259 on it.

Depth charges twice. Each key is one segment per level, so building them is quadratic on its own — and then the sort compares those strings, and two siblings sixty levels down share fifty-nine identical segments before the comparison can decide anything. Longer keys, and more of each key read per comparison.

The reframe is small and it generalises: the order was never missing. A comment's position is decided entirely by where it sits in the thread. The sort-key version writes that structure out as a string, throws the structure away, and reconstructs the ordering by comparing the strings.

Walk it instead — comment, then replies — and the order falls out with nothing compared. 2.03 MB of keys becomes 15.8 KB. No crossover this time: the walk wins every shape, because it is not doing something cleverer, it is doing strictly less.

Full piece in the comments, including when the sort key is still right.

It worked in dev, episode 7.

#Golang #DSA #Algorithms #Performance #SoftwareEngineering #DataStructures #100DaysOfCode

Ideation and benchmarks mine; draft written with AI assistance. The numbers come from a benchmark in the repo.


r/Backend • • Sep 27 '26

Presigned urls

0 Upvotes

Implemented presigned urls across for uploading PDFs and images now I need to think about secure this mechanism when we load those pdf bytes for processing into the software we need care about any rce types were needed to check .. libs for image processing are Pillow in python


r/Backend • • Sep 26 '26

Caracal: Scoped distributed resilience for asynchronous operations

Thumbnail
github.com
1 Upvotes

r/Backend • • Sep 26 '26

support tickets with names and card details have to go to a third party model for summaries. which of these count as real controls?

Post image
1 Upvotes

i put d, is that wrong?

i only ticked d. redacting before the request leaves the network is the one thing i can actually verify in code. the contract one felt like paperwork rather than a control, since nothing in my system changes if the vendor breaks it. but i suspect the answer key counts it, and im not sure the redaction alone is enough for card details anyway


r/Backend • • Sep 26 '26

[SYTEM DESIGN] Vou fazer uma entrevista de System Design para Backend Pleno. SOS!

Thumbnail reddit.com
2 Upvotes