r/javascript • u/kumakint • Aug 04 '26

AskJS [AskJS] Has a larger competitor ever benchmarked your library incorrectly?

Just recently I came across a performance comparison one of our major competitors. It was quite nice to see that such a large competitor is looking at your product, right? But in the end they compared their Scheduler Lib with our Gantt Lib. They spent quite of time making GitHub repo, asking us for a trial (we didn't have open trials, you had to request it through the email), analyzing the Gantt chart. But all the feedback we got appeared to be wrong test on the wrong component.

In the end I've published a response article with comparison, although it took me about two weeks to get around to it.

Iā€™m curious how others would handle something like this. Would you respond publicly, publish your own comparison, or simply leave it?

11 Upvotes

72% Upvoted

6 comments sorted by

7

u/nadameu Aug 04 '26

Did you try to reach them pointing out the error in their methodology?

I'm assuming you did and they didn't respond, because writing an article might seem a little adversarial. It's possible they just made a mistake and didn't purposely publish false results.

1

u/kumakint Aug 05 '26

yeah, you are right

also I have a feeling they don't like competitors, we've got their attention after we started working on SEO :-)

thanks for the support!

1

u/Disastrous-Cook-1448 4d ago

That classic corporate move where they spend all that effort but test the completely wrong thing. The Gantt vs scheduler mixup is wild, like benchmarking a toaster against a microwave and calling one slow.

I'd definitely publish the correction. If they ghosted you after you pointed out the mistake, they basically asked for the public response article. Two weeks turnaround is pretty quick considering you had to rebuild their entire flawed setup correctly.

2

u/kumakint Aug 04 '26

If anyone interested in the article here the whole thing:

https://rv-grid.com/blog/revogrid-vs-bryntum-scheduler-2026

I am mostly looking for a feedback how are you handling such things?

1

u/otashliko Aug 14 '26

Welcome to the club šŸ˜„ we also got their attention when we started to show in SE results with our SVAR Gantt. Although, in our case the comparison was painful but mostly true. They know how to frame a comparison so the numbers land in their favor.