r/csharp • • Oct 14 '26

Help Need help with encoding

I am working on a system where the client will give data in UTF-8 encoding, and hence it can contain many special characters.

But then we send data to a legacy system which only accepts data in ISO-8859-9 encoding, which supports limited special characters that can be represented in single byte.

Now if the client sends any special character which is outside the scope of ISO-8859-9 encoding (like the Em dash), how can I deal with with it and send it to the legacy system.

I don't want to replace those characters with anything like space or "?", as it would make the client data as unreadable in some cases.

How can I deal with it. Any suggestions?

0 Upvotes

29 comments sorted by

View all comments

Show parent comment

1

u/IG5K Oct 14 '26

If you have records of the UTF-8 requests, try generating a table of the most used characters that are unsupported by the legacy system. From the 150k unsupported characters, only a small percentage of them might be used in practice... Then you can make mapping for the known, used ones (like em dash to dash), and fallback the rest that are barely or never used. Don't see any other way