From 4ab7e453e26afc6e9f4938c65f89463fbba9e267 Mon Sep 17 00:00:00 2001 From: Albert Cervin Date: Fri, 23 Aug 2024 17:07:27 +0200 Subject: Overhaul unicode parsing It now instead iterates the actual unicode code points. This is better than what it was previously doing but it is still not entirely correct w.r.t to unicode sequences. This handling of unicode code points does however make it slightly easier to handle UTF-16 if needed in the future. This also adds some long needed tests for buffer methods. --- sune.txt | 4 ++++ 1 file changed, 4 insertions(+) create mode 100644 sune.txt (limited to 'sune.txt') diff --git a/sune.txt b/sune.txt new file mode 100644 index 0000000..711f7ee --- /dev/null +++ b/sune.txt @@ -0,0 +1,4 @@ +⬆️asd +🎠 aba +this is tab +🇫🇮 hej hej -- cgit v1.2.3