GitLab

Minor change to SCSU encoder. If someone feeds us a byte-order mark (U+FEFF) as the first character of a stream, we encode it as SQU FE FF. This is recommended by revision 3.1 of Unicode Technical Report #6.

Version 0.44. Tagged as 'Unicode-0_44'

ISO 8859-8 is now ISO-IR 198 (05/14).

Version 0.43. Tagged as 'Unicode-0_43'

Improved handling of SIP ideographs.
Added ISO-8859-11 (csISOLatinThai).
Renamed Latin13 to Latin7.

Version 0.42. Tagged as 'Unicode-0_42'

UTF-8 encoder handles out-of-space conditions correctly.
ISO 2022 encoder/decoder doesn't try to load table 7E (the null table).
encoding_new() does identify a null MIME string with auto-detect Japanese.
UnicodeData 3.0.0 imported.

Version 0.41. Tagged as 'Unicode-0_41'

Changed default language of Latin-5 (ISO 8859-9) from English to Turkish.

Version 0.40. Tagged as 'Unicode-0_40'

Modified encoding.c so that Chinese encodings use the correct
country code as a secondary tag to the language code so that
we can distinguish Chinese Simplified and Traditional.

Version 0.39. Tagged as 'Unicode-0_39'

Fixed encoding_table_remove_unused() which totally failed to work correctly would most likely crash as soon as it tried to free any tables.

Verified that fixed version does work within branched.

Version 0.38. Tagged as 'Unicode-0_38'

Fixed encoding_new() so that it returns NULL if an encoding is chosen that does not have an encoding structure with it.

e.g. encoding 0 or AutoDetectJP.

Version 0.37. Tagged as 'Unicode-0_37'

Changed encoding_table_remove_unused() so that it takes a parameter giving the depth from which to start purging.

Fixed ISO2022 write code to free search tables.
Added unix.c for unix-targeted builds.
Updated cross-compile build.
Added unix-targeted build of library and textconv tool
in ccsolaris directory.

Version 0.36. Tagged as 'Unicode-0_36'

x-Current encoding didn't work if International 1.50 wasn't loaded.
Adjusted various ISO 2022 escape sequence tables to change prioritisation.
ISO 2022 writer won't shift character set until required.

Version 0.35. Tagged as 'Unicode-0_35'

Added encoding_set_flags().
Proper handling of byte order marks in UTF-16 and UCS-4.
Fixed UTF-16 surrogate writing.
Adjusted various MIME charset identifiers.
Incorporated latest Unicode Character Database (2.1.8).
Added "current system alphabet" encoding.
Created "TextConv" command line character set conversion utility.

Version 0.34. Tagged as 'Unicode-0_34'

Created new file riscos.c for RISC OS specific functions. Rest of library should remain portable. Moved function to load a map file into that new file. Added #defines for directory separator and wild card characters and updated the various file names.

Version 0.33. Tagged as 'Unicode-0_33'

DOS code page 866 (Russian) added.

Version 0.32. Tagged as 'Unicode-0_32'

More messing with the state machine - some state transitions were still totally wrong, causing some EUC pages to come up as Shift-JIS. Maybe this one will work?

Version 0.31. Tagged as 'Unicode-0_31'

Version 0.30. Tagged as 'Unicode-0_30'

Version 0.29. Tagged as 'Unicode-0_29'

Updated all the writers to ignore the NULL_UCS4 character (as had been previously added to the iso2022_escapes case). Any new writers should flush any pending characters they may have at this point.

Also udpated enc_UCS4.c and utf8.c to turn all illegal characeters
(top bit set) into FFFD.

Version 0.28. Tagged as 'Unicode-0_28'

Added new function encoding_default_mime_type() which given an encoding number returns the first mime type from the matching entry in the table.

Version 0.27. Tagged as 'Unicode-0_27'

Version 0.26. Tagged as 'Unicode-0_26'

Version 0.25. Tagged as 'Unicode-0_25'

Version 0.24. Tagged as 'Unicode-0_24'

Changed Shift-JIS 7-bit set to match MS CP932. It is now ASCII, except that character &5C is yen instead of backslash.

Version 0.23. Tagged as 'Unicode-0_23'

Version 0.22. Tagged as 'Unicode-0_22'

Version 0.21. Tagged as 'Unicode-0_21'

Version 0.20. Tagged as 'Unicode-0_20'

Version 0.19. Tagged as 'Unicode-0_19'

Version 0.18. Tagged as 'Unicode-0_18'

Version 0.16. Tagged as 'Unicode-0_16'

Version 0.15. Tagged as 'Unicode-0_15'

Version 0.14. Tagged as 'Unicode-0_14'

Fixed Big5 encoding_write (checked for !cc rather than cc).
Removed unictype.c which is built from mkunictype.

Version 0.13. Tagged as 'Unicode-0_13'

Fixed autojp state machine. It wasn't resetting 'state' to HAD_NONE after changing whatcode. So basically it was lucky it ever worked. Also rewrote the various range tests to only use one compare per case.

Changed the 'for_encoding' parameter to encoding_write() to an enumeration.
Added a new type of writing where if the character cannot be encoded then
the function returns -1 rather than writing a default character
Added the pseudo-charsets csAutodetectJP and csEUCorShiftJIS to the encoding
table so that they return the correct default language (ja).
Added function to remove unused encoding tables (must be called explicitly).
Fixed usage counting in iso2022 (I think).
When looking up encoding name try stripping 'x-' and 'X-' off the front i
can't find on first pass.

Version 0.12. Tagged as 'Unicode-0_12'

It also now assumes that the first write encoding is already set up.

Version 0.10. Tagged as 'Unicode-0_10'

Version 0.09. Tagged as 'Unicode-0_09'

Fixed when SS1 or SS2 followed by a set change by disallowing controlcharacters after single shifts.

Made encoding_table_ptr and encoding_n_table_entries check for null tables.
moved 'Lm' type characters from marks to letters in mkunictype.

Version 0.08. Tagged as 'Unicode-0_08'

Acorn Latin1 encoding using fuzzy mapping to get the greatest number
of displayable characters. Reads as Acorn.Latin1.

Version 0.07. Tagged as 'Unicode-0_07'

Version 0.06. Tagged as 'Unicode-0_06'

Fixed bug in checking the buffer size available for writing (postindex decrement rather than preindex).

Only affected the 8bit encoders.

Version 0.05. Tagged as 'Unicode-0_05'

Added a default language field to each encoding (using above codes).
Added a max char size field to each encoding.
Tidied up some of the reencoders behaviour when output ptr NULL.
Fixed a load of charset numbers which were wrong.
New UTF8 function to skiop multiple characters in a string.
Fixed RISC OS build which was out of date.

Version 0.04. Tagged as 'Unicode-0_04'

Made all tables be on linked list to avoid static copies of pointers.
Removed redundant 8bit files.

Version 0.03. Tagged as 'Unicode-0_03'