Java Code Examples for sun.text.normalizer.NormalizerImpl
The following examples show how to use
sun.text.normalizer.NormalizerImpl.
These examples are extracted from open source projects.
You can vote up the ones you like or vote down the ones you don't like,
and go to the original project or source file by following the links above each example. You may check out the related API usage on the sidebar.
Example #1
Source Project: dragonwell8_jdk Author: alibaba File: StringPrep.java License: GNU General Public License v2.0 | 6 votes |
private StringBuffer normalize(StringBuffer src){ /* * Option UNORM_BEFORE_PRI_29: * * IDNA as interpreted by IETF members (see unicode mailing list 2004H1) * requires strict adherence to Unicode 3.2 normalization, * including buggy composition from before fixing Public Review Issue #29. * Note that this results in some valid but nonsensical text to be * either corrupted or rejected, depending on the text. * See http://www.unicode.org/review/resolved-pri.html#pri29 * See unorm.cpp and cnormtst.c */ return new StringBuffer( Normalizer.normalize( src.toString(), java.text.Normalizer.Form.NFKC, Normalizer.UNICODE_3_2|NormalizerImpl.BEFORE_PRI_29)); }
Example #2
Source Project: TencentKona-8 Author: Tencent File: StringPrep.java License: GNU General Public License v2.0 | 6 votes |
private StringBuffer normalize(StringBuffer src){ /* * Option UNORM_BEFORE_PRI_29: * * IDNA as interpreted by IETF members (see unicode mailing list 2004H1) * requires strict adherence to Unicode 3.2 normalization, * including buggy composition from before fixing Public Review Issue #29. * Note that this results in some valid but nonsensical text to be * either corrupted or rejected, depending on the text. * See http://www.unicode.org/review/resolved-pri.html#pri29 * See unorm.cpp and cnormtst.c */ return new StringBuffer( Normalizer.normalize( src.toString(), java.text.Normalizer.Form.NFKC, Normalizer.UNICODE_3_2|NormalizerImpl.BEFORE_PRI_29)); }
Example #3
Source Project: jdk8u60 Author: chenghanpeng File: StringPrep.java License: GNU General Public License v2.0 | 6 votes |
private StringBuffer normalize(StringBuffer src){ /* * Option UNORM_BEFORE_PRI_29: * * IDNA as interpreted by IETF members (see unicode mailing list 2004H1) * requires strict adherence to Unicode 3.2 normalization, * including buggy composition from before fixing Public Review Issue #29. * Note that this results in some valid but nonsensical text to be * either corrupted or rejected, depending on the text. * See http://www.unicode.org/review/resolved-pri.html#pri29 * See unorm.cpp and cnormtst.c */ return new StringBuffer( Normalizer.normalize( src.toString(), java.text.Normalizer.Form.NFKC, Normalizer.UNICODE_3_2|NormalizerImpl.BEFORE_PRI_29)); }
Example #4
Source Project: openjdk-jdk8u Author: AdoptOpenJDK File: StringPrep.java License: GNU General Public License v2.0 | 6 votes |
private StringBuffer normalize(StringBuffer src){ /* * Option UNORM_BEFORE_PRI_29: * * IDNA as interpreted by IETF members (see unicode mailing list 2004H1) * requires strict adherence to Unicode 3.2 normalization, * including buggy composition from before fixing Public Review Issue #29. * Note that this results in some valid but nonsensical text to be * either corrupted or rejected, depending on the text. * See http://www.unicode.org/review/resolved-pri.html#pri29 * See unorm.cpp and cnormtst.c */ return new StringBuffer( Normalizer.normalize( src.toString(), java.text.Normalizer.Form.NFKC, Normalizer.UNICODE_3_2|NormalizerImpl.BEFORE_PRI_29)); }
Example #5
Source Project: openjdk-jdk8u-backup Author: AdoptOpenJDK File: StringPrep.java License: GNU General Public License v2.0 | 6 votes |
private StringBuffer normalize(StringBuffer src){ /* * Option UNORM_BEFORE_PRI_29: * * IDNA as interpreted by IETF members (see unicode mailing list 2004H1) * requires strict adherence to Unicode 3.2 normalization, * including buggy composition from before fixing Public Review Issue #29. * Note that this results in some valid but nonsensical text to be * either corrupted or rejected, depending on the text. * See http://www.unicode.org/review/resolved-pri.html#pri29 * See unorm.cpp and cnormtst.c */ return new StringBuffer( Normalizer.normalize( src.toString(), java.text.Normalizer.Form.NFKC, Normalizer.UNICODE_3_2|NormalizerImpl.BEFORE_PRI_29)); }
Example #6
Source Project: jdk8u-jdk Author: lambdalab-mirror File: StringPrep.java License: GNU General Public License v2.0 | 6 votes |
private StringBuffer normalize(StringBuffer src){ /* * Option UNORM_BEFORE_PRI_29: * * IDNA as interpreted by IETF members (see unicode mailing list 2004H1) * requires strict adherence to Unicode 3.2 normalization, * including buggy composition from before fixing Public Review Issue #29. * Note that this results in some valid but nonsensical text to be * either corrupted or rejected, depending on the text. * See http://www.unicode.org/review/resolved-pri.html#pri29 * See unorm.cpp and cnormtst.c */ return new StringBuffer( Normalizer.normalize( src.toString(), java.text.Normalizer.Form.NFKC, Normalizer.UNICODE_3_2|NormalizerImpl.BEFORE_PRI_29)); }
Example #7
Source Project: hottub Author: dsrg-uoft File: StringPrep.java License: GNU General Public License v2.0 | 6 votes |
private StringBuffer normalize(StringBuffer src){ /* * Option UNORM_BEFORE_PRI_29: * * IDNA as interpreted by IETF members (see unicode mailing list 2004H1) * requires strict adherence to Unicode 3.2 normalization, * including buggy composition from before fixing Public Review Issue #29. * Note that this results in some valid but nonsensical text to be * either corrupted or rejected, depending on the text. * See http://www.unicode.org/review/resolved-pri.html#pri29 * See unorm.cpp and cnormtst.c */ return new StringBuffer( Normalizer.normalize( src.toString(), java.text.Normalizer.Form.NFKC, Normalizer.UNICODE_3_2|NormalizerImpl.BEFORE_PRI_29)); }
Example #8
Source Project: openjdk-8-source Author: keerath File: StringPrep.java License: GNU General Public License v2.0 | 6 votes |
private StringBuffer normalize(StringBuffer src){ /* * Option UNORM_BEFORE_PRI_29: * * IDNA as interpreted by IETF members (see unicode mailing list 2004H1) * requires strict adherence to Unicode 3.2 normalization, * including buggy composition from before fixing Public Review Issue #29. * Note that this results in some valid but nonsensical text to be * either corrupted or rejected, depending on the text. * See http://www.unicode.org/review/resolved-pri.html#pri29 * See unorm.cpp and cnormtst.c */ return new StringBuffer( Normalizer.normalize( src.toString(), java.text.Normalizer.Form.NFKC, Normalizer.UNICODE_3_2|NormalizerImpl.BEFORE_PRI_29)); }
Example #9
Source Project: openjdk-8 Author: bpupadhyaya File: StringPrep.java License: GNU General Public License v2.0 | 6 votes |
private StringBuffer normalize(StringBuffer src){ /* * Option UNORM_BEFORE_PRI_29: * * IDNA as interpreted by IETF members (see unicode mailing list 2004H1) * requires strict adherence to Unicode 3.2 normalization, * including buggy composition from before fixing Public Review Issue #29. * Note that this results in some valid but nonsensical text to be * either corrupted or rejected, depending on the text. * See http://www.unicode.org/review/resolved-pri.html#pri29 * See unorm.cpp and cnormtst.c */ return new StringBuffer( Normalizer.normalize( src.toString(), java.text.Normalizer.Form.NFKC, Normalizer.UNICODE_3_2|NormalizerImpl.BEFORE_PRI_29)); }
Example #10
Source Project: jdk8u_jdk Author: JetBrains File: StringPrep.java License: GNU General Public License v2.0 | 6 votes |
private StringBuffer normalize(StringBuffer src){ /* * Option UNORM_BEFORE_PRI_29: * * IDNA as interpreted by IETF members (see unicode mailing list 2004H1) * requires strict adherence to Unicode 3.2 normalization, * including buggy composition from before fixing Public Review Issue #29. * Note that this results in some valid but nonsensical text to be * either corrupted or rejected, depending on the text. * See http://www.unicode.org/review/resolved-pri.html#pri29 * See unorm.cpp and cnormtst.c */ return new StringBuffer( Normalizer.normalize( src.toString(), java.text.Normalizer.Form.NFKC, Normalizer.UNICODE_3_2|NormalizerImpl.BEFORE_PRI_29)); }
Example #11
Source Project: jdk8u-jdk Author: frohoff File: StringPrep.java License: GNU General Public License v2.0 | 6 votes |
private StringBuffer normalize(StringBuffer src){ /* * Option UNORM_BEFORE_PRI_29: * * IDNA as interpreted by IETF members (see unicode mailing list 2004H1) * requires strict adherence to Unicode 3.2 normalization, * including buggy composition from before fixing Public Review Issue #29. * Note that this results in some valid but nonsensical text to be * either corrupted or rejected, depending on the text. * See http://www.unicode.org/review/resolved-pri.html#pri29 * See unorm.cpp and cnormtst.c */ return new StringBuffer( Normalizer.normalize( src.toString(), java.text.Normalizer.Form.NFKC, Normalizer.UNICODE_3_2|NormalizerImpl.BEFORE_PRI_29)); }
Example #12
Source Project: jdk8u-dev-jdk Author: frohoff File: StringPrep.java License: GNU General Public License v2.0 | 6 votes |
private StringBuffer normalize(StringBuffer src){ /* * Option UNORM_BEFORE_PRI_29: * * IDNA as interpreted by IETF members (see unicode mailing list 2004H1) * requires strict adherence to Unicode 3.2 normalization, * including buggy composition from before fixing Public Review Issue #29. * Note that this results in some valid but nonsensical text to be * either corrupted or rejected, depending on the text. * See http://www.unicode.org/review/resolved-pri.html#pri29 * See unorm.cpp and cnormtst.c */ return new StringBuffer( Normalizer.normalize( src.toString(), java.text.Normalizer.Form.NFKC, Normalizer.UNICODE_3_2|NormalizerImpl.BEFORE_PRI_29)); }
Example #13
Source Project: dragonwell8_jdk Author: alibaba File: StringPrep.java License: GNU General Public License v2.0 | 5 votes |
/** * Creates an StringPrep object after reading the input stream. * The object does not hold a reference to the input steam, so the stream can be * closed after the method returns. * * @param inputStream The stream for reading the StringPrep profile binarySun * @throws IOException * @draft ICU 2.8 */ public StringPrep(InputStream inputStream) throws IOException{ BufferedInputStream b = new BufferedInputStream(inputStream,DATA_BUFFER_SIZE); StringPrepDataReader reader = new StringPrepDataReader(b); // read the indexes indexes = reader.readIndexes(INDEX_TOP); byte[] sprepBytes = new byte[indexes[INDEX_TRIE_SIZE]]; //indexes[INDEX_MAPPING_DATA_SIZE] store the size of mappingData in bytes mappingData = new char[indexes[INDEX_MAPPING_DATA_SIZE]/2]; // load the rest of the data data and initialize the data members reader.read(sprepBytes,mappingData); sprepTrieImpl = new StringPrepTrieImpl(); sprepTrieImpl.sprepTrie = new CharTrie( new ByteArrayInputStream(sprepBytes),sprepTrieImpl ); // get the data format version formatVersion = reader.getDataFormatVersion(); // get the options doNFKC = ((indexes[OPTIONS] & NORMALIZATION_ON) > 0); checkBiDi = ((indexes[OPTIONS] & CHECK_BIDI_ON) > 0); sprepUniVer = getVersionInfo(reader.getUnicodeVersion()); normCorrVer = getVersionInfo(indexes[NORM_CORRECTNS_LAST_UNI_VERSION]); VersionInfo normUniVer = NormalizerImpl.getUnicodeVersion(); if(normUniVer.compareTo(sprepUniVer) < 0 && /* the Unicode version of SPREP file must be less than the Unicode Vesion of the normalization data */ normUniVer.compareTo(normCorrVer) < 0 && /* the Unicode version of the NormalizationCorrections.txt file should be less than the Unicode Vesion of the normalization data */ ((indexes[OPTIONS] & NORMALIZATION_ON) > 0) /* normalization turned on*/ ){ throw new IOException("Normalization Correction version not supported"); } b.close(); }
Example #14
Source Project: TencentKona-8 Author: Tencent File: StringPrep.java License: GNU General Public License v2.0 | 5 votes |
/** * Creates an StringPrep object after reading the input stream. * The object does not hold a reference to the input steam, so the stream can be * closed after the method returns. * * @param inputStream The stream for reading the StringPrep profile binarySun * @throws IOException * @draft ICU 2.8 */ public StringPrep(InputStream inputStream) throws IOException{ BufferedInputStream b = new BufferedInputStream(inputStream,DATA_BUFFER_SIZE); StringPrepDataReader reader = new StringPrepDataReader(b); // read the indexes indexes = reader.readIndexes(INDEX_TOP); byte[] sprepBytes = new byte[indexes[INDEX_TRIE_SIZE]]; //indexes[INDEX_MAPPING_DATA_SIZE] store the size of mappingData in bytes mappingData = new char[indexes[INDEX_MAPPING_DATA_SIZE]/2]; // load the rest of the data data and initialize the data members reader.read(sprepBytes,mappingData); sprepTrieImpl = new StringPrepTrieImpl(); sprepTrieImpl.sprepTrie = new CharTrie( new ByteArrayInputStream(sprepBytes),sprepTrieImpl ); // get the data format version formatVersion = reader.getDataFormatVersion(); // get the options doNFKC = ((indexes[OPTIONS] & NORMALIZATION_ON) > 0); checkBiDi = ((indexes[OPTIONS] & CHECK_BIDI_ON) > 0); sprepUniVer = getVersionInfo(reader.getUnicodeVersion()); normCorrVer = getVersionInfo(indexes[NORM_CORRECTNS_LAST_UNI_VERSION]); VersionInfo normUniVer = NormalizerImpl.getUnicodeVersion(); if(normUniVer.compareTo(sprepUniVer) < 0 && /* the Unicode version of SPREP file must be less than the Unicode Vesion of the normalization data */ normUniVer.compareTo(normCorrVer) < 0 && /* the Unicode version of the NormalizationCorrections.txt file should be less than the Unicode Vesion of the normalization data */ ((indexes[OPTIONS] & NORMALIZATION_ON) > 0) /* normalization turned on*/ ){ throw new IOException("Normalization Correction version not supported"); } b.close(); }
Example #15
Source Project: jdk8u60 Author: chenghanpeng File: StringPrep.java License: GNU General Public License v2.0 | 5 votes |
/** * Creates an StringPrep object after reading the input stream. * The object does not hold a reference to the input steam, so the stream can be * closed after the method returns. * * @param inputStream The stream for reading the StringPrep profile binarySun * @throws IOException * @draft ICU 2.8 */ public StringPrep(InputStream inputStream) throws IOException{ BufferedInputStream b = new BufferedInputStream(inputStream,DATA_BUFFER_SIZE); StringPrepDataReader reader = new StringPrepDataReader(b); // read the indexes indexes = reader.readIndexes(INDEX_TOP); byte[] sprepBytes = new byte[indexes[INDEX_TRIE_SIZE]]; //indexes[INDEX_MAPPING_DATA_SIZE] store the size of mappingData in bytes mappingData = new char[indexes[INDEX_MAPPING_DATA_SIZE]/2]; // load the rest of the data data and initialize the data members reader.read(sprepBytes,mappingData); sprepTrieImpl = new StringPrepTrieImpl(); sprepTrieImpl.sprepTrie = new CharTrie( new ByteArrayInputStream(sprepBytes),sprepTrieImpl ); // get the data format version formatVersion = reader.getDataFormatVersion(); // get the options doNFKC = ((indexes[OPTIONS] & NORMALIZATION_ON) > 0); checkBiDi = ((indexes[OPTIONS] & CHECK_BIDI_ON) > 0); sprepUniVer = getVersionInfo(reader.getUnicodeVersion()); normCorrVer = getVersionInfo(indexes[NORM_CORRECTNS_LAST_UNI_VERSION]); VersionInfo normUniVer = NormalizerImpl.getUnicodeVersion(); if(normUniVer.compareTo(sprepUniVer) < 0 && /* the Unicode version of SPREP file must be less than the Unicode Vesion of the normalization data */ normUniVer.compareTo(normCorrVer) < 0 && /* the Unicode version of the NormalizationCorrections.txt file should be less than the Unicode Vesion of the normalization data */ ((indexes[OPTIONS] & NORMALIZATION_ON) > 0) /* normalization turned on*/ ){ throw new IOException("Normalization Correction version not supported"); } b.close(); }
Example #16
Source Project: openjdk-jdk8u Author: AdoptOpenJDK File: StringPrep.java License: GNU General Public License v2.0 | 5 votes |
/** * Creates an StringPrep object after reading the input stream. * The object does not hold a reference to the input steam, so the stream can be * closed after the method returns. * * @param inputStream The stream for reading the StringPrep profile binarySun * @throws IOException * @draft ICU 2.8 */ public StringPrep(InputStream inputStream) throws IOException{ BufferedInputStream b = new BufferedInputStream(inputStream,DATA_BUFFER_SIZE); StringPrepDataReader reader = new StringPrepDataReader(b); // read the indexes indexes = reader.readIndexes(INDEX_TOP); byte[] sprepBytes = new byte[indexes[INDEX_TRIE_SIZE]]; //indexes[INDEX_MAPPING_DATA_SIZE] store the size of mappingData in bytes mappingData = new char[indexes[INDEX_MAPPING_DATA_SIZE]/2]; // load the rest of the data data and initialize the data members reader.read(sprepBytes,mappingData); sprepTrieImpl = new StringPrepTrieImpl(); sprepTrieImpl.sprepTrie = new CharTrie( new ByteArrayInputStream(sprepBytes),sprepTrieImpl ); // get the data format version formatVersion = reader.getDataFormatVersion(); // get the options doNFKC = ((indexes[OPTIONS] & NORMALIZATION_ON) > 0); checkBiDi = ((indexes[OPTIONS] & CHECK_BIDI_ON) > 0); sprepUniVer = getVersionInfo(reader.getUnicodeVersion()); normCorrVer = getVersionInfo(indexes[NORM_CORRECTNS_LAST_UNI_VERSION]); VersionInfo normUniVer = NormalizerImpl.getUnicodeVersion(); if(normUniVer.compareTo(sprepUniVer) < 0 && /* the Unicode version of SPREP file must be less than the Unicode Vesion of the normalization data */ normUniVer.compareTo(normCorrVer) < 0 && /* the Unicode version of the NormalizationCorrections.txt file should be less than the Unicode Vesion of the normalization data */ ((indexes[OPTIONS] & NORMALIZATION_ON) > 0) /* normalization turned on*/ ){ throw new IOException("Normalization Correction version not supported"); } b.close(); }
Example #17
Source Project: openjdk-jdk8u-backup Author: AdoptOpenJDK File: StringPrep.java License: GNU General Public License v2.0 | 5 votes |
/** * Creates an StringPrep object after reading the input stream. * The object does not hold a reference to the input steam, so the stream can be * closed after the method returns. * * @param inputStream The stream for reading the StringPrep profile binarySun * @throws IOException * @draft ICU 2.8 */ public StringPrep(InputStream inputStream) throws IOException{ BufferedInputStream b = new BufferedInputStream(inputStream,DATA_BUFFER_SIZE); StringPrepDataReader reader = new StringPrepDataReader(b); // read the indexes indexes = reader.readIndexes(INDEX_TOP); byte[] sprepBytes = new byte[indexes[INDEX_TRIE_SIZE]]; //indexes[INDEX_MAPPING_DATA_SIZE] store the size of mappingData in bytes mappingData = new char[indexes[INDEX_MAPPING_DATA_SIZE]/2]; // load the rest of the data data and initialize the data members reader.read(sprepBytes,mappingData); sprepTrieImpl = new StringPrepTrieImpl(); sprepTrieImpl.sprepTrie = new CharTrie( new ByteArrayInputStream(sprepBytes),sprepTrieImpl ); // get the data format version formatVersion = reader.getDataFormatVersion(); // get the options doNFKC = ((indexes[OPTIONS] & NORMALIZATION_ON) > 0); checkBiDi = ((indexes[OPTIONS] & CHECK_BIDI_ON) > 0); sprepUniVer = getVersionInfo(reader.getUnicodeVersion()); normCorrVer = getVersionInfo(indexes[NORM_CORRECTNS_LAST_UNI_VERSION]); VersionInfo normUniVer = NormalizerImpl.getUnicodeVersion(); if(normUniVer.compareTo(sprepUniVer) < 0 && /* the Unicode version of SPREP file must be less than the Unicode Vesion of the normalization data */ normUniVer.compareTo(normCorrVer) < 0 && /* the Unicode version of the NormalizationCorrections.txt file should be less than the Unicode Vesion of the normalization data */ ((indexes[OPTIONS] & NORMALIZATION_ON) > 0) /* normalization turned on*/ ){ throw new IOException("Normalization Correction version not supported"); } b.close(); }
Example #18
Source Project: jdk8u-jdk Author: lambdalab-mirror File: StringPrep.java License: GNU General Public License v2.0 | 5 votes |
/** * Creates an StringPrep object after reading the input stream. * The object does not hold a reference to the input steam, so the stream can be * closed after the method returns. * * @param inputStream The stream for reading the StringPrep profile binarySun * @throws IOException * @draft ICU 2.8 */ public StringPrep(InputStream inputStream) throws IOException{ BufferedInputStream b = new BufferedInputStream(inputStream,DATA_BUFFER_SIZE); StringPrepDataReader reader = new StringPrepDataReader(b); // read the indexes indexes = reader.readIndexes(INDEX_TOP); byte[] sprepBytes = new byte[indexes[INDEX_TRIE_SIZE]]; //indexes[INDEX_MAPPING_DATA_SIZE] store the size of mappingData in bytes mappingData = new char[indexes[INDEX_MAPPING_DATA_SIZE]/2]; // load the rest of the data data and initialize the data members reader.read(sprepBytes,mappingData); sprepTrieImpl = new StringPrepTrieImpl(); sprepTrieImpl.sprepTrie = new CharTrie( new ByteArrayInputStream(sprepBytes),sprepTrieImpl ); // get the data format version formatVersion = reader.getDataFormatVersion(); // get the options doNFKC = ((indexes[OPTIONS] & NORMALIZATION_ON) > 0); checkBiDi = ((indexes[OPTIONS] & CHECK_BIDI_ON) > 0); sprepUniVer = getVersionInfo(reader.getUnicodeVersion()); normCorrVer = getVersionInfo(indexes[NORM_CORRECTNS_LAST_UNI_VERSION]); VersionInfo normUniVer = NormalizerImpl.getUnicodeVersion(); if(normUniVer.compareTo(sprepUniVer) < 0 && /* the Unicode version of SPREP file must be less than the Unicode Vesion of the normalization data */ normUniVer.compareTo(normCorrVer) < 0 && /* the Unicode version of the NormalizationCorrections.txt file should be less than the Unicode Vesion of the normalization data */ ((indexes[OPTIONS] & NORMALIZATION_ON) > 0) /* normalization turned on*/ ){ throw new IOException("Normalization Correction version not supported"); } b.close(); }
Example #19
Source Project: hottub Author: dsrg-uoft File: StringPrep.java License: GNU General Public License v2.0 | 5 votes |
/** * Creates an StringPrep object after reading the input stream. * The object does not hold a reference to the input steam, so the stream can be * closed after the method returns. * * @param inputStream The stream for reading the StringPrep profile binarySun * @throws IOException * @draft ICU 2.8 */ public StringPrep(InputStream inputStream) throws IOException{ BufferedInputStream b = new BufferedInputStream(inputStream,DATA_BUFFER_SIZE); StringPrepDataReader reader = new StringPrepDataReader(b); // read the indexes indexes = reader.readIndexes(INDEX_TOP); byte[] sprepBytes = new byte[indexes[INDEX_TRIE_SIZE]]; //indexes[INDEX_MAPPING_DATA_SIZE] store the size of mappingData in bytes mappingData = new char[indexes[INDEX_MAPPING_DATA_SIZE]/2]; // load the rest of the data data and initialize the data members reader.read(sprepBytes,mappingData); sprepTrieImpl = new StringPrepTrieImpl(); sprepTrieImpl.sprepTrie = new CharTrie( new ByteArrayInputStream(sprepBytes),sprepTrieImpl ); // get the data format version formatVersion = reader.getDataFormatVersion(); // get the options doNFKC = ((indexes[OPTIONS] & NORMALIZATION_ON) > 0); checkBiDi = ((indexes[OPTIONS] & CHECK_BIDI_ON) > 0); sprepUniVer = getVersionInfo(reader.getUnicodeVersion()); normCorrVer = getVersionInfo(indexes[NORM_CORRECTNS_LAST_UNI_VERSION]); VersionInfo normUniVer = NormalizerImpl.getUnicodeVersion(); if(normUniVer.compareTo(sprepUniVer) < 0 && /* the Unicode version of SPREP file must be less than the Unicode Vesion of the normalization data */ normUniVer.compareTo(normCorrVer) < 0 && /* the Unicode version of the NormalizationCorrections.txt file should be less than the Unicode Vesion of the normalization data */ ((indexes[OPTIONS] & NORMALIZATION_ON) > 0) /* normalization turned on*/ ){ throw new IOException("Normalization Correction version not supported"); } b.close(); }
Example #20
Source Project: openjdk-8-source Author: keerath File: StringPrep.java License: GNU General Public License v2.0 | 5 votes |
/** * Creates an StringPrep object after reading the input stream. * The object does not hold a reference to the input steam, so the stream can be * closed after the method returns. * * @param inputStream The stream for reading the StringPrep profile binarySun * @throws IOException * @draft ICU 2.8 */ public StringPrep(InputStream inputStream) throws IOException{ BufferedInputStream b = new BufferedInputStream(inputStream,DATA_BUFFER_SIZE); StringPrepDataReader reader = new StringPrepDataReader(b); // read the indexes indexes = reader.readIndexes(INDEX_TOP); byte[] sprepBytes = new byte[indexes[INDEX_TRIE_SIZE]]; //indexes[INDEX_MAPPING_DATA_SIZE] store the size of mappingData in bytes mappingData = new char[indexes[INDEX_MAPPING_DATA_SIZE]/2]; // load the rest of the data data and initialize the data members reader.read(sprepBytes,mappingData); sprepTrieImpl = new StringPrepTrieImpl(); sprepTrieImpl.sprepTrie = new CharTrie( new ByteArrayInputStream(sprepBytes),sprepTrieImpl ); // get the data format version formatVersion = reader.getDataFormatVersion(); // get the options doNFKC = ((indexes[OPTIONS] & NORMALIZATION_ON) > 0); checkBiDi = ((indexes[OPTIONS] & CHECK_BIDI_ON) > 0); sprepUniVer = getVersionInfo(reader.getUnicodeVersion()); normCorrVer = getVersionInfo(indexes[NORM_CORRECTNS_LAST_UNI_VERSION]); VersionInfo normUniVer = NormalizerImpl.getUnicodeVersion(); if(normUniVer.compareTo(sprepUniVer) < 0 && /* the Unicode version of SPREP file must be less than the Unicode Vesion of the normalization data */ normUniVer.compareTo(normCorrVer) < 0 && /* the Unicode version of the NormalizationCorrections.txt file should be less than the Unicode Vesion of the normalization data */ ((indexes[OPTIONS] & NORMALIZATION_ON) > 0) /* normalization turned on*/ ){ throw new IOException("Normalization Correction version not supported"); } b.close(); }
Example #21
Source Project: openjdk-8 Author: bpupadhyaya File: StringPrep.java License: GNU General Public License v2.0 | 5 votes |
/** * Creates an StringPrep object after reading the input stream. * The object does not hold a reference to the input steam, so the stream can be * closed after the method returns. * * @param inputStream The stream for reading the StringPrep profile binarySun * @throws IOException * @draft ICU 2.8 */ public StringPrep(InputStream inputStream) throws IOException{ BufferedInputStream b = new BufferedInputStream(inputStream,DATA_BUFFER_SIZE); StringPrepDataReader reader = new StringPrepDataReader(b); // read the indexes indexes = reader.readIndexes(INDEX_TOP); byte[] sprepBytes = new byte[indexes[INDEX_TRIE_SIZE]]; //indexes[INDEX_MAPPING_DATA_SIZE] store the size of mappingData in bytes mappingData = new char[indexes[INDEX_MAPPING_DATA_SIZE]/2]; // load the rest of the data data and initialize the data members reader.read(sprepBytes,mappingData); sprepTrieImpl = new StringPrepTrieImpl(); sprepTrieImpl.sprepTrie = new CharTrie( new ByteArrayInputStream(sprepBytes),sprepTrieImpl ); // get the data format version formatVersion = reader.getDataFormatVersion(); // get the options doNFKC = ((indexes[OPTIONS] & NORMALIZATION_ON) > 0); checkBiDi = ((indexes[OPTIONS] & CHECK_BIDI_ON) > 0); sprepUniVer = getVersionInfo(reader.getUnicodeVersion()); normCorrVer = getVersionInfo(indexes[NORM_CORRECTNS_LAST_UNI_VERSION]); VersionInfo normUniVer = NormalizerImpl.getUnicodeVersion(); if(normUniVer.compareTo(sprepUniVer) < 0 && /* the Unicode version of SPREP file must be less than the Unicode Vesion of the normalization data */ normUniVer.compareTo(normCorrVer) < 0 && /* the Unicode version of the NormalizationCorrections.txt file should be less than the Unicode Vesion of the normalization data */ ((indexes[OPTIONS] & NORMALIZATION_ON) > 0) /* normalization turned on*/ ){ throw new IOException("Normalization Correction version not supported"); } b.close(); }
Example #22
Source Project: jdk8u_jdk Author: JetBrains File: StringPrep.java License: GNU General Public License v2.0 | 5 votes |
/** * Creates an StringPrep object after reading the input stream. * The object does not hold a reference to the input steam, so the stream can be * closed after the method returns. * * @param inputStream The stream for reading the StringPrep profile binarySun * @throws IOException * @draft ICU 2.8 */ public StringPrep(InputStream inputStream) throws IOException{ BufferedInputStream b = new BufferedInputStream(inputStream,DATA_BUFFER_SIZE); StringPrepDataReader reader = new StringPrepDataReader(b); // read the indexes indexes = reader.readIndexes(INDEX_TOP); byte[] sprepBytes = new byte[indexes[INDEX_TRIE_SIZE]]; //indexes[INDEX_MAPPING_DATA_SIZE] store the size of mappingData in bytes mappingData = new char[indexes[INDEX_MAPPING_DATA_SIZE]/2]; // load the rest of the data data and initialize the data members reader.read(sprepBytes,mappingData); sprepTrieImpl = new StringPrepTrieImpl(); sprepTrieImpl.sprepTrie = new CharTrie( new ByteArrayInputStream(sprepBytes),sprepTrieImpl ); // get the data format version formatVersion = reader.getDataFormatVersion(); // get the options doNFKC = ((indexes[OPTIONS] & NORMALIZATION_ON) > 0); checkBiDi = ((indexes[OPTIONS] & CHECK_BIDI_ON) > 0); sprepUniVer = getVersionInfo(reader.getUnicodeVersion()); normCorrVer = getVersionInfo(indexes[NORM_CORRECTNS_LAST_UNI_VERSION]); VersionInfo normUniVer = NormalizerImpl.getUnicodeVersion(); if(normUniVer.compareTo(sprepUniVer) < 0 && /* the Unicode version of SPREP file must be less than the Unicode Vesion of the normalization data */ normUniVer.compareTo(normCorrVer) < 0 && /* the Unicode version of the NormalizationCorrections.txt file should be less than the Unicode Vesion of the normalization data */ ((indexes[OPTIONS] & NORMALIZATION_ON) > 0) /* normalization turned on*/ ){ throw new IOException("Normalization Correction version not supported"); } b.close(); }
Example #23
Source Project: jdk8u-jdk Author: frohoff File: StringPrep.java License: GNU General Public License v2.0 | 5 votes |
/** * Creates an StringPrep object after reading the input stream. * The object does not hold a reference to the input steam, so the stream can be * closed after the method returns. * * @param inputStream The stream for reading the StringPrep profile binarySun * @throws IOException * @draft ICU 2.8 */ public StringPrep(InputStream inputStream) throws IOException{ BufferedInputStream b = new BufferedInputStream(inputStream,DATA_BUFFER_SIZE); StringPrepDataReader reader = new StringPrepDataReader(b); // read the indexes indexes = reader.readIndexes(INDEX_TOP); byte[] sprepBytes = new byte[indexes[INDEX_TRIE_SIZE]]; //indexes[INDEX_MAPPING_DATA_SIZE] store the size of mappingData in bytes mappingData = new char[indexes[INDEX_MAPPING_DATA_SIZE]/2]; // load the rest of the data data and initialize the data members reader.read(sprepBytes,mappingData); sprepTrieImpl = new StringPrepTrieImpl(); sprepTrieImpl.sprepTrie = new CharTrie( new ByteArrayInputStream(sprepBytes),sprepTrieImpl ); // get the data format version formatVersion = reader.getDataFormatVersion(); // get the options doNFKC = ((indexes[OPTIONS] & NORMALIZATION_ON) > 0); checkBiDi = ((indexes[OPTIONS] & CHECK_BIDI_ON) > 0); sprepUniVer = getVersionInfo(reader.getUnicodeVersion()); normCorrVer = getVersionInfo(indexes[NORM_CORRECTNS_LAST_UNI_VERSION]); VersionInfo normUniVer = NormalizerImpl.getUnicodeVersion(); if(normUniVer.compareTo(sprepUniVer) < 0 && /* the Unicode version of SPREP file must be less than the Unicode Vesion of the normalization data */ normUniVer.compareTo(normCorrVer) < 0 && /* the Unicode version of the NormalizationCorrections.txt file should be less than the Unicode Vesion of the normalization data */ ((indexes[OPTIONS] & NORMALIZATION_ON) > 0) /* normalization turned on*/ ){ throw new IOException("Normalization Correction version not supported"); } b.close(); }
Example #24
Source Project: jdk8u-dev-jdk Author: frohoff File: StringPrep.java License: GNU General Public License v2.0 | 5 votes |
/** * Creates an StringPrep object after reading the input stream. * The object does not hold a reference to the input steam, so the stream can be * closed after the method returns. * * @param inputStream The stream for reading the StringPrep profile binarySun * @throws IOException * @draft ICU 2.8 */ public StringPrep(InputStream inputStream) throws IOException{ BufferedInputStream b = new BufferedInputStream(inputStream,DATA_BUFFER_SIZE); StringPrepDataReader reader = new StringPrepDataReader(b); // read the indexes indexes = reader.readIndexes(INDEX_TOP); byte[] sprepBytes = new byte[indexes[INDEX_TRIE_SIZE]]; //indexes[INDEX_MAPPING_DATA_SIZE] store the size of mappingData in bytes mappingData = new char[indexes[INDEX_MAPPING_DATA_SIZE]/2]; // load the rest of the data data and initialize the data members reader.read(sprepBytes,mappingData); sprepTrieImpl = new StringPrepTrieImpl(); sprepTrieImpl.sprepTrie = new CharTrie( new ByteArrayInputStream(sprepBytes),sprepTrieImpl ); // get the data format version formatVersion = reader.getDataFormatVersion(); // get the options doNFKC = ((indexes[OPTIONS] & NORMALIZATION_ON) > 0); checkBiDi = ((indexes[OPTIONS] & CHECK_BIDI_ON) > 0); sprepUniVer = getVersionInfo(reader.getUnicodeVersion()); normCorrVer = getVersionInfo(indexes[NORM_CORRECTNS_LAST_UNI_VERSION]); VersionInfo normUniVer = NormalizerImpl.getUnicodeVersion(); if(normUniVer.compareTo(sprepUniVer) < 0 && /* the Unicode version of SPREP file must be less than the Unicode Vesion of the normalization data */ normUniVer.compareTo(normCorrVer) < 0 && /* the Unicode version of the NormalizationCorrections.txt file should be less than the Unicode Vesion of the normalization data */ ((indexes[OPTIONS] & NORMALIZATION_ON) > 0) /* normalization turned on*/ ){ throw new IOException("Normalization Correction version not supported"); } b.close(); }
Example #25
Source Project: dragonwell8_jdk Author: alibaba File: Normalizer.java License: GNU General Public License v2.0 | 2 votes |
/** * Returns the combining class of the given character * @param ch character to retrieve combining class of * @return combining class of the given character */ public static final int getCombiningClass(int ch) { return NormalizerImpl.getCombiningClass(ch); }
Example #26
Source Project: TencentKona-8 Author: Tencent File: Normalizer.java License: GNU General Public License v2.0 | 2 votes |
/** * Returns the combining class of the given character * @param ch character to retrieve combining class of * @return combining class of the given character */ public static final int getCombiningClass(int ch) { return NormalizerImpl.getCombiningClass(ch); }
Example #27
Source Project: jdk8u60 Author: chenghanpeng File: Normalizer.java License: GNU General Public License v2.0 | 2 votes |
/** * Returns the combining class of the given character * @param ch character to retrieve combining class of * @return combining class of the given character */ public static final int getCombiningClass(int ch) { return NormalizerImpl.getCombiningClass(ch); }
Example #28
Source Project: openjdk-jdk8u Author: AdoptOpenJDK File: Normalizer.java License: GNU General Public License v2.0 | 2 votes |
/** * Returns the combining class of the given character * @param ch character to retrieve combining class of * @return combining class of the given character */ public static final int getCombiningClass(int ch) { return NormalizerImpl.getCombiningClass(ch); }
Example #29
Source Project: openjdk-jdk8u-backup Author: AdoptOpenJDK File: Normalizer.java License: GNU General Public License v2.0 | 2 votes |
/** * Returns the combining class of the given character * @param ch character to retrieve combining class of * @return combining class of the given character */ public static final int getCombiningClass(int ch) { return NormalizerImpl.getCombiningClass(ch); }
Example #30
Source Project: jdk8u-jdk Author: lambdalab-mirror File: Normalizer.java License: GNU General Public License v2.0 | 2 votes |
/** * Returns the combining class of the given character * @param ch character to retrieve combining class of * @return combining class of the given character */ public static final int getCombiningClass(int ch) { return NormalizerImpl.getCombiningClass(ch); }