How to search in Arabic text in JAVA?

Question

I have arabic text in a diacritical database. when I type Arabic to search for some string, it is without diacritics, which definitely does not match the database string. it works great on text without diacritics. is there any way to run it in the text with diacritics ???

Answer 1

is there any way to run it in the text with diacritics ???

Unfortunately not. As MIE said:

Arabic diacritics are symbols

so this is not real as far as I know.

The MIE answer will be difficult to implement and it will simply be impossible to get an update if you change anything in your database.

Perhaps you can look at the Apache Lucene search software library . I'm not sure, but it looks like it can solve your problem.

Or you need to remove all diacritics from your database, and then you can request it with or without diacritics, just using a small Arabic normalizer, like this one :

/** * ArabicNormalizer class * @author Ibrabel */ public final class ArabicNormalizer { private String input; private final String output; /** * ArabicNormalizer constructor * @param input String */ public ArabicNormalizer(String input){ this.input=input; this.output=normalize(); } /** * normalize Method * @return String */ private String normalize(){ //Remove honorific sign input=input.replaceAll("\u0610", "");//ARABIC SIGN SALLALLAHOU ALAYHE WA SALLAM input=input.replaceAll("\u0611", "");//ARABIC SIGN ALAYHE ASSALLAM input=input.replaceAll("\u0612", "");//ARABIC SIGN RAHMATULLAH ALAYHE input=input.replaceAll("\u0613", "");//ARABIC SIGN RADI ALLAHOU ANHU input=input.replaceAll("\u0614", "");//ARABIC SIGN TAKHALLUS //Remove koranic anotation input=input.replaceAll("\u0615", "");//ARABIC SMALL HIGH TAH input=input.replaceAll("\u0616", "");//ARABIC SMALL HIGH LIGATURE ALEF WITH LAM WITH YEH input=input.replaceAll("\u0617", "");//ARABIC SMALL HIGH ZAIN input=input.replaceAll("\u0618", "");//ARABIC SMALL FATHA input=input.replaceAll("\u0619", "");//ARABIC SMALL DAMMA input=input.replaceAll("\u061A", "");//ARABIC SMALL KASRA input=input.replaceAll("\u06D6", "");//ARABIC SMALL HIGH LIGATURE SAD WITH LAM WITH ALEF MAKSURA input=input.replaceAll("\u06D7", "");//ARABIC SMALL HIGH LIGATURE QAF WITH LAM WITH ALEF MAKSURA input=input.replaceAll("\u06D8", "");//ARABIC SMALL HIGH MEEM INITIAL FORM input=input.replaceAll("\u06D9", "");//ARABIC SMALL HIGH LAM ALEF input=input.replaceAll("\u06DA", "");//ARABIC SMALL HIGH JEEM input=input.replaceAll("\u06DB", "");//ARABIC SMALL HIGH THREE DOTS input=input.replaceAll("\u06DC", "");//ARABIC SMALL HIGH SEEN input=input.replaceAll("\u06DD", "");//ARABIC END OF AYAH input=input.replaceAll("\u06DE", "");//ARABIC START OF RUB EL HIZB input=input.replaceAll("\u06DF", "");//ARABIC SMALL HIGH ROUNDED ZERO input=input.replaceAll("\u06E0", "");//ARABIC SMALL HIGH UPRIGHT RECTANGULAR ZERO input=input.replaceAll("\u06E1", "");//ARABIC SMALL HIGH DOTLESS HEAD OF KHAH input=input.replaceAll("\u06E2", "");//ARABIC SMALL HIGH MEEM ISOLATED FORM input=input.replaceAll("\u06E3", "");//ARABIC SMALL LOW SEEN input=input.replaceAll("\u06E4", "");//ARABIC SMALL HIGH MADDA input=input.replaceAll("\u06E5", "");//ARABIC SMALL WAW input=input.replaceAll("\u06E6", "");//ARABIC SMALL YEH input=input.replaceAll("\u06E7", "");//ARABIC SMALL HIGH YEH input=input.replaceAll("\u06E8", "");//ARABIC SMALL HIGH NOON input=input.replaceAll("\u06E9", "");//ARABIC PLACE OF SAJDAH input=input.replaceAll("\u06EA", "");//ARABIC EMPTY CENTRE LOW STOP input=input.replaceAll("\u06EB", "");//ARABIC EMPTY CENTRE HIGH STOP input=input.replaceAll("\u06EC", "");//ARABIC ROUNDED HIGH STOP WITH FILLED CENTRE input=input.replaceAll("\u06ED", "");//ARABIC SMALL LOW MEEM //Remove tatweel input=input.replaceAll("\u0640", ""); //Remove tashkeel input=input.replaceAll("\u064B", "");//ARABIC FATHATAN input=input.replaceAll("\u064C", "");//ARABIC DAMMATAN input=input.replaceAll("\u064D", "");//ARABIC KASRATAN input=input.replaceAll("\u064E", "");//ARABIC FATHA input=input.replaceAll("\u064F", "");//ARABIC DAMMA input=input.replaceAll("\u0650", "");//ARABIC KASRA input=input.replaceAll("\u0651", "");//ARABIC SHADDA input=input.replaceAll("\u0652", "");//ARABIC SUKUN input=input.replaceAll("\u0653", "");//ARABIC MADDAH ABOVE input=input.replaceAll("\u0654", "");//ARABIC HAMZA ABOVE input=input.replaceAll("\u0655", "");//ARABIC HAMZA BELOW input=input.replaceAll("\u0656", "");//ARABIC SUBSCRIPT ALEF input=input.replaceAll("\u0657", "");//ARABIC INVERTED DAMMA input=input.replaceAll("\u0658", "");//ARABIC MARK NOON GHUNNA input=input.replaceAll("\u0659", "");//ARABIC ZWARAKAY input=input.replaceAll("\u065A", "");//ARABIC VOWEL SIGN SMALL V ABOVE input=input.replaceAll("\u065B", "");//ARABIC VOWEL SIGN INVERTED SMALL V ABOVE input=input.replaceAll("\u065C", "");//ARABIC VOWEL SIGN DOT BELOW input=input.replaceAll("\u065D", "");//ARABIC REVERSED DAMMA input=input.replaceAll("\u065E", "");//ARABIC FATHA WITH TWO DOTS input=input.replaceAll("\u065F", "");//ARABIC WAVY HAMZA BELOW input=input.replaceAll("\u0670", "");//ARABIC LETTER SUPERSCRIPT ALEF //Replace Waw Hamza Above by Waw input=input.replaceAll("\u0624", "\u0648"); //Replace Ta Marbuta by Ha input=input.replaceAll("\u0629", "\u0647"); //Replace Ya // and Ya Hamza Above by Alif Maksura input=input.replaceAll("\u064A", "\u0649"); input=input.replaceAll("\u0626", "\u0649"); // Replace Alifs with Hamza Above/Below // and with Madda Above by Alif input=input.replaceAll("\u0622", "\u0627"); input=input.replaceAll("\u0623", "\u0627"); input=input.replaceAll("\u0625", "\u0627"); return input; } /** * @return the output */ public String getOutput() { return output; } public static void main(String[] args) { String test = "كَلَّا لَا تُطِعْهُ وَاسْجُدْ وَاقْتَرِبْ ۩"; System.out.println("Before: "+test); test=new ArabicNormalizer(test).getOutput(); System.out.println("After: "+test); } } 

Answer 2

I found it much better to do this. All joop rewards :

 import java.text.Normalizer; import java.text.Normalizer.Form; /** * * @author Ibbtek <http://ibbtek.altervista.org/> */ public class ArabicDiacritics { private String input; private final String output; /** * ArabicDiacritics constructor * @param input String */ public ArabicDiacritics(String input){ this.input=input; this.output=normalize(); } /** * normalize Method * @return String */ private String normalize(){ input = Normalizer.normalize(input, Form.NFKD) .replaceAll("\\p{M}", ""); return input; } /** * @return the output */ public String getOutput() { return output; } public static void main(String[] args) { String test = "كَلَّا لَا تُطِعْهُ وَاسْجُدْ وَاقْتَرِبْ ۩"; System.out.println("Before: "+test); test=new ArabicDiacritics(test).getOutput(); System.out.println("After: "+test); } } 

Answer 3

Arabic diacritics are symbols, so you can use a similar sentence as follows:

 SELECT * FROM table WHERE name LIKE 'a[cd]*b[cd]*' 

it will find "ab" with any number c or d in between.

you can do this by adding all the Arabic diacritics between the square brackets after each letter

here you can find them all with their Unicode code point.

Answer 4

Please see below the class I created. It is designed for android, returns a spannable String. It is so simple and not worry about memory consumption. You guys can optimize yourself.

http://freshinfresh.com/sample/ABHArabicDiacritics.java

If you want to check without the nunation (harakath) contained in the Arabic line,

  ABHArabicDiacritics objSearchd = new ABHArabicDiacritics(); objSearchdobjSearch.getDiacriticinsensitive("وَ اَشْهَدُ اَنْ لا اِلهَ اِلاَّ اللَّهُ").contains("اشهد"); 

If you want to return the Highlighhed or redColored snippet to String. Use below code

 ABHArabicDiacritics objSearch = new ABHArabicDiacritics( وَ اَشْهَدُ اَنْ لا اِلهَ اِلاَّ اللَّهُ, اشهد); SpannableString spoutput=objSearch.getSearchHighlightedSpan(); textView.setText(spoutput); 

To see the start and end position of the search text, use the methods below.

  /** to serch Contains */ objSearch.isContain();// objSearch.getSearchHighlightedSpan(); objSearch.getSearchTextStartPosition(); objSearch.getSearchTextEndPosition(); 

Copy the common Java class and enjoy.

I will spend more time on more features if you guys answer.

thanks