<![CDATA[Causes garbled characters]]>I'm currently using the Pro version. The index of the uploaded PDF and Excel data is garbled. What is the cause of this? ?? Is File Extraction Rules involved?

]]>https://fulltextsearch.org/forum/topic/84/causes-garbled-charactersRSS for NodeFri, 11 Sep 2026 01:38:41 GMTWed, 16 Jun 2021 01:37:21 GMT60<![CDATA[Reply to Causes garbled characters on Thu, 24 Jun 2021 02:47:29 GMT]]>@epsilonadmin
Thank you very much for your kindness. I'll take a look.

]]>https://fulltextsearch.org/forum/post/223https://fulltextsearch.org/forum/post/223Thu, 24 Jun 2021 02:47:29 GMT<![CDATA[Reply to Causes garbled characters on Thu, 24 Jun 2021 02:02:08 GMT]]>Hi @enya

Half of the plugin is the indexer. It would be too long to explain how it works.

I think you need to see the code of /extractors/native.php
It's a wrapper for NativePHP extraction that uses the PdftoText library and then sending ready data to the indexer.

]]>https://fulltextsearch.org/forum/post/222https://fulltextsearch.org/forum/post/222Thu, 24 Jun 2021 02:02:08 GMT<![CDATA[Reply to Causes garbled characters on Thu, 24 Jun 2021 01:47:02 GMT]]>@epsilonadmin
Thank you very much. I was relieved to know that it was strong in terms of security.
In which code part of fulltext-search.php is the character data extracted by PdfToText.class.php used? ??

]]>https://fulltextsearch.org/forum/post/221https://fulltextsearch.org/forum/post/221Thu, 24 Jun 2021 01:47:02 GMT<![CDATA[Reply to Causes garbled characters on Thu, 24 Jun 2021 01:30:40 GMT]]>Hi @enya

We are preparing the official Privacy Policy document now, that will describe most part of Textmill.io functionality.

The main thing I would explain is this:
Textmill.io does not store any data. When any file is uploaded to the service for text extracting after the conversion and converted text responded to the caller (to WPFTS Pro instance) all data is removed.

Nothing stored means nothing will be stolen etc.

Textmill.io also uses HTTPS and protected servers.

Yes, I would not recommend it for very important secret documents (military, government, etc). But I also think that these companies that manage such information do not use Wordpress at all and have enough money to create their own protected systems and CMSs.

Wordpress itself is not that protected and safe. Any small code stored in the 3rd-party plugin may share any information on the internet.

]]>https://fulltextsearch.org/forum/post/220https://fulltextsearch.org/forum/post/220Thu, 24 Jun 2021 01:30:40 GMT<![CDATA[Reply to Causes garbled characters on Thu, 24 Jun 2021 00:53:21 GMT]]>@epsilonadmin
Is there a possibility of security problems using TextMill.io when uploading confidential data? ??

]]>https://fulltextsearch.org/forum/post/219https://fulltextsearch.org/forum/post/219Thu, 24 Jun 2021 00:53:21 GMT<![CDATA[Reply to Causes garbled characters on Wed, 23 Jun 2021 09:59:04 GMT]]>Hi @enya

Hmmm, sorry I am not an author of this library and unfortunately, I can't say which internal logic the author means here. The WPFTS Pro is just using it "as is". Actually, this way is just a fall-down method, because it's intended to use Textmill.io in most cases.

]]>https://fulltextsearch.org/forum/post/218https://fulltextsearch.org/forum/post/218Wed, 23 Jun 2021 09:59:04 GMT<![CDATA[Reply to Causes garbled characters on Wed, 23 Jun 2021 04:08:33 GMT]]>@enya
I'm new to PHP so I'm sorry if I made a mistake. I think I'm converting the character code between lines 282 and 315 in PdfToText.class.php. How can I make the character code such as Shift-JIS convertible here? ??
I'm sorry if it's not the content to ask here.

]]>https://fulltextsearch.org/forum/post/217https://fulltextsearch.org/forum/post/217Wed, 23 Jun 2021 04:08:33 GMT<![CDATA[Reply to Causes garbled characters on Wed, 23 Jun 2021 00:56:19 GMT]]>@epsilonadmin
Thank you very much. Let's take a look at the contents.

]]>https://fulltextsearch.org/forum/post/216https://fulltextsearch.org/forum/post/216Wed, 23 Jun 2021 00:56:19 GMT<![CDATA[Reply to Causes garbled characters on Tue, 22 Jun 2021 09:27:23 GMT]]>Hi @enya
We are using ready library pdf-to-text by Christian Vigh. It's in the /classes/ folder of WPFTS plugin.

]]>https://fulltextsearch.org/forum/post/215https://fulltextsearch.org/forum/post/215Tue, 22 Jun 2021 09:27:23 GMT<![CDATA[Reply to Causes garbled characters on Tue, 22 Jun 2021 07:21:51 GMT]]>@enya
Another question is, in which php file is the code that recognizes the pdf text when NativePHP is applied? ??

]]>https://fulltextsearch.org/forum/post/214https://fulltextsearch.org/forum/post/214Tue, 22 Jun 2021 07:21:51 GMT<![CDATA[Reply to Causes garbled characters on Tue, 22 Jun 2021 00:57:48 GMT]]>@epsilonadmin
Thank you very much.

]]>https://fulltextsearch.org/forum/post/213https://fulltextsearch.org/forum/post/213Tue, 22 Jun 2021 00:57:48 GMT<![CDATA[Reply to Causes garbled characters on Mon, 21 Jun 2021 10:24:31 GMT]]>Hi @enya
Okay, I am still looking for a solution to this.

]]>https://fulltextsearch.org/forum/post/212https://fulltextsearch.org/forum/post/212Mon, 21 Jun 2021 10:24:31 GMT<![CDATA[Reply to Causes garbled characters on Mon, 21 Jun 2021 06:57:22 GMT]]>@enya
I'm sorry, the quality of the data I passed last time was not good, so could you try it with this data?テスト用のデータ.pdf

]]>https://fulltextsearch.org/forum/post/211https://fulltextsearch.org/forum/post/211Mon, 21 Jun 2021 06:57:22 GMT<![CDATA[Reply to Causes garbled characters on Fri, 18 Jun 2021 01:01:06 GMT]]>@epsilonadmin
This is a sample, but I will send it. Thank you.bantekansan.pdf

]]>https://fulltextsearch.org/forum/post/210https://fulltextsearch.org/forum/post/210Fri, 18 Jun 2021 01:01:06 GMT<![CDATA[Reply to Causes garbled characters on Thu, 17 Jun 2021 07:53:33 GMT]]>@enya Could you send me an example of that PDF file to the epsiloncool@gmail.com or via private message in forum chat. I need to make some tests.

]]>https://fulltextsearch.org/forum/post/209https://fulltextsearch.org/forum/post/209Thu, 17 Jun 2021 07:53:33 GMT<![CDATA[Reply to Causes garbled characters on Thu, 17 Jun 2021 06:55:52 GMT]]>@epsilonadmin
Yes, I did. It worked fine with Textmill.io. However, we are worried about security, so we would like to operate with Native PHP.

]]>https://fulltextsearch.org/forum/post/208https://fulltextsearch.org/forum/post/208Thu, 17 Jun 2021 06:55:52 GMT<![CDATA[Reply to Causes garbled characters on Thu, 17 Jun 2021 04:31:02 GMT]]>@enya
Unfortunately, the NativePHP parser for PDF is not that good. It still works for most PDFs but fails on some of them. Also, it does not support Excel file parsing.

We have created Textmill.io service because it's much more powerful and does this job much better.

Did you try to switch on Textmill.io?

]]>https://fulltextsearch.org/forum/post/207https://fulltextsearch.org/forum/post/207Thu, 17 Jun 2021 04:31:02 GMT<![CDATA[Reply to Causes garbled characters on Thu, 17 Jun 2021 01:31:42 GMT]]>@epsilonadmin Causes garbled characters_screenshot.png
Here is the index of garbled PDF data. Is it possible to set Native PHP so that it does not get garbled?

]]>https://fulltextsearch.org/forum/post/206https://fulltextsearch.org/forum/post/206Thu, 17 Jun 2021 01:31:42 GMT<![CDATA[Reply to Causes garbled characters on Wed, 16 Jun 2021 15:30:08 GMT]]>Hi @enya

Could you please show me some screenshots? Preferrable a part of the PDF / Excel file and how it looks on search.

Thanks!

]]>https://fulltextsearch.org/forum/post/205https://fulltextsearch.org/forum/post/205Wed, 16 Jun 2021 15:30:08 GMT