Searchdaimon Forum

Excellent Product!

2013-05-09T21:47:06Z

I have been searching for MONTHS for a good intranet file search engine, and I am happy to report that yours is the best I have found after testing out many similar products and online services.

I have deployed your cloud-based solution on Amazon Web Services and thanks to you I am offering my client a multi-server full text index/file search service across multiple websites from one simple search form on their intranet. We are protecting some files using simple htaccess, and Searchdaimon crawled those protected files just fine. I also got it to log in and crawl our WordPress intranet site just fine as well but I am mostly using it to index protected and unprotected file directories in several locations. Nothing else I have found does the job we needed of indexing all the text inside protected documents. Your solution works for us, and I think it is simply the best one out there right now.

Nice job, Searchdaimon!

Authentication problems when crawling

2013-04-05T11:08:06Z

Hi,

I’m trying out SearchDaimon, with a view to using it for our intranet. I’ve got a VirtualBox installation working and can successfully crawl sites that don’t require authentication.

However, when I try to crawl our intranet - Which uses https:// and authentication, I just keep getting the error:

Can’t get url https://.../: 401 Unauthorized

(Note: ... contains the URL of our intranet, which I have removed before posting here)

I did see the following error in the crawling management log yesterday, but have not seen it since:

Noting {500 Can’t locate object method “new” via package “LWP::Protocol::https::Socket”} error at https://.../

I wondered if the problem was related to a missing Perl-Crypt-SSLeay (as mentioned in http://www.searchdaimon.com/forum/viewthread/46/ ), but if I try to install the RPM I just see the message that it is already installed.

Here’s what I’ve done so far then - Within the collection settings page:

I’m using Fake ad as we only want to create a public search
I’ve put the URL including https:// within the url text field

Finally, for authentication, I’ve tried username and password without a user prefix (our Active Directory name) and with a user prefix. Whichever way I do it, it still doesn’t work.

Our intranet is accessible via the internet, so isn’t configured to only use Integrated Windows Authentication - I can connect to it using any browser without any problems by just entering my username into the popup login box.

I don’t really know what else to try!

Any help would be much appreciated.

Thanks,

Adam.

Search result links are sdsmb:// and do not open

2013-03-06T02:05:48Z

When I perform a search against my SMB collection, the results returned have links that start with sdsmb:// and when I click on any of the result links nothing happens. I read through the document posted on how to add the chrome extension that allows file:// links to be open but all the results seem to be sdsmb:// links. Please advise.

Control of the Crawl Process.

2013-02-13T08:12:35Z

1. When crawling a SharePoint site can certain pages or lists be restricted from the crawl?

2. And at the opposite end can SD follow links on a web page or document and crawl that source too.

I realize that one could end up crawling the whole Internet that way . I have heard of people doing that with MS SharePoint Search only discover their SQL DB in the with massive Gigs of data.

The Crawl Process

2013-02-13T08:01:07Z

Just how does SD crawl a site ? Does it internally open each record or page “read” through it and index it to its database? is there any possible destructive or invasive effect on any data during the crawled process?

VERY Slow crawl on a SharePoint Page

2013-02-13T07:56:10Z

I am crawling a SharePoint site that has a page with an Audit log that keeps track of the transactions on that sub-site and its taking hours to crawl each Audit entry . The Audit entries very simple forms as below . What could be taking so long?

Example of each Audit log item:

ListName Accounts
Action Edit
Field Name Source
PreviousValue Referral
NewValue Other
ItemID 10,314
ModifiedBy H2201V01\administrator
ModifiedDateTime 11/9/2012 6:09 PM
Ad Agency
temTitle

Tag mismatch:

2013-02-13T07:46:46Z

I entered the number 1966 in the serch window and I got this result: Any ideas?

XML parse error: Opening and ending tag mismatch: td line 244 and title Opening and ending tag mismatch: tr line 244 and result Opening and ending tag mismatch: table line 240 and search Premature end of data in tag snippet line 239 Premature end of data in tag description line 239 Premature end of data in tag result line 217 Premature end of data in tag search line 2 at /usr/lib64/perl5/vendor_perl/5.8.8/x86_64-linux-thread-multi/XML/LibXML/SAX.pm line 64 at /usr/lib/perl5/vendor_perl/5.8.8/XML/Simple.pm line 370

Cannot crawl a sharepoint site

2013-02-07T08:12:00Z

I just cannot crawl a sharepoint no matter what I use—even if I go the Internat route.

Here is what I keep getting as a result: ( Changed the address here)

NEWMedia Not fully crawled Service description ‘http://server\administrator:M@$4448B@88.88.88.86/_vti_bin/Webs.asmx?WSDL’ can’t be loaded: 400 Bad Request

Why is there a “http” before the domain or server name and the login name i this case Administrator ?

I have tired this a million different ways with different accounts - no go! But, I can reach it as normal SP site in my browser.

I also tired if from 3 different installs of SD—same result. Crawling other Servers works ok .

Change from port 80.

2013-01-28T10:03:48Z

I would like to change from port 80 to some other port. How is this done ?

New Install and User Access, Shares. Time. too

2013-01-28T06:03:15Z

First great software! But, there are few issues:

1. Trying to run user access without AD looks to be impossible. I tried you FAKE AD but no such User system gets created, therefore no users can be added. I have to use public access. which I do not want to. I have some situations where the Sharepoint server is standalone, not a member of AD so it does a good job of crawling it but no private user access to crawled data.

2. What is the PUSH USER SYSTEM option. Does not seem to do anything?

2. Seems it does not crawl file shares from Windows 7—does ok on Windows 2003 . Will try 2008 RC next.

3. Any plans for a more Advanced Search options?

4. Where do change the time and date ? I live in North America Pacific Time bit the time is ahead by a few hours.