IDescribe Posted February 4, 2016 Share Posted February 4, 2016 (edited) I used to be able to use Google to do site specific searches on this forum. A search like -- site:www.brianenos.com 124gr JHP Titegroup load data -- would turn up bunches of threads on this forum with load data for Titegroup and 124gr JHP. Now when I use that feature, I get a link to maybe one page, and below the link on Google, all it says is: "A description for this result is not available because of this site's robots.txt " Are the site's operators aware of this issue? It's been like this for months now. Not sure when things changed. If you know it's like this and want it this way so that the site's search feature is the only search option have, okay, but I wanted to make sure the site knew what was going on. Edited February 4, 2016 by IDescribe Link to comment Share on other sites More sharing options...
Dpickl01 Posted February 8, 2016 Share Posted February 8, 2016 Clear cookies and catchie Link to comment Share on other sites More sharing options...
IDescribe Posted February 8, 2016 Author Share Posted February 8, 2016 Made no difference. Same exact response. Link to comment Share on other sites More sharing options...
IDescribe Posted February 8, 2016 Author Share Posted February 8, 2016 And response is the same regardless of browser -- Chrome, Firefox, and Explorer.If you put this -- site:www.brianenos.com titegroup 124 jhp -- into Google, are you getting a long list of links? Link to comment Share on other sites More sharing options...
ChuckS Posted February 8, 2016 Share Posted February 8, 2016 Something in this file is breaking the search: User-agent: * Disallow: / Disallow: /cgi-bin/ Disallow: /dealers/ Disallow: /bebook/ Disallow: /forums/admin/ Disallow: /forums/cache/ Disallow: /forums/converge_local/ Disallow: /forums/hooks/ Disallow: /forums/ips_kernel/ Disallow: /forums/retail/ Disallow: /forums/public/js/ Disallow: /forums/public/style_captcha/ Disallow: /forums/public/style_css/ Disallow: /forums/index.php?app=core&module=task Disallow: /forums/index.php?app=core&module=usercp&tab=forumss&area=forumssubs Disallow: /forums/index.php?app=core&module=usercp&tab=forumss&area=watch&watch=topic Disallow: /forums/index.php?app=forumss&module=extras§ion=forward Disallow: /forums/index.php?app=members&module=messaging Disallow: /forums/index.php?app=members&module=chat Disallow: /forums/index.php?app=members&module=search Disallow: /forums/index.php?app=members&module=search&do=active Disallow: /forums/index.php?&unlockUserAgent=1 Disallow: /*app=core&module=usercp Disallow: /*app=core&module=usercp Disallow: /*app=members&module=messaging Disallow: /*&p= Disallow: /*&pid= Disallow: /*&hl= Disallow: /*&start= Disallow: /*view__getnewpost$ Disallow: /*view__getlastpost$ Disallow: /*view__old$ Disallow: /*view__new$ Disallow: /*view__getfirst$ Disallow: /*view__getprevious$ Disallow: /*view__getnext$ Disallow: /*view__getlast$ Disallow: /*&view=getnewpost$ Disallow: /*&view=getlastpost$ Disallow: /*&view=old$ Disallow: /*&view=new$ Disallow: /*&view=getfirst$ Disallow: /*&view=getprevious$ Disallow: /*&view=getnext$ Disallow: /*&view=getlast$ Disallow: /*?s= Disallow: /*&s= Disallow: /forums/index.php?app=core&module=global§ion=login&do=deleteCookies Disallow: /forums/index.php?app=forumss&module=extras§ion=rating Disallow: /forums/index.php?app=forumss&module=forumss§ion=markasread crawl-delay: 20 Link to comment Share on other sites More sharing options...
benos Posted February 8, 2016 Share Posted February 8, 2016 Someone, I can't remember now, who knows more about this stuff than me, had me set the robots.txt file to block google from searching the forums. Link to comment Share on other sites More sharing options...
BritinUSA Posted February 8, 2016 Share Posted February 8, 2016 Someone, I can't remember now, who knows more about this stuff than me, had me set the robots.txt file to block google from searching the forums. It may have been put in place as a result of this : http://www.brianenos.com/forums/index.php?showtopic=186151&p=2054942 Link to comment Share on other sites More sharing options...
IDescribe Posted February 8, 2016 Author Share Posted February 8, 2016 Okay, so it was deliberate. Got it. Thanks for the clarification. Link to comment Share on other sites More sharing options...
benos Posted February 8, 2016 Share Posted February 8, 2016 Someone, I can't remember now, who knows more about this stuff than me, had me set the robots.txt file to block google from searching the forums. It may have been put in place as a result of this : http://www.brianenos.com/forums/index.php?showtopic=186151&p=2054942 Right. Good one Paul! Link to comment Share on other sites More sharing options...
jar Posted April 18, 2016 Share Posted April 18, 2016 Is there any chance this can be fixed in a way that allows google searching the forum? I've always found it much easier to search forums with google than the internal search. Link to comment Share on other sites More sharing options...
benos Posted June 16, 2016 Share Posted June 16, 2016 I removed this: Disallow: / ... from the robots.txt file - which should not have been in that file. Let me know if that helped. Link to comment Share on other sites More sharing options...
x98c Posted June 18, 2016 Share Posted June 18, 2016 (edited) Brian, Thanks that fixed it! example "site:brianenos.com hs6" used to just show thread urls, now it gives thread topic titles Edited June 18, 2016 by x98c Link to comment Share on other sites More sharing options...
benos Posted June 20, 2016 Share Posted June 20, 2016 Excellent, thanks for the update. Link to comment Share on other sites More sharing options...
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now