Wednesday, 23 April 2014 20:02
beggarly

Problem with sitemap size

An open forum for opinions and general questions

Problem with sitemap size

Postby Mindriot » Fri Feb 10, 2012 2:32 pm

Im having a problem with the size of a sitemap generated for one of my sites.

http://autoaeterna.com

Its not really a fault of xmap or any part of the site joomla wise.

This is the issue :

My site is a directory site, it has a very large database. Im using mosets tree, the content for mosets alone is 58066 listings and 13963 categories, and then theres a small amount of stuff for the site in general and jomsocial.

Ive got xmap set to only handle category links, not even show any listings per category. Ive even tried multiple columns.

Xmap seems to be happy to create the sitemap links, but the generated sitemap is so massive, it never resolves in a browser or when requested by google, bing, etc. It just loads forever and times out. I run this site and just a hanful of of others on a dual xeon dedicated server I own in entirety, the database is even served off of a dedicated SSD and the main content of a fast sata raid1, so even with the considerable speed the sitemap still takes too long to load.

What could be done with xmap or the mosets plugin to give more control over the sitemap?

Is pagination viable?

could the mosets tree plugin be improved to allow a selectable maximum depth of levels corresponding to the category structure of mosets tree?

I really like xmap, been a user for sometime, and I find its sitemaps essential for search engine submission these days, but I am at aloss what more I can do about this particular site of mine.
Mindriot
Fresh Boarder
Fresh Boarder
 
Posts: 13
Joined: Fri Feb 10, 2012 2:21 pm

Re: Problem with sitemap size

Postby Mindriot » Tue Feb 14, 2012 1:03 am

Well I tried something different, I saved the output to a static file to speed up load times to stop google timing out fetching the sitemap and Ive hit a new problem :

Your Sitemap contains too many URLs. Please create multiple Sitemaps with up to 50000 URLs each and submit all Sitemaps.

Cant win, is there any possibility of some help here?
Mindriot
Fresh Boarder
Fresh Boarder
 
Posts: 13
Joined: Fri Feb 10, 2012 2:21 pm

Re: Problem with sitemap size and xml formatting

Postby Mindriot » Mon Feb 20, 2012 10:51 am

nothing? Ill bump this once and hope theres some interest, otherwise Ill have to assume theres zero support for xmap.

Im also having problems with google flagging xml formatting errors on sitemaps.
Mindriot
Fresh Boarder
Fresh Boarder
 
Posts: 13
Joined: Fri Feb 10, 2012 2:21 pm

Re: Problem with sitemap size

Postby Mindriot » Wed Feb 29, 2012 4:22 pm

The formatting turned out to be down to a fault with the js_xmap plugin and Im pursuing that here :

http://joomlaextensions.latitudweb.com/forum/11-installation-a-configuration/1183-re-xml-errors-in-sitemap-being-reported-by-google.html#1185

Well I had to save the sitemap and manually break it up into 4 sub 50000 url chunks and manually upload them, itll have to do for now, if theres some way this could be addressed by xmap that would be a big improvement.
Mindriot
Fresh Boarder
Fresh Boarder
 
Posts: 13
Joined: Fri Feb 10, 2012 2:21 pm


Return to General



Who is online

Users browsing this forum: No registered users and 2 guests