Карта сайта для ботов (phpBB3 SEO Sitemap)

userAx · Сообщение **userAx** » 09.06.14 19:18

Поставил, сразу же создалась карта на 22 тыс ссылок, в гугле и яндексе
Сведения об ошибках: Ошибки отсутствуют.
Прыгаю прям, ибо когда стоял sitemapFx только 30% ссылок кушало. Надеюсь теперь кол-во в выдаче возрастёт.
Ещё раз большое спасибо.

П.с.
По поводу файла robots.txt, не могли бы Вы своим опытным взглядом посмотреть, всё ли в нём нормально?

Код: Выделить всё

User-agent: *
Disallow: /tracker/
Disallow: /adm/
Disallow: /db/
Disallow: /images/
Disallow: /includes/
Disallow: /language/
Disallow: /faq.php
Disallow: /mcp.php 
Disallow: /index.php?
Disallow: /memberlist.php
Disallow: /posting.php
Disallow: /report.php
Disallow: /search.php
Disallow: /style.php 
Disallow: /ucp.php
Disallow: /viewonline.php
Disallow: /*&st=*
Disallow: /*&sk=*
Disallow: /*&sd=*
Disallow: /*&hilit=*
Disallow: /*&view=*
Disallow: /viewtopic.php?p=*
Disallow: /viewtopic.php?f=*&t=*&view=previous
Disallow: /viewtopic.php?f=*&t=*&view=next
Disallow: /view*&start=0$
Clean-param: sid /index.php
Clean-param: sid /viewforum.php
Clean-param: sid /viewtopic.php
Sitemap: http://f-torrents.org/sitemap.php

# Google Image
User-agent: Googlebot-Image
Disallow:

# Google AdSense
User-agent: Mediapartners-Google
Disallow:


User-agent: Yandex
Disallow: /tracker/
Disallow: /adm/
Disallow: /db/
Disallow: /images/
Disallow: /includes/
Disallow: /language/
Disallow: /index.php?
Disallow: /mcp.php 
Disallow: /memberlist.php
Disallow: /posting.php
Disallow: /report.php
Disallow: /search.php
Disallow: /style.php 
Disallow: /ucp.php
Disallow: /*&st=*
Disallow: /*&sk=*
Disallow: /*&sd=*
Disallow: /*&hilit=*
Disallow: /*&view=*
Disallow: /viewtopic.php?p=*
Disallow: /view*&start=0$
Disallow: /viewtopic.php?f=*&t=*&view=previous
Disallow: /viewtopic.php?f=*&t=*&view=next
Clean-param: sid /index.php
Clean-param: sid /viewforum.php
Clean-param: sid /viewtopic.php
Host: f-torrents.org
Sitemap: http://f-torrents.org/sitemap.php

User-agent: msn 
Disallow: /tracker/
Disallow: /adm/
Disallow: /db/
Disallow: /images/
Disallow: /includes/
Disallow: /language/
Disallow: /index.php?
Disallow: /mcp.php 
Disallow: /memberlist.php
Disallow: /posting.php
Disallow: /report.php
Disallow: /search.php
Disallow: /style.php 
Disallow: /ucp.php
Disallow: /*&st=*
Disallow: /*&sk=*
Disallow: /*&sd=*
Disallow: /*&hilit=*
Disallow: /*&view=*
Disallow: /viewtopic.php?p=*
Disallow: /view*&start=0$
Disallow: /viewtopic.php?f=*&t=*&view=previous
Disallow: /viewtopic.php?f=*&t=*&view=next
Clean-param: sid /index.php
Clean-param: sid /viewforum.php
Clean-param: sid /viewtopic.php
Sitemap: http://f-torrents.org/sitemap.php


User-agent: yahoo 
Disallow: /tracker/
Disallow: /adm/
Disallow: /db/
Disallow: /images/
Disallow: /includes/
Disallow: /language/
Disallow: /index.php?
Disallow: /mcp.php 
Disallow: /memberlist.php
Disallow: /posting.php
Disallow: /report.php
Disallow: /search.php
Disallow: /style.php 
Disallow: /ucp.php
Disallow: /*&st=*
Disallow: /*&sk=*
Disallow: /*&sd=*
Disallow: /*&hilit=*
Disallow: /*&view=*
Disallow: /viewtopic.php?p=*
Disallow: /view*&start=0$
Disallow: /viewtopic.php?f=*&t=*&view=previous
Disallow: /viewtopic.php?f=*&t=*&view=next
Clean-param: sid /index.php
Clean-param: sid /viewforum.php
Clean-param: sid /viewtopic.php
Sitemap: http://f-torrents.org/sitemap.php

Seeeeler · Сообщение **Seeeeler** » 12.06.14 03:43

Hello mate,

Thanks for great mod, It is helped my site to have best seo but after huge number of posts, this mod has stopped working.
When i check my site's sitemap.php it does not load, sometimes it loads but many times does not load and shows URL timeout error.

Код: Выделить всё

http://www.thewarez.org/sitemap.php

Just a few days ago it was working fine, but now my board has 30,000 posts, this mod has stopped working.

I am using SEO Sitemap Version: 2.1.1

Can you please help me with this as soon as possible?

Сообщение **Shredder** » 12.06.14 06:24

userAx писал(а):П.с.
По поводу файла robots.txt, не могли бы Вы своим опытным взглядом посмотреть, всё ли в нём нормально?

Вроде да.

Seeeeler
Try to reduce URL limit in the MOD's settings.

Seeeeler · Сообщение **Seeeeler** » 12.06.14 06:36

Thanks for the reply Shredder,

I tried to reduce URL limit to 30,000 but still did not work, after that i changed back to 50,000 but still did not work, after a few hours i tried again and now i can access my site's sitemap.

It is wierd, somtimes i can't access to sitemap and sometimes can access. Can you please suggest me a solution, do you think it could be a server error where my site is hosted or it could be the seo mod error?

I love your great mod, If you can help me with this, I will be really thankful to you and i know you are seo expert, can i hire you for seo services?

Edit: This is the setting i am using on my site for SEO Sitemap, This setting was working great, My site seo was super high and newly posted topics were showing on the first page of google search but now sitemap is not loading correctly or is too slow, google is not showing my site's topic on the first page and i have lost all the traffic for my site.

Please see attachment

Сообщение **Shredder** » 12.06.14 06:52

What HTTP-status url has when there is an error?
Google webmaster panel indicates whether there an error in the sitemap or not?

Have you tried to increase the caching time to 24 or more hours?

Seeeeler · Сообщение **Seeeeler** » 12.06.14 07:00

Please see attachment to see the HTTP error in Google webmaster tools.

Mostly this error appears but sometimes it is successful and no error.

No, I have not tried increasing cache time to 24 hours, Do you think if i increase the time it will help?
I am afraid if I increase the cache time to 24 or more hours then new topics won't get too hurry indexed by google, am i right?

Сообщение **Shredder** » 12.06.14 07:39

These errors occurs because the server limits are exceeded. I see two ways to solve problem:
1) Try to use earlier MOD version (v2.0.2 in the first post of this topic), because it creates less stress to the server. The main difference between these versions is that the second uses a more advanced algorithm to determine lastmod of pages and slightly more load to the server for this reason, but it is not critical for the SEO if you use not precise lastmod.
2) Ask your hosting provider to allocate more power for your site. Or just change to more powerful hosting.

Seeeeler · Сообщение **Seeeeler** » 13.06.14 15:53

Ok thanks, I will try your suggestions.

Can you please guide me how can i downgrade to v2.0.2?

Do i have to uninstall the current version v2.1.1 and then install v2.0.2 or simply do some edits to downgrade to v2.0.2?

I have asked my hosting provider, They say my site's server is fast enough.

Сообщение **Shredder** » 13.06.14 18:17

You can just replace MOD files, nothing more is needed.

Seeeeler · Сообщение **Seeeeler** » 14.06.14 02:05

Thanks Shredder, It seems like v2.0.2 is working fine on my site.

I will let you know if it creates any problem in the next few days.

I hope you can modify and make the next version more stable and perfect

Thanks again for your awesome mod, It is just perfect to get great seo for site.

unfyl · Сообщение **unfyl** » 29.06.14 19:43

Подскажите пожалуйста, как выставить приоритет для отдельных конкретных тем форумов.
Я так понял, что можно выставить приоритет для какой-либо темы, только сделав ее важной, прикрепленной и т.п.?

Сообщение **Shredder** » 30.06.14 15:43

unfyl
Приоритет для отдельных тем не выставляется. Только для типов тем, т.е. вы всё верно поняли.

Lopes · Сообщение **Lopes** » 19.07.14 10:07

Shredder, в админке "общее число урл в карте" постоянно слетает на 0. Наберу в адресной строке сайт/sitemap.php - урлов несколько тысяч, через неделю-две зайду в админку - урлов 0. Так и должно быть?

Сообщение **Shredder** » 19.07.14 21:46

Не должно.
Могу предположить, что на страницу карты заходит кто-то, кто не имеет никаких прав доступа к форуму, из-за чего у него "получается" карта с нулевым количеством URL.

dmitrogen · Сообщение **dmitrogen** » 19.07.14 22:13

Shredder, спасибо за мод, всё понравилось, пользуюсь. А как сделать, чтобы в файл карты .xml добавлялись только свежие топики, а не перегенерировались все файлы .xml, т.к. форум во время генерации "ложится" на 3-4 минуты