Sitemap going too big

Hello,

You should configure the date range in the JEvents configuration. I suspect the date is 2020 for the future, so the search engines can crawl every day.

You may find:

https://www.jevents.net/docs/jevents/it ... vents-site

Useful.

Thanks
Tony

Thanks
Tony

Yes, the last year is 2020, but I may have events there.
Ok, I tried other way:

Set meta-tag to stop robots crawling : Conditional date
Block Robots before this date : 1 month
Block Robots after this date : 1 month

Anyway xml-sitemaps continue to pick up dates well beyond this interval.
I am not sure for Googlebot.
How to instruct robots to crawl only dates with events, but not all dates?

Regarding end year - this should be updated also - we are in 2015 now.

View some of the pages in your website that this service is crawling - what are the robots meta tags set to? I suspect its not respecting these meta tags

I have plenty like "xxxx/day.listevents/2015/05/24/-".
Is that normal?
I do not have events on these days (No events on 24-May-2015 also).
I'm using [url:1pyoz5v8]http://www.screamingfrog.co.uk/[/url:1pyoz5v8] to crawl my site.
Also plenty of "xxx/http://search.form/2015/05/18/-";

Hello,

Yes that is normal as although there are no events there is a valid page.

Thanks
Tony

Thank you.
for example at this page: site_name/menu_item/month.calendar/2015/04/24/-
What I noticed: <meta name="robots" content="index, follow" /> is in page source, although my setting for JEvents menu item is - no index, no follow.

Hello,

Can you check your JEvents config? under SEF / performance too?

Can you provide your support info from JEvents please?

Thanks
Tony

May be my settings are not so correct but this is what I have:

1. Latest Events module published with some events entered through backend.

2. Hidden menu (linked to not published module or published module with empty position - both cases return same result in meta robots tag, what is important here - this menu to be non-visible to users)
In this menu I have 2 items:
2.1. Menu-Item-1 of type JEvents » View by Month
2.2. Menu-Item-2 of type JEvents » Crawler access
Both menu items have "no index, no follow" in meta tab

3. SEF settings in JEvents:
Use new SEF Url system - No (or Yes - same result)
Set meta-tag to stop robots crawling - Yes
Redirect Spider/Robots to crawler menu item - Yes
Menu item for robots (Type must be Crawler) - Menu-Item-2 (see above)

When I click on some event in Latest Events:
- Detailed view of Event is shown (in page source: meta name="robots" content="index, follow" )
- Breadcrumbs is as below:
Home -> Menu-Item-1 -> Event-XXX

If I click on 'Menu-Item-1' in Breadcrumbs: Component Calendar is shown (Monthly view) with Today's Date highlighted.
This page also has meta name="robots" content="index, follow" in page source.

Here we have many links (on each day) and since instruction is 'index, follow' every Search Engine/Crawler feels free to index. I have many links in page source like:

<a class="cal_daylink" href="/????????/eventsbyday/2015/4/14/-" title="translated-label">14</a>

But I do not have event on 14.04.2015 and I do not want crawlers to pick up/open this link.

2.2 - the crawler menu item must allow 'follow' but not index

If I click on 'Menu-Item-1' in Breadcrumbs: Component Calendar is shown (Monthly view) with Today's Date highlighted.
This page also has meta name="robots" content="index, follow" in page source.

This is not correct and is (as you point out) the heart of your problem. Did you try using 'global' in the
menu item metadata and blocking robots based on calendar dates in the JEvents config?

These settings work fine on my site

Thank you for advice,
Please disregard my previous post. It was 3-party component which set index,follow regardless of the menu settings. Hope that situation will improve.