is this ocrrect sitem,ap - <sitemapindex…
- User
is this ocrrect sitem,ap - https://www.theloomstudiolifestyle.com/blog-categories-sitemap.xml 2024-06-15 https://www.theloomstudiolifestyle.com/blog-posts-sitemap.xml 2024-06-15 https://www.theloomstudiolifestyle.com/store-products-sitemap.xml 2024-07-27 https://www.theloomstudiolifestyle.com/pages-sitemap.xml 2024-07-21
- Assistant
Your sitemap appears to be mostly correct, but there are a couple of minor details to fix. Firstly, there's a typo in the first line where you wrote "sitem,ap" instead of "sitemap". Secondly, the field "generatedBy" is not a standard attribute for a sitemap index file according to the XML Sitemap Protocol. However, if it's required by your platform, you might still include it. Here is the corrected version without the "generatedBy" attribute:
<sitemapindex xmlns="http://www.sitemaps.org/schemas/sitemap/0.9"> <sitemap> <loc>https://www.theloomstudiolifestyle.com/blog-categories-sitemap.xml</loc> <lastmod>2024-06-15</lastmod> </sitemap> <sitemap> <loc>https://www.theloomstudiolifestyle.com/blog-posts-sitemap.xml</loc> <lastmod>2024-06-15</lastmod> </sitemap> <sitemap> <loc>https://www.theloomstudiolifestyle.com/store-products-sitemap.xml</loc> <lastmod>2024-07-27</lastmod> </sitemap> <sitemap> <loc>https://www.theloomstudiolifestyle.com/pages-sitemap.xml</loc> <lastmod>2024-07-21</lastmod> </sitemap> </sitemapindex>If "generatedBy" is necessary for your WIX implementation, then you can include it, but understand that it is customized beyond the standard protocol.
Here is how it would look with "generatedBy":
<sitemapindex xmlns="http://www.sitemaps.org/schemas/sitemap/0.9" generatedBy="WIX"> <sitemap> <loc>https://www.theloomstudiolifestyle.com/blog-categories-sitemap.xml</loc> <lastmod>2024-06-15</lastmod> </sitemap> <sitemap> <loc>https://www.theloomstudiolifestyle.com/blog-posts-sitemap.xml</loc> <lastmod>2024-06-15</lastmod> </sitemap> <sitemap> <loc>https://www.theloomstudiolifestyle.com/store-products-sitemap.xml</loc> <lastmod>2024-07-27</lastmod> </sitemap> <sitemap> <loc>https://www.theloomstudiolifestyle.com/pages-sitemap.xml</loc> <lastmod>2024-07-21</lastmod> </sitemap> </sitemapindex>Make sure you validate it with your specific needs and platform requirements.
- User
isthis ocrrcet robots txt - User-agent: * Allow: / User-agent: Googlebot Disallow: *?lightbox=
Optimization for Google Ads Bot
User-agent: AdsBot-Google-Mobile User-agent: AdsBot-Google Disallow: /_api/* Disallow: /_partials* Disallow: /pro-gallery-webapp/v1/galleries/*
Block PetalBot
User-agent: PetalBot Disallow: /
Crawl delay for overly enthusiastic bots
User-agent: dotbot Crawl-delay: 10 User-agent: AhrefsBot Crawl-delay: 10
Sitemap: https://www.theloomstudiolifestyle.com/sitemap.xml
Auto generated, go to SEO Tools > Robots.txt Editor to change this
- Assistant
Your
robots.txtfile appears to be mostly correct, but there are some minor points to consider for better readability and adherence to common conventions. Here’s a cleaned-up version with some comments added to clarify each section:User-agent: * Allow: / User-agent: Googlebot Disallow: *?lightbox= # Optimization for Google Ads Bot User-agent: AdsBot-Google-Mobile Disallow: /_api/* Disallow: /_partials* Disallow: /pro-gallery-webapp/v1/galleries/* User-agent: AdsBot-Google Disallow: /_api/* Disallow: /_partials* Disallow: /pro-gallery-webapp/v1/galleries/* # Block PetalBot User-agent: PetalBot Disallow: / # Crawl delay for overly enthusiastic bots User-agent: dotbot Crawl-delay: 10 User-agent: AhrefsBot Crawl-delay: 10 Sitemap: https://www.theloomstudiolifestyle.com/sitemap.xml # Auto generated, go to SEO Tools > Robots.txt Editor to change thisKey Points:
-
Wildcard
User-agent: *at the top: This is a general rule that applies to all user agents.- If you want to specify rules for all crawlers first, it is correct to place it at the top.
-
Specific user-agent rules:
- Googlebot: Disallowed from accessing URLs with
*?lightbox=. - AdsBot-Google-Mobile and AdsBot-Google: Disallowed from accessing
/api/*,/partials*, and/pro-gallery-webapp/v1/galleries/*. - PetalBot: Completely disallowed from accessing the site.
- dotbot and AhrefsBot: Given a 10-second crawl delay to manage server load.
- Googlebot: Disallowed from accessing URLs with
-
Sitemap location**:
- Correctly pointing to the sitemap URL.
Adjustments:
- Separate rules for clarity: It’s a good practice to separate rules for different user agents with line breaks and comments to make it easier to read.
- Ensure
Crawl-delayis supported: Not all search engine crawlers support theCrawl-delaydirective. Ensure those specified do, based on their respective documentation.
Make sure to validate your
robots.txtwith tools like Google Search Console to ensure it meets your requirements. -