Home

Free Robots.txt & Sitemap Generator

Use our free tool to instantly generate an SEO-optimized robots.txt file with built-in pagination exclusion and proper sitemap paths. Just enter your website URL below to get started.

Robots.txt & Sitemap Generator

Generate a search-optimized configuration file for your website instantly.

How to Add This to Blogger (Blogspot)

  1. Log in to your Blogger Dashboard.
  2. Go to Settings from the left menu.
  3. Scroll down to the Crawlers and indexing section.
  4. Turn on the toggle for Enable custom robots.txt.
  5. Click on Custom robots.txt, paste the code you generated from our tool, and click Save.

      6. How to Add This to WordPress

      You can add this file to your WordPress site using an SEO plugin or via cPanel:

      Method 1: Using Rank Math SEO

      1. Go to your WordPress Dashboard and click on Rank Math > General Settings.
      2. Click on the Edit robots.txt tab.
      3. Paste your generated code into the text area and click Save Changes.

      Method 2: Using Yoast SEO

      1. Go to Yoast SEO > Tools in your dashboard.
      2. Click on the File editor link.
      3. Look for the robots.txt section, paste your code there, and click Save changes to robots.txt.

      Method 3: Direct Upload via cPanel (Without Plugins)

      1. Open Notepad on your computer, paste the generated code, and save the file as robots.txt.
      2. Log in to your hosting cPanel and open the File Manager.
      3. Go to the public_html folder (root directory) of your website.
      4. Click Upload and select the robots.txt file you just saved.

Post a Comment

Do not write spam comment