Home
Blogs
Services
Contact
Robots.txt Generator Online for Free
Rule 1
User-agent (e.g. * or Googlebot)
Type
Allow
Disallow
Path (e.g. /admin/)
Add Rule
Crawl-delay (seconds)
Sitemap URL
Code
Copy
User-agent: * Disallow:
Home
Blogs
Services
Contact
Meta Tags
Common Meta
Open Graph
Article
Book
Business
Music Album
Music Playlist
Music Radio Station
Music Song
Product
Profile
Video
Video Episode
Video Movie
Video TV Show
Website
Twitter Card
App
Player
Summary
Summary with Large Image
Structured Data
Article
Book
Breadcrumb
Carousel
Course
Dataset
Education Q & A
EmployerAggregateRating
Estimated salary
Event
Fact Check
FAQ
Home Activities
How-to
Image Metadata
JobPosting
Learning Video
Local Business
Logo
Math solvers
Movie
Practice problems
Product
Q&A
Recipe
Review snippet
Sitelinks Search box
Software App
Speakable
Subscription & Paywalled
Video
Robots.txt
Robots.txt Generator
Sitemap
Sitemap Generator
Robots.txt Generator Online for Free
Rule 1
User-agent (e.g. * or Googlebot)
Type
Allow
Disallow
Path (e.g. /admin/)
Add Rule
Crawl-delay (seconds)
Sitemap URL
Code
Copy
User-agent: * Disallow:
