inference
03d7141525
"robots.txt" is a file which allows the website owner to disallow bots, crawlers, scrapers, and other potentially malicious or unwanted behaviour on their website.
6 lines
125 B
Plaintext
6 lines
125 B
Plaintext
# Inferencium - Website - robots.txt
|
|
# Version: 0.1.0
|
|
|
|
# Copyright 2024 Jake Winters
|
|
# SPDX-License-Identifier: BSD-3-Clause
|