Allow website to be indexed by search engines
This is the output of curl --head https://www.hifis.net
.
HTTP/2 200
server: nginx
date: Tue, 15 Jun 2021 10:39:10 GMT
content-type: text/html
content-length: 42636
last-modified: Tue, 15 Jun 2021 05:44:03 GMT
etag: "60c83e23-a68c"
strict-transport-security: max-age=63072000; includeSubdomains; preload
x-frame-options: DENY
x-xss-protection: 1; mode=block
x-content-type-options: nosniff
x-robots-tag: none
accept-ranges: bytes
The header as shown below contains the element x-robots-tag: none
. This prevents search engines to index our page. This is why we don't appear in Google, etc.
To fix this, the web server needs to be configured in a way that it doesn't set the x-robots-tag
to none
.