If Lemmy gets big enough, google will work on any customized scraping of the fediverse they need to add in, because it’ll be in their best interest. They might already be able to since Lemmy isn’t private for non-logged in users.
In fact as a user of one different forum I was able to witness search engines logging in as bots for better access. I know this sounds made-up, but the forum was made with/powered by Xenforo. Btw XDA forums and lot of other forums are also made with xenforo. It’s possible that xenforo has a built-in support for search indexing bots, but I don’t reaľly know if that’s the case.
If Lemmy gets big enough, google will work on any customized scraping of the fediverse they need to add in, because it’ll be in their best interest. They might already be able to since Lemmy isn’t private for non-logged in users.
In fact as a user of one different forum I was able to witness search engines logging in as bots for better access. I know this sounds made-up, but the forum was made with/powered by Xenforo. Btw XDA forums and lot of other forums are also made with xenforo. It’s possible that xenforo has a built-in support for search indexing bots, but I don’t reaľly know if that’s the case.