Woah! Congratulations!!! 🥳 🎉

For mander.xyz it has been bot scrapers. That time that you are mentioning it was scraping via the onion front end that I am hosting for easier access over Tor. Yesterday an army of bots scraping via Alibaba cloud servers made the server unusable for a few minutes. The instance would receive a bunch of requests from the same IP range (47.79.0.0/16), and denying that full IP range fixed the problem.

Some instances implement anti-bot measures. For example, https://sopuli.xyz/ makes use of Anubis. I think that instances behind Cloudfare get some protection too. I am considering using Anubis for mander.xyz, but for now I have just been dealing with this manually as it does not happen too often.

No problem! Happy to contribute

Thanks!

I don’t see those specific IPs, nor 16514. But now I see what scrapers tend to look like in the logs :)

I am now pretty sure that the cause was scraper-like activity coming from the Mlmym front-end that I am serving over an onion site. I am not sure if it randomly started mis-behaving or if a tor scraper was using it.

After blocking this, federation was restored, performance increased, and CPU use came down:

I just realized that it is not a ‘scraper’, the requests came from the server that I am using to provide an interface to the site as an Onion site. The amount of requests was suspiciously high so maybe a bot is scraping through Tor. I will leave it off for a few days and see if I can turn it back on later.

Thanks! It seems like the lag may have been due to a scraper

I did not update or change anything in the past few days.

But, now that you mentioned an AI scrapper I looked into the logs and noticed some heavy requests to the API from a specific IP.

Requests look consistent to scraping - just consistently and continuously issuing GET requests to different API endpoints.

XX.XX.XX.XX - - [14/Oct/2025:21:28:54 +0000] "GET /api/v3/community/list?limit=20&sort=TopAll HTTP/2.0" 403 107 "-" "Mlmym"

I have started denying their requests and it is the first thing that seems to have actually helped!

I don’t want to speak too early but I think you may have identified the cause. Thanks!

So far, I have been able to ‘control’ the CPU use by setting limits to the process that pulls stuff from the database (pool size, CPU, memory).

This does release some of the CPU for other tasks, but I think that that what creates the lag might actually be the clogged database queries. So, constraining those resources might not solve the lag problem.

Hmm, thanks!

I just made another change. I am not sure why the database suddenly started taking up so many resources, so I have reduced the amount of resources available to it. It did reduce CPU use to 80% as opposed to 100%, but it is still somewhat laggy for me.

I can see that since October 13 the CPU use spiked to 100%…

I just reset the server to check if that would fix it quickly. It don’t think it did.

I can see the processes that are taking up a lot of CPU (parallell database queries it seems), but I still don’t understand what is causing these and why they have spiked since Oct 13. I will need to investigate.

I’d rather pay for preventing the front passenger from reclining into me.

I would take a portable CD player, place a CD with Rick Astley’s Never Gonna Give You Up on it playing backwards, hook up solar panels, remove the ability to shut it on/off, and set it up a circuit that will:

• As the device solar charges, keep it off until some voltage threshold is exceeded
• Once the voltage is high enough, start a random timer (8 - 100 hours), so that it is not immediately obvious that the sun activated the device
• When the timer ends, turn the music on on repeat mode
• Sometimes turn the music off at random, and then turn it on again at random after a long delay, so that in some cases you can have turn ‘ON’ events without the device being exposed to the sun
• When the voltage drops below a low threshold, turn the device off until it is charged again

I speak spanish natively and at during uni I would hang out with a group of Brazillian friends. I would speak a mixture of portuguese and spanish with them.

The mom of one of these friends made a Brazilian dish for us (Feijoada) and asked me how it was as it was the first time I tried it. I answered that the dish as ‘exquisito’, which in Spanish means delicious (similar ‘exquisite’). She seemed somewhat disappointed and upset by my response so I probed a little and found out that ‘esquisito’ in Portuguese actually means ‘weird’. She thought I was calling her dish weird tasting. I found quickly enough to clarify, but I did feel bad about making her fell that way… She was very excited about sharing her cooking and she thought I called it weird.

No worries! If you need me to test something with it I can this week, just let me know

I am currently near Cologne in Germany. I placed one of these LycaMobile SIM cards from NL and it activated automatically. It does recognize that it is connected to the German network and roaming, and still activates data and assigns a phone number.

So, it seems to work fine

It’s spider season! That’s very normal in September/October. At least in the Netherlands but I imagine it’s similar in the UK.

I didn’t know about Foxes. I very rarely see them.

El del presidente de los eeuu no lo vi… Cual es? Mi favorito es el de Willem Alexander: https://www.youtube.com/watch?v=HbgPqccCQcs

The use-cases that I see advertised are not things that I do in my day-to-day. I usually place my phone on a drawer or leave it in my backpack - I definitely don’t want it on my face.

So, to me, smart glasses feel like an uncomfortable gimmick at this point. Maybe there is something amazing about them that has not yet clicked with me, but for the time being I don’t see me buying one of these for the foreseeable future.

I also did not know of him at all. I did know who Ben Shapiro is. This week has been an educational one: I have learned about Nick Fuentes and ‘groypers’, Candace Owens, and that the change my mind meme guy is called Steven Crowder (I first thought it was this guy when I saw the video of Kirk).

The US political commentator that I do watch some times is Hasan, but not too often. The US lore goes too deep and moves too quickly, hard to keep up.

Jajaja, al menos lo intentó 😅 Un 8 por el esfuerzo!