https://imgur.com/a/U4u0JA2 Admittedly it is just one site, but it feels suspicious because its asking for permission from port 443?
That is normal https port, some websites may reference it directly while others skip it, it is fine. You can edit permissions on a per site basis to always ask, block, or allow location access by clicking on the lock icon > Connection (secure/unsecured) > More Information, then change to Permissions tab and set it how you want.
If tired of being prompted about location on all sites you can go into Settings > Privacy & Security, scroll to Permissions, click Settings next to Location, click ‘Block new requests’ and save changes. Per site allow/block/ask can still be configured.
Blocking it browser wide worked, but it is a bit inconvenient; the site was prompting everytime i was just browsing it even though i clicked remember the decision.
Is it always exactly the same site URL?
That’s not suspicious, that is the normal port for it to run on. It is not typical that they would include the port number but they may use a different one for testing and automatically change it or something.