Hi, Once in a while I try to clean up my tabs. First thing I do is use “merge all windows” to put all tabs into one window.

This often causes a memory clog and firefox get stuck in this state for 10-20 minutes

I have recorded one such instance.

I have tried using the “discard all tabs” addon, unfortunately, it is also getting frozen by the memory clog.

Sometimes I will just reboot my PC as that is faster.

Unfortunately, killing firefox this way, does not save the new tab order, so when I start firefox again, it will have 20+ windows open, which I again, merge all pages and then it clogs again !

So far the only solution I have found is just wait the 20 minutes.

Once the “memory clog” is passed, it runs just fine.

I would like better control over tab discard. and maybe some way of limitting bloat. For instance, I would rather keep a lower number of undiscarded youtube that as they seem to be insanely bloated.

In other cases, for most website I would like to never discard the contents.

In my ideal world, I would like the tabs to get frozen and saved to disk permanently, rather than assuming discard tabs can be reloaded. As if the websites were going to exist forever and discarding a tab is like cleaning a cache.

  • Onihikage@beehaw.org
    link
    fedilink
    English
    arrow-up
    0
    ·
    edit-2
    21 days ago

    Sidebery (FOSS, MIT license) has several features that could be used to help you merge thousands of tabs into one window without choking out your memory usage, and generally makes it really easy to organize a massive amount of tabs. It would take several steps. First, you’d right-click the panel (the top-level organizational unit in Sidebery, above the tabs) on each window and select Save to bookmarks (example folder structure: selecting Bookmarks Toolbar/merge/ for a panel named panel1 would save the tabs under Bookmarks Toolbar/merge/panel1; click a folder twice in the selection dialog to expand it). Then you’d close that window and repeat with each window, being careful with the panel names so as not to overwrite any other window’s tabs. Once you’re down to one window, create an empty panel, right-click it, and select Restore from bookmarks. From this dialog, selecting the top-level folder that all the other bookmarked panels reside in (Bookmarks Toolbar/merge/ in this example) will import every tab from every window that was bookmarked, grouped by the window name.

    When Sidebery imports a panel from bookmarks, the tabs are imported in an unloaded state, so they have basically no effect on memory until you actually click into them and load them. I can restore about 50 tabs per second from bookmarks without my system even slowing down, taking me from 0 to 500 tabs in about 10 seconds. It’s not exactly a one-click option, but I wager it will be significantly faster and less prone to completely breaking than your current workflow, and a little easier to back up (even if window/session states get wonky, bookmarks sync pretty much instantly).

    Once your tabs are all in the same window, you can load tabs you want loaded by selecting a bunch (ctrl-click, shift-click, etc., just like in file explorer) and refreshing them, presumably avoiding YouTube tabs (should probably download those with YT-DLP anyway if you want to keep them). Sidebery will actually limit how many tabs it reloads at once, so it’ll never choke out your system by trying to instantly load a thousand of them (unlike if you select “open all in tabs” in Firefox’s native bookmarks context menu… eurgh). Even if it isn’t faster (though I suspect it is) the browser is at least usable while that’s going on. I’m not sure how well this method preserves containers, mainly because I don’t use them, so if you do, keep an eye on that if you test it out. All I know for sure is Sidebery supports reopening a tab in a new/different container because that’s in the default context menu.

    There’s more time savings than just window merging and tab loading, there’s the tree-style viewing, being able to collapse whole trees of tabs you aren’t actively paying attention to, seeing the full titles of 30-40 tabs at a time, no more sideways scrolling, a built in search bar to filter shown tabs by title, fully customizable keyboard shortcuts and context menus… it’s actually incredible how much this addon can do, and not only does it have a lot of settings and customization that should let you tailor its behavior to exactly how you want it, you can even sync its actual settings through Firefox! (just make sure to set your device name) Only thing it can’t do is remove the tab strip to give you more vertical real estate, but Mozilla might be working on that.

    I know what it’s like to be attached to a cumbersome workflow. I hope this can help streamline things for you a bit and make life with ~2,000 tabs just a little less troublesome.

    • tyler@programming.dev
      link
      fedilink
      arrow-up
      0
      ·
      21 days ago

      Yeah I was going to suggest sidebery as well, but not because of the window merging stuff. It just makes handling thousands of tabs much easier. I’m pretty sure that OP’s problem is the add-on he is using can’t handle his workflow and that it has absolutely nothing to do with Firefox. Because I can drag and drop several hundred tabs from one FF window to another in sidebery without ff even so much as sneezing.

  • Undaunted@discuss.tchncs.de
    link
    fedilink
    arrow-up
    0
    ·
    21 days ago

    I have no direct solution to you exact problem but your usage of tabs sounds like a nightmare.

    A while back I found Omnivore which works like a charm if you want to “freeze” the contents of a website to read them later. You can also self host it if you like.

    I took it a step further because I love Obsidian as personal knowledge management and I want to have everything in one place. There’s a plugin to sync all your saved pages from Omnivore to Obsidian. In the template for it I then have my marked highlights, the links to the version in Omnivore and the original URL and also the whole content. So I have all of that in markdown which is really nice to work with.

    Maybe that’s a solution you too could be happy with.

    • interdimensionalmeme@lemmy.mlOP
      link
      fedilink
      arrow-up
      0
      ·
      21 days ago

      Thanks, never heard of Omnivore

      “Distraction free. Privacy focused. Open source”

      They do hit the right notes. I was going to try QOwnNotes but I’ll put that on my list.

  • orcrist@lemm.ee
    link
    fedilink
    arrow-up
    0
    ·
    20 days ago

    From a practical standpoint, it’s hard to imagine what you could possibly be doing where it’s beneficial to have a thousand tabs open.

    If I’m writing a research paper, I might want 5 or 10 tabs open at a given time. Let’s say I’m a little chaotic so I get up to 20. And then limitations on my working memory kick in, and having any more open tabs actually makes me worse off.

    But then let’s suppose it’s a thesis that’s 50 pages long. So I might be relying on 40 or 50 references. I’m not relying on them all at the same time, right? So I definitely don’t want to keep those tabs open all at the same time.

    What I could do, and what you could consider, is either bookmarking things or using archive.org to make a backup of the pages.

    In one of the other comments you mentioned Facebook. That has me a little concerned again with your objectives. If it’s something private on Facebook that can’t be recovered later, and you need something reliable, then you have no choice but to do long screenshots or scrolling videos. If it’s not reliable, then why do you care so much to keep the window open? Just close the window, remember whatever you remember, and move on with your life.

    Whatever you do, here’s a few rules of thumb… Your web browser is not an archiving tool. Printing to PDF is one way to archive things. There are other ways to archive things too. You don’t actually need to archive as much as you might think you need to archive. Most of the things that we think might be important now actually won’t be useful at all three months from now. Rarely would one actually want to have a thousand sources of information for any given task.

  • TootSweet@lemmy.world
    link
    fedilink
    English
    arrow-up
    0
    ·
    21 days ago

    I’ve read this entire thread like three times and watched all the videos you’ve posted, and I still don’t understand your workflow at all.

    If searching bookmarks/history is harder than using Google to just find the thing you want to get back to, why do you need to keep the things you want to get back to open rather than just using Google to find the page again later? Or when you want to get back to something you (think you?) have left open, do you find it just by scrolling through all your tabs until a title/favicon looks like what you’re looking for?

    Your last paragraph makes it seem like maybe you want to keep the tabs open so if the page/content gets deleted off of the server, you don’t lose it. Is that correct? I’d imagine that doesn’t always accomplish that, though, right? (Particularly for something like YouTube.) If that’s a significant part of why you keep the tabs open, though, maybe that bit at least is a good question for a data hoarder community.

    I haven’t been able to find any “discard all tabs” addon for Firefox by Googling. And I can’t guess what exactly it does. (Does it save tab states to disk and suspend - but also leave open - all tabs or something?) Are you sure that’s the name of the addon you’re using?

    • interdimensionalmeme@lemmy.mlOP
      link
      fedilink
      arrow-up
      0
      ·
      21 days ago

      why do you need to keep the things you want to get back to open rather than just using Google to find the page again later?

      If it’s already in memory, that’s one few step to reach it.

      My tab manager can’t search google

      do you find it just by scrolling through all your tabs until a title/favicon looks like what you’re looking for?

      I search my live memory with Tab Manager Plus

      Sadly, it can’t search tab body text, only tab titles.

      if the page/content gets deleted off of the server, you don’t lose it. Is that correct?

      My software should not discard data without my permission. When it runs out of RAM it should dump to disk cache, not delete. But browser have the builtin assumption that the web remembers everything, which is false. I also think bookmarks should save all tab data, all text, all images, all code, all video, and the code should remain as functional as possible. That’s a long way off, currently the only way to do that is freeze the tab with its browser and operating system inside a virtual machine live snapshot.

      I haven’t been able to find any “discard all tabs

      I believe this one can do, discard selected tabs, but not discard all tabs

      https://addons.mozilla.org/en-GB/firefox/addon/discard/

      Discard is the action where all tab content is deleted, keeping only URL, title and favicon

      I haven’t found discard all tabs either.

      I would like “stop all tabs” to work

      https://addons.mozilla.org/en-US/firefox/addon/stop-all-button/

      But it will only work after firefox has cleared the clog, it currently freezes with the rest of the browser.

      • TootSweet@lemmy.world
        link
        fedilink
        English
        arrow-up
        0
        ·
        edit-2
        21 days ago

        If it’s already in memory, that’s one few step to reach it.

        I search my live memory with Tab Manager Plud

        Oh, so you’re doing something like Googling just to find the page title and then rather than clicking the link in Google, (closing the Google results page, I hope and) searching through your tab titles with Tab Manager Plus to find and switch to the open tab where you already have the page in question open?

        Though, I still don’t understand why you keep the tab open in the first place rather than juat closing the tab when you’re (at least for the moment) done with it and then Googling to find the content again and clicking the appropriate link to get that same content in a new tab when you do need it again. I asked whether the reason was so that if the content is removed from the server, you didn’t lose it, but I don’t think anything you said in your last post answered that question. You did say:

        My software should not discard data without my permission. When it runs out of RAM it should dump to disk cache, not delete.

        Which wasn’t quite a direct answer to my question. And you then directly admit that the browser doesn’t even keep content that’s open in a tab:

        But browser have the builtin assumption that the web remembers everything, which is false.

        So that must not be why you keep content open in tabs, right?

        Is it maybe something like if you keep something open in a tab, the presence of that page title in your tab manager gives you confirmation when you later Google to find the page title that such-and-such particular result in the Google results is indeed the thing you’re looking for and not a different page than the one you were looking for?

        Just as an aside, my web browser use is probably atypical as well. I have my browser forget all cookies, history, cache, etc (basically everything but my bookmarks) every time I fully close it. And I close it every time I switch activities to keep my online personas isolated from each other. (So I’m never logged into my Google account and my Amazon account at the same time, for instance. To reduce targeted ads and such.)

        Also, I’m wondering if something more like a caching proxy with maybe page searching capabilities and finegrained control of what is cached and what isn’t might fill part of your use case, but I still don’t have a firm grasp on your use case.

  • chillhelm@lemmy.world
    link
    fedilink
    arrow-up
    0
    ·
    21 days ago

    I’m not going to tell you that you’re managing your information wrong. I would physically die if I had ever more than 20 tabs (my ADHD couldn’t handle it).

    But I think you might be using the wrong tool. A browser (like Firefox) is not really designed as an information manager. It’s primary purpose is navigating and visualizing web pages. So when you talk about “a few megabytes of text and images” thats not what your browser sees. Your browser handles more than just the text and images. It also handles fetching and prefetching, a browser history for every tab, a JS context and much much more.

    What you want is some kind of personalized archiving system that processes websites into machine processable (ie searchable) structures. Firefox is not that. Maybe data hoarder communities will have the answers you seek.

    • interdimensionalmeme@lemmy.mlOP
      link
      fedilink
      arrow-up
      0
      ·
      21 days ago

      Well so far, it would be too much friction and extra labour to export each tab to external software.

      I’m not even sure what software other than a browser would display live web pages in a more organized manner than firefox ?

      I’m pretty sure I just hit a bug that’s causing firefox to wake up too many tabs and not handle tab discarding correctly. Firefox does seem like the best tool still even if it’s not working right.

      What I would like instead is a browser that treats tabs more like virtual machines that you can roll back, suspend to disk and resume. Little package of data that get frozen in time and are externally searchable.

      Anyway, here’s my setup

      • chillhelm@lemmy.world
        link
        fedilink
        arrow-up
        0
        ·
        21 days ago

        What I would like instead is a browser that treats tabs more like virtual machines that you can roll back, suspend to disk and resume. Little package of data that get frozen in time and are externally searchable.

        Maybe look at ArchiveBox. IIRC it has pretty much everything you ask for including an import from your browser history and bookmarks.

  • Skunk@jlai.lu
    link
    fedilink
    arrow-up
    0
    ·
    edit-2
    21 days ago

    I am not sure what you’re working on but from your answers I’ve read you seems to need access to a lot of information with a few keystrokes, like searching for a keyword or tag.

    In my opinion you are using the wrong tool for that. Ditch the browser and learn about the Zettelkasten way of working. It is really powerful for plenty of applications like science, studies, dev, or even the way I use it, author repository of ideas/concepts/stuff I need when writing a book.

    You can do that with several software but I like obsidian for that (and because of all its plugins you could probably find something to automatically copy webpage content)

    On the downside side :

    • You’ll have to learn Zettelkasten, Obsidian etc
    • Obviously do the work of writing (or copy pasting) your vault.

    But on the plus size :

    • You’ll have all the information you need at your fingertips, searchable with keywords, tags, associations etc.
    • Everything is basic text MD files so it will still be readable by any text editor or terminal in the next century.
    • You can have images, run code, do some mathlib, jupyter etc inside.
    • Text is light, easy to store, backup and retrieve.
    • If you do good enough you can have a satisfying visual representation of your new brain, kinda mindmap (which is also possible)

    • interdimensionalmeme@lemmy.mlOP
      link
      fedilink
      arrow-up
      0
      ·
      21 days ago

      Cool I would love to navigate my data in a manner similar to this. However not obsidian, I am in the process of de-googling and I have severe cloud fatigue. But maybe QOwnNotes

      I’m hoping something like Archivebox or squid or some other software can help me, autodump everything in a way that will become accessible to these second party data management software. Hopefully in a manner as transparent as opening a tab.

    • interdimensionalmeme@lemmy.mlOP
      link
      fedilink
      arrow-up
      0
      ·
      21 days ago

      Yes, I find that it identical to closing a tab. I never go in the bookmarks manager after. It is very clunky to use, it adds extra steps compared to keeping the tab open. At that point, it’s usually easier to use google to find it again, since at least google can search text inside the page, not just the title. I do occasionally dump my thousands of tabs into the bookmarks managers, in a single unusable folder. It hasn’t yet happenned that one of these tabs was retreived. But I hope in the future that I could dump all these tabs into another piece of software that will fetch all the tab’s body data and allow me to search it all with a local LLM based search like “using my bookmarks, create one browser window with all URLs on the topic of the 7 megahertz maser” We’re close but not there yet.

      • originalfrozenbanana@lemm.ee
        link
        fedilink
        arrow-up
        0
        ·
        edit-2
        21 days ago

        Then you will have software that doesn’t work. This is not a Firefox problem, or a problem of extensions, or anything but a user problem.

        If your 1998 Toyota Camry is struggling to haul a cargo container up a hill it’s not the car’s fault. You’re doing it wrong. Whatever tasks you’re trying to do with 1000 tabs, a web browser is the wrong tool for the job.

  • sgtlion [any]@hexbear.net
    link
    fedilink
    English
    arrow-up
    0
    ·
    21 days ago

    I tend to have ~10,000 tabs because I obsessively fail to clean up. But it never takes much memory or cpu, my PC isn’t amazing yet Firefox is always lightning quick.

    I’ve never used the discard or merge windows features though, I can see why those might cause issues. I assume these two functions just aren’t optimised for so many tabs.

    One addon I might recommend to help keep numbers down is Duplicate Tab Closer, which has options to specify how similar tabs can be to be considered duplicates, and also will detect across all open windows if desired.

    • Possibly linux@lemmy.zip
      link
      fedilink
      English
      arrow-up
      0
      ·
      edit-2
      21 days ago

      It blows my mind how many tabs people open. I rarely use more than 4.

      I feel like Firefox should just start hard limiting the number of tabs.

  • oscardejarjayes [comrade/them]@hexbear.net
    link
    fedilink
    English
    arrow-up
    0
    ·
    21 days ago

    Oh, hmm, interesting. I would simply not bother trying to clean up your tabs (it’s what I do, 6476 baby!).

    Perhaps consider also getting more RAM. 128 is good, 256 is better. Thanks to ddr5, ddr4 isn’t all that expensive now (and 5000 series can’t use ddr5 anyways).

    • interdimensionalmeme@lemmy.mlOP
      link
      fedilink
      arrow-up
      0
      ·
      21 days ago

      I got some old HP G8 DL380 servers with 384GB ram in each, I am investigating running firefox in a VM on them and then somehow making only the firefox window appear on my PC. That would be awesome. I would have practically unlimited ram !

  • enbyecho@lemmy.world
    link
    fedilink
    English
    arrow-up
    0
    ·
    20 days ago

    You are manually caching web content. Were you aware that (a) your browser does that for you; (b) the internet does that for you ?

    I’m as guilty of this as anyone and can tell you from experience that it’s sutpid.