>>24502 Update. >I also use hydownloader and it works for twitter for me. I'm not sure what I did, but I think I probably sent my cookies over through hydrus companion. Thank you. This worked for me. I figured out how to do it. Some of them have multiple "twitter tweet" media things. I'll have to fix that. Another tangential thing. This happens with every downloader (WF downloader and Hydrus) I've tried. The site (Twitter in this instance) always lists more posts than I get downloaded. >165 vs 135 Am I doing something wrong?

>>24509 I think all I had to do for hydownloader was add these two things to hydrus-companion. It's right under the hydrus api access stuff. You can find it in hydownloader's data directory within the file "hydownloader-config.json".

>>24509 For instagram, you need the url mapping, even if hydrus doesn't download instagrams it needs a way to "label" the urls, for lack of a more technical term. So if you have the instagram downloader from the user repo (https://github.com/CuddleBear92/Hydrus-Presets-and-Scripts) it should be toggleable even if it doesn't work for actual downloading. I attached everything I have that matches instagram in pic 2 in case instagram got removed from the user repo for being nonfunctional. >>24510 >The site always lists more posts than I get downloaded It may be seeing posts that don't have pictures or have already been imported. If the guy reposts the same picture hydrus will see the file matches an already existing file and will simply associate the new url with the picture, there's no reason for exact duplicates, see pic 3.

>>24506 I booted 644 after a backup since the changelogs seemingly had a lot of db stuff and it felt slower to populate than usual? But it may have been the transparency checking also happening, not sure. Although the hangs I usually get from procrastinating cleaning up hydrus seem lesser than usual so I guess it evens out.

>>24511 I already figured it out. I had to do that which I did before making the post and I had to edit the "import cookies" option in the settings. Third pic I had to add 'api = "hydownloader"' >>24512 I found why every image had multiple Twitter options. It was displaying the same link twice with a minor difference. The Github you linked worked well. Thank you! It didn't use the tags that Hydownloader grabs but it's works besides that.

Hey hydev does your visually similar auto-resolution use gpu acceleration or lots of compute or something? I have some hardware issue causing kernel panics that I've never been able to properly nail down, it is generally caused by sudden bursts of computer load, and I think hydrus is triggering it with whatever happens when trying to find visually similar pairs.

>>24515 >I have some hardware issue causing kernel panics that I've never been able to properly nail down, it is generally caused by sudden bursts of computer load If you have a Zen cpu disable power state 6, it causes a hardware fault in some chips. If not it might still be something similar so look up things along those lines for your chipset.

I'm not sure whether this is still a problem, but could you add an automatic bypass for when in something like URL import, the entire import queue hangs because one of its items has hit a bandwidth limit, even if there are further items that don't have the same bandwidth limit? To be more specific, say I download the default 2GB off rule34, but then queue up more downloads off 4chan. I want it to download the 4chan files immediately because they might be gone tomorrow, but it'll hang for 24 hours on the rule34 download before going any further and it needs manual intervention.

>>24515 shot in the dark, but I recently fixed some incessant graphics hardware hangs with the swiotlb=65536 kernel parameter. https://wiki.gentoo.org/wiki/IOMMU_SWIOTLB#SWIOTLB_for_high_input_output_(such_as_graphics)

>>24519 >>24517 I'll check these out when I get the chance, thanks bros.

I just realized that my hydrus isn't downloading any loli from gelbooru like a non logged in acc but I do have a login, what do I need to do to fix that?

>>24341 I'm new to Linux so I'm still learning it. Will having two versions of Hydrus on my PC not mess anything up with the database?

>>24534 Scroll Up It's a http header you need to import, gelbooru doesn't check account status for it because they already track that option for anon users as well

>>24488 Not with this system. Before I overhauled it to the current 'virtual only' system, It supported a mix of 'hard' mappings replace and soft/virtual display-only swap-ins. It was a huge mess to deal with with many bugs, so I decided to move to entirely soft/virtual, where no mappings are hard-replaced and any decision has 100% undo-ability. I am thinking and generally planning to add a hard-replace system, something a bit like tags->migrate tags, that will be one-off powerful jobs you fire. I'm sure it will talk to siblings and allow you to hard-collapse some stuff, but there is often little actual benefit in doing this and often a bunch of frustrating pains in the ass when something unexpected happens. >>24507 I've noticed what I'll call 'navigation' lag in the past say three months in my IRL client. I click on a page tab, and one in fifty times when big imports are going on it might take 800ms to actually switch tab. I am not sure if it is the page doing some 'on page show, recalculate some taglist stuff' or if it is just some file import job eating up some CPU. I'll keep working here, so please continue to let me know how this goes, and feel free to send in some profiles as under help->debug->profiling. >>24508 It is a long story, and the answer is 'somewhat'. Basically if you import a zip full of numbered images that looks like an ugoira more than a cbz, we call it that and we've got some rendering tech. The big source of Ugoiras online, Pixiv, has some jank javascript solution to deliver frame timings, and I've been holding off for years on actually downloading Pixiv Ugoiras (the default hydrus Pixiv downloader skip/vetoes them) because I've wanted a nice way to grab this timing data and put it in a note text or .json file or something to actually embed in the Ugoira zip, but there's no really nice solutions so it all got put off. We have the note-parsing tech for synthetic framerate, which is part of what I did last week, but no nice Pixiv site-parsing solution to grab it yet. If you grab an Ugoira from danbooru or something, hydrus will import it and usually render it with a fixed framerate of like 12fps. Fingers crossed we'll one day figure out a nice solution here and we'll finally be able to get them from Pixiv, with accurate variable frame rate. Most of this work was done by a user who was keen to make Ugoiras work, and I am very grateful. I'm personally a little pissed off by the whole decade-long debacle; the way Ugoiras work behind the scenes is dumb, and imo the whole thing should have been converted to apng or something years ago (although webm is fine because almost all Ugoiras these days are jpegs rather than pngs anyway, defeating the original cool thing they did), but I'm really just expressing my frustration. >>24513 Ok, thank you. Some jobs were split into smaller pieces or made more polite, so there is a little more overhead or just latency in order to reduce lag. Some of that I'm ok with. Let me know how this continues to go, and if you notice anything in particular hanging for ages, I'm interested.

>>24515 I can't talk about the hardware or config stuff here, but to answer this specifically--yes, mostly CPU. I basically render the image to a bitmap, resize it to 1024x1024, cut that guy into like 64 tiles, and do some hardcode histogram and gaussian blur math on it. There might be a touch of GPU in there, at least initially, but it'll mostly gonk one CPU core for, I'd say, 50-400ms depending on the image and your machine and stuff. I haven't properly profiled this IRL though, so it may be a bit faster, and the follow-up delay is other stuff all floating around the duplicate filter or auto-resolution. I assume you have some duplicates auto-resolution rules that use the new visual duplicates stuff, or is this in the duplicate filter? If you do have a rule doing this, if you want to test, try turning off the duplicate auto-resolution rules work in 'normal time' and 'idle time' under the cog icon in a duplicates page->auto-resolution tab. The rule won't do anything and no visual duplicates work won't happen outside of the duplicates filter. You can schedule this work under options->maintenance and processing also. I can't slow a single job down, but you can reduce the size of the bumps to minimum size by changing the 'packet time' for duplicates auto-resolution work to like 100ms and boost the rest percentage to like 9000%. That'll mean it usually just only ever does one meaty job and then takes a break for ten seconds. There are other times that hydrus eats up CPU. The bigger your client, the more it'll happen. Similar files search can be pretty meaty, and PTR processing, and file imports in general. If you've noticed this just recently, I'd hesitantly say that it might be on the OS side, some new driver update or something, since most of my work in the past year has been in reducing the size of jobs and spreading things out to be less rude, with the exception of the visual duplicates test, which is indeed new and does some hardcore math on memory. Let me know what you figure out, and if I can fix anything or add any new options, I'll give it a go. >>24518 I have a plan to deal with this, and similar stuff for waiting on domain errors, where we'd rather retry later. Unfortunately it will take quite a bit of cleanup and overhaul work in the 'file log' and some downloader stuff. I have it in mind, but I can't promise it any time soon. It sucks, but the best solution for now is to split large URL downloaders by rough domain, or have a separate one for a regularly bandwidth-choked domain.

In one of my duplicates auto resolution rules, I found a pair that was resolved as a better/worse pair, but the notes weren't merged. The worse file has a note with body text that's the exact same as the better file's note, but the better file and worse files' notes have different names. For some reason, the note from the worse file wasn't merged to the better file. Is this intentional, and if so, is there a way to change it so that the note is always copied to the better file even if they only have a different name but the same body text? I have the "if possible, extend existing note" setting enabled, but that says that it only happens if the notes have the same name. I also have the merge conflict setting set to "add note under new name" so that shouldn't be the cause of the issue either. So I don't know why this is happening.

>>24540 >Not with this system Figures, I just thought it was annoying to see all these tags I set as children pop up constantly everywhere whenever I tagged shit that I'd add in my database. It's a bit distracting, especially when the children has more tagged images than the parent.

>>24547 If the issue you're having is that you just don't want to see the tags, you can hide them from being displayed with a button in the tag's context menu.

>>24515 Hardware issue causing kernel panics? Run a deep memory test. >>24536 Each version of hydrus uses a specific database scheme. When upgrading hydrus you can see the database gets upgraded through every version you skipped. I recommend against mixing versions.

>>24541 Yes, it was the visual duplicate processing in auto resolution. I once had a panic right in front of me after I did "review actions" in semi-auto after just adding a visually similar pairs and i've had it panic while I wasn't there when it was processing in the background. I've had visually similar processing paused since then.

>>24536 >>24552 >I recommend against mixing versions. It's perfectly fine to run two separate clients/databases with different versions though.

In 643, "furaffinity.net favorites page parser" gets the urls with its "content parsers" "urls - post page urls", but the urls are not used in the final (empty) result.

In the duplicates auto resolution rules, I wanted to add a comparator that checks that files A and B don't share any known urls. Is there some way to accomplish this with the kinds of comparators that currently exist? If not, would you mind adding a comparator like that, sort of like how the ICC profile value comparators work? I wanted to use that kind of comparator in one of my "riskier" rules as a way to avoid files that share a post url from being paired up by the rule, since I've found that files are much more likely to be alternates if they come from the same post.

I had a good week. I did the duplicate db tech thing I wanted, and I figured out an mpv test that may fix some long-term issues. The release should be as normal tomorrow.

I have my search distance for potential duplicates discovery set to 8. Is it safe to set this as the max search distance in auto-resolution rules? Since the "almost definitely visual duplicates" comparator should still ensure that files A and B are actually duplicates, I think that it should be safe, but I just want to make sure since it's not the default.

https://www.youtube.com/watch?v=uzg3DFsnH3I windows zip: https://github.com/hydrusnetwork/hydrus/releases/download/v645/Hydrus.Network.645.-.Windows.-.Extract.only.zip exe: https://github.com/hydrusnetwork/hydrus/releases/download/v645/Hydrus.Network.645.-.Windows.-.Installer.exe linux tar.zst: https://github.com/hydrusnetwork/hydrus/releases/download/v645/Hydrus.Network.645.-.Linux.-.Executable.tar.zst I had a good week working on a mix of stuff. There's a new mpv test mode. Full changelog: https://hydrusnetwork.github.io/hydrus/changelog.html highlights For advanced users only: I figured out a wrapper that deletes mpv windows rather than re-using them. It doesn't seem to cause crashes any more. If you want to help me out, or if you often have a 'every other mpv window is mute'-style bug, please brace for a crash and try out options->media playback->TEST: Destroy/recreate mpv widgets instead of recycling them. Click a video and then unload it, try navigating from a video to an image, then video to video. Do you have any problems? Is anything fixed? I can't get it to crash, but if I scroll super fast, I can get a hang. 'review bandwidth use' now sorts its web domains so subdomains are below their parents. I'm renaming the advanced 'all local files' service to 'hydrus local file storage'. New users get it today, existing users are planned to get it in a couple weeks. If this breaks something for you, please shout at me. I'll do 'all my files' to something like 'all local file domains' soon too. The duplicates db tech improvement I wanted to do is done. You'll get a bit of work on db update this week, and your 'x pairs' numbers in the duplicates system will be better (they won't count some deleted stuff any more). next week I want to figure out fast duplicates search for very low hit-rate searches, like '5 pairs in 750,000'.

>>24480 >>24483 >>24506 Still experiencing tons of hanging on CachyOS since I switched from Windows to Linux. I run from source now and update using git_pull.sh. Experienced it on versions 642, 643, and 644, so no recent changes have remedied it. It seems to be happening more consistently though, as I used to have long periods free from it entirely. Most hanging occurs in the tag manger, with it hanging for 0.5 all the way to 5 or so seconds upon trying to load tag results, or trying to close the tag manager/apply the tags. It also crashed recently. I left it open and untouched for a few hours, and when I tried opening the window, everything but the info bar for the window and the window buttons was not rendering. Wasn't black either, it was empty and I could see other windows through it. After minimizing and maximizing a couple times to see if it clear up, it crashed. Instantly closed too, not a freeze where I had to manually kill the program. Since switching to CachyOS it's taken longer to initialing when restoring my tabs than on Windows, but after this crash it took much longer than usual. Curious to know if those logs I emailed the other day gave any insight into the issue? I'm considering seeing about running another install inside of WINE instead, but I'm not sure that will play nice with my db unless I put it inside the WINE prefix with it. Not sure about storing anything like that inside a WINE prefix at all. Updating to 645 now.

>>24573 Also, I must note, the hanging in the tag manager for tag searches happens even when searching the same query over and over. Been going though a lot of similar files that need tags that all start with the same word. While the very first search for that query can take the longest, repeated searches when the results I presume may still be in RAM can be instant on occasion but usually hang with variation now.

I've noticed in the last version, and this version, audio will continue playing after a file is deselected, until the end of the video is reached. This only happens if there is a very small length of the video left to be played, but can result in audio from two videos playing at once. It has not caused any more serious issues though.

After updating to 645 (from 643) some of the side panels like in the gallery download page have become about half the width of my screen, manually shrinking them causes them to cut off. I've seen this in the URL and gallery downloader pages, and the duplicates processor page, but with it changing tabs fixed it. An empty db doesn't seem to exhibit this behavior. Not sure if this is something I did accidentally or a slightly botched update.

In an auto resolution rule's "actions taken" tab, I'd appreciate if there was a way to open a pair that's in the list in a new page, kinda like how you can when you're in the filter. currently, I can't figure out any way to see a file that's been deleted (so I can check its metadata and such) since I can't open it to send it to a new page.

>>24546 Sorry for the trouble. The note merge options are really ugly and unintuitive. The logic behind the scenes is a pain too. I will have a look at it and try to make it more obvious what is supposed to happen, and then make sure I have unit tests to ensure that is actually happening, and I'll look at your exact report. >>24547 >>24548 Yeah. If I can get myself in order, I want to spend a bit of 2026 just revamping the 'manage tags' interface. It is too difficult to manage a bigass list of tags, and there should be more viewing/grouping/whatevering options to make dealing with siblings and parents not a pain in the ass. >>24564 Is this from this guy? https://github.com/CuddleBear92/Hydrus-Presets-and-Scripts/blob/master/Downloaders/furaffinity.net%20-%20version%202020-02-19%20-%20normal%20-%20AiO%20for%20Classic%20and%20ModernUI.png I'm afraid I don't make or maintain that, but did this happen to work in previous versions, and only now it is breaking in ~v643? I've been doing some URL handling changes in parsers recently, so let me know if I broke something. >>24565 Thanks, good idea. I'm hesitant to add too much 'dynamic metadata' comparator tech that examines things that can change, at least until we have a better grip or what works and doesn't here, but a hardcoded rule for 'no shared urls' is a good threading of the needle. >>24569 I'd say set it at 0 for now. My 'visual duplicates' comparator is way overtuned to never produce false positives, so I don't think it'll true positive for anything at distance 2+. You'll just be wasting CPU if you make the search encompass 'fairly similar' files. I'm working on this problem though and over the next months and maybe years I hope to make the 'visual duplicates' algorithm more capable at tuning out blurrier jpeg artifacts. I hope we can slowly expand the visual dupes search to encompass more stuff in future.

>>24573 >>24574 Your profiles were useful and I optimised some UI update stuff for the past couple of versions. I don't know how much was truly 'real' though, so let me know how v645 feels. I'm sorry to be lame, but if your client with its current sort of session and usage was ok in Windows but is now having trouble in this OS, it may more be that your OS isn't happy with the Wayland/X11 interpretation layer or compositor or Qt or disk access or some other complex Linux thing I'm not familiar with. The true solution here might be some conf, but I will keep working on optimisations, and I'm interested in fresh profiles in the latest code. I've noticed UI hitches in the past couple of months on my IRL client, where I'll click on a page tab and it won't show for 600ms kind of thing. I am not sure if it is new auto-resolution stuff or something else. I'm investigating it. >>24577 Please hit `options->media playback->LEGACY DEBUG: Use legacy mpv communication method` and restart the client--is it better? If so, leave that mode on and let me know your OS, hydrus install situation (source, AUR, built package?) and mpv version under `help->about`. >>24579 Sorry for the trouble here. It is probably the multi-column lists in those panels. In some random situations, I don't know how it happens or who for, my internal record of how wide one column should be, usually the rightmost one, goes crazy, like 135 characters, and then when I re-lay those pages down, they come up going 'oh, the user saved this column as being this wide, so I guess my minimum width should be 1100 pixels' or something similarly stupid. Please right-click the header of the affected lists and go like 'restore (list type) to default settings', and then resize your sidebar to what feels good and then restart the client. If this happens again, let me know if you remember what you may have done right before it happened. >>24580 Thanks--I'll make sure this gets done.

>>24582 >it may more be that your OS isn't happy with the Wayland/X11 interpretation layer or compositor or Qt or disk access or some other complex Linux thing I'm not familiar with That's probably it. I may just have to give up on it working smoothly because CachyOS doesn't like GUIs or something. It seems like if you want niche software to work on Linux, you'd need a deep understanding of the program, Linux, your distribution, your window manager, and Qt. Given everything has to go through the window manager and Qt regardless, I don't think even running it in WINE would help. >>24582 >Please hit `options->media playback->LEGACY DEBUG: Use legacy mpv communication method` and restart the client--is it better? This did not get rid of the audio continuing after deselect, but did make it so that the newly selected file could not begin playing until the audio from the previous file finished. OS:CachyOS Hydrus+MPV: Pic related

>>24583 Damn, ok, please keep me updated. I'm going to write some extra safety code for mpv this week that does stuff like 'only move to the next media when the current mpv window is safely "done"', which sounds like it will affect your situation. I moved to Linux Mint from Windows for my main desktop this year and found it a very pleasant migration experience outside of the normal Linux conf stuff you need for weird USB devices and so on. I would recommend it to anyone, including for hydrus.

>>24584 Maybe I'll switch to Mint. It was a lot of work getting everything I've got going now working on CachyOS though. CachyOS is the distro pushed as being pre-optimized for running games, besides Bazzite which is more aimed at dedicated portable gaming machine and is immutable. Looking around online, I think a lot of my issues are caused by Wayland, which has been forced recently upon KDE, which seems to be the standard DE for CachyOS. I think Mint's top DEs lack the issues of Wayland, and that's why everything runs smooth on your machine. At the very least, it would probably fix my drag and drop issues.