/t/ - Technology

Discussion of Technology

Index Catalog Archive Bottom Refresh
+
-
Options
Subject
Message

Max message length: 0/12000

files

Max file size: 32.00 MB

Total max file size: 50.00 MB

Max files: 5

Supported file types: GIF, JPG, PNG, WebM, OGG, and more

CAPTCHA
E-mail
Password

(used to delete files and posts)

Misc

Remember to follow the Rules

The backup domains are located at 8chan.se and 8chan.cc. TOR access can be found here, or you can access the TOR portal from the clearnet at Redchannit 3.0.



8chan.moe is a hobby project with no affiliation whatsoever to the administration of any other "8chan" site, past or present.

You may also be interested in: AI

(4.11 KB 300x100 simplebanner.png)

Hydrus Network General #11 Anonymous Board volunteer 02/05/2025 (Wed) 22:34:45 No. 17183
This is a thread for releases, bug reports, and other discussion for the hydrus network software. The hydrus network client is an application written for Anon and other internet-fluent media nerds who have large image/swf/webm collections. It browses with tags instead of folders, a little like a booru on your desktop. Users can choose to download and share tags through a Public Tag Repository that now has more than 2 billion tag mappings, and advanced users may set up their own repositories just for themselves and friends. Everything is free and privacy is the first concern. Releases are available for Windows, Linux, and macOS, and it is now easy to run the program straight from source. I am the hydrus developer. I am continually working on the software and try to put out a new release every Wednesday by 8pm EST. Past hydrus imageboard discussion, and these generals as they hit the post limit, are being archived at >>>/hydrus/ . Hydrus is a powerful and complicated program, and it is not for everyone. If you would like to learn more, please check out the extensive help and getting started guide here: https://hydrusnetwork.github.io/hydrus/ Previous thread >>>/hydrus/22247
Edited last time by hydrus_dev on 04/19/2025 (Sat) 18:45:34.
>>23632 I noticed my tag and rating hovers in the media viewer would not pop up when I had two or more media viewers open
>>23647 Thanks.
>>23634 "All Known Files with Tags" includes deleted files (as well as files that you have ptr tags for but have never passed through your client). the file's tags still exist after deleting. for an example, all the files in the attached screenshot are deleted. A file stops showing the trashcan icon on its thumb after its purged. if you want to search all your file services at once, use "all my files". "all known files with tags" is also limited to one tag service at a time anyways.
>>23630 If I recall correctly those blurred thumbs mean they were already deleted, that's the blurhash of them. Hydrus knows still knows about files after they're gone.
>>23666 Me again, if you click on the thumbnail it has some information about the state of the file, see the bottom bar. On the topic of stuff getting deleted, I have a question for hydev. I have some files in the trash that are most likely from an auto-dedupe function, but I'm not sure, would it be possible to show the reason they are in the trash like deleted files do? See pic 2.
Where can I see my whole file deletion log? The only one I can seem to find in documentation and in the app in the one that just shows a chart of file management/deletion activity. Because I was sorting some dupes and eventually in the last 750 out of 2000-ish I figured just clicking on the images to "skip" the ones I didn't want to deal with would be faster than clicking on "they're variants" every time and then I realized that was actually stripping them of their tags and sending them to the trash. Glad most of them had metadata for URL re-check for what it's worth.
>>23671 And I mean deletion log without just grabbing the image link -> getting a dupe/deleted error in the file log then and then deleting the result from there so I can re-DL it because that's kind of how I've been proceeding for re-downloading stuff.
>>23668 You can delete the deletion record, but it will be downloaded again in the future. you should be able to remove the tag from the deletion record but I'm not sure why you would just stop using "all known files with tags", it shows deleted files. alternately, get better taste.
>>23671 If they haven't been purged already, you can find them by searching the "trash" file domain. you'll also want to wipe their dupe records entirely. you can see their wiped tags by telling the tag interface to show you deleted tags. tbh the click shortcuts in the dupe filter are fucking insane to have as defaults, they probably shouldn't be defaults.
>>23674 >you can see their wiped tags by telling the tag interface to show you deleted tags Thanks.
>>23627 I do not think so. Thank you for this report. I suspect the exceptions are not applying correctly when you do a manual delete, only when you delete as part of a duplicate-resolving action--I'll look into it. >>23629 >>23646 Thanks. Yeah, I don't think this is possible yet. The 'context variable' guy just has a couple of urls in atm, and sometimes a post_index, and I populate it manually. I was going to expand it to allow assigning of other temp variables, but haven't got around to it yet. I haven't thought of parsing from response headers before, not properly anyway, but it feels like a good idea. I'll have a think and plan it out. It'd probably involve a whole new formula type, and I would need to rejig the parsing pipeline and add some test UI to support testing it. >>23632 >>23650 Thanks! I messed something up with the new logic that says 'if I have a child window/dialog open, stop the hover show/hide'. Somehow it isn't doing the ancestor test correctly and any other resizable window anywhere is stopping show/hide. I'll fix it! >>23637 I'm a little hesitant to do 'sliding' zooms. A lot of my zoom tech is still duct-taped together and waiting behind the scenes work to make it work faster. Top priority here, when I find the time to work on it, is to get rid of the media-transition and zoom-transition flickering you sometimes get. Once the layout here is cleaner, I'll be able to think about new UI. I think ctrl+mouse-wheel should do +/- zoom by default, btw. You can change it in options->shortcuts->media viewers - all if you want something else. Check the 'with forced media viewer center' actions and the 'centerpoint for media zooming' setting under options->media playback if you want to have zooms better 'pin' a media in place versus zooming in on where your mouse is pointed etc.. >>23641 Thanks for letting me know! The hydrus mpv embed is very delicate and will absolutely screw around with other similarly special programs and drivers. I'll add a note about this to the help.
>>23642 There's a soft secondary sort under options->file sort/collect. I want to better expose this in every normal page so you can override it there, but you can't do it yet. If I understand your problem, you want to set 'creator-artist-series' as the primary sort, and then within those distinct sort groups, sort by modified timestamp. You may be able to set this up right now via the options, but that secondary sort will apply to all pages everywhere. Let me know how you get on, and if I've misunderstood here. >>23656 >A file stops showing the trashcan icon on its thumb after its purged. Just a minor note--this isn't supposed to happen. The logic behind the scenes is a real pain in the neck, so I've had to fix it in five different ways. Is there any chance your files here have had their deletion records removed? i.e., did you delete them while selecting 'do not make a deletion record' or have you purged your deletion records under review services at any point? If those files have lost their deletion record, you'd both have the blurhash since it was a previously imported file, but it wouldn't have a deletion record for 'all my files' (any more) and thus doesn't get the trash can icon. You can also right-click on them, and the top-row flyout menu should say 'deleted from x 3 months ago' kind of thing. If it says 'deleted from the client x months ago', it should have a trash icon. Let me know if things are wrong here! >>23667 Files deleted in auto-resolution should get reasons just like a manual delete. Pic related. Do your files have any deletion reasons? If you are >>23656 , I wonder if you have a deletion regime somehow that is clearing deletion records? A file in the trash should have a deletion reason, but I wonder if some unusual combination of deletes or purges might clear it? Let me know what you discover--it could also be a bug my end. >>23671 If you turn on help->advanced mode, the 'file domain' selector of any search page suddenly has a lot more options. If you hit 'multiple/deleted locations', you can now select 'deleted from all my files'. You should also be able to sort by 'import time' in that page, and fingers crossed it'll sort by deletion time.
>>23690 >>23667 here, I am not >>23656, I haven't messed around with clearing deletion records. The trashed files do have duplicates present from what I've seen. I haven't messed with purges or anything. From pic 2 it's clearly an auto-resolution rule firing because the saved pic is slightly smaller and I've never seen these pictures before.
>>23691 Thanks, that's interesting and I think we are looking at a bug. If you right-click on one of those deleted files and look at the top-row flyout like in my pic, does it have a 'sent to trash x time ago'? If it does, does it have any reason attached? Does it have 'imported/removed'? If there's nothing secret there, you can just paste a screen of the menu. I now need to figure out if I am simply forgetting to attach a deletion reason somewhere or if files are magically transferring to the delete domain without any deletion timestamp at all.
>>23692 It does have the reason in the right click menu: "sent to trash 2 days 23 hours ago (duplicates auto-resolution (pixel-perfect pairs - eliminate bloat))". I can't take a screenshot of pop-up menus so I made a little webm, but nothing seems out of place.
>>23694 Perfect. There's nothing wrong here, just some display thing I think. I think we have a weird edge case (probably what the defaults are) of the hell options under options->media viewer hovers and then the 'top hover file summary' box. This thing is a mess, but do you by any chance not have 'show file trash times' checked? I wonder if it shows the full delete statement for files fully deleted from the hard drive, but not for those currently in trash. You have fresh eyes, so if this was the problem, and please tell me what the defaults should be and any ideas you have on how to make this thing make sense.
>>23695 These are the settings I have, I think I have only opened this menu once before so I think they are mostly default. After enabling the trash reason one it shows up, thanks hydev! I turned on the preview corner hover too, that's also very nice. Pic 2 is what I settled on. I think the status hover is fine with everything enabled personally. I also think calling it a hover or hover window is a little unclear, I'm pretty experienced with hydrus and I had no idea what it meant on first read. I also have no idea what else it should be called though, "info box"?, "ratings hud"?, "quick menu"?, "mouse menu"?, I don't know. It might also be nice to have the status and top hover be separate with an option to keep them synchronized? I know features like that are kind of annoying to program though so I can't blame you if you don't want to do that lol. Also, "Hide uninteresting modified times" has 2 colons in it.
>>23690 >If I understand your problem, you want to set 'creator-artist-series' as the primary sort, and then within those distinct sort groups, sort by modified timestamp. Yeah that's pretty much what I'm trying to go for so I can look at images that are connected without them being separated by 10 related images from one same creator. Figured I could maybe do it with a custom sort of my own under the option after the two regular creator-series things given but that seems to be no dice. I guess I'll try that options thing for now, thanks.
>>23690 >Just a minor note--this isn't supposed to happen. The logic behind the scenes is a real pain in the neck, so I've had to fix it in five different ways. Is there any chance your files here have had their deletion records removed? i.e., did you delete them while selecting 'do not make a deletion record' or have you purged your deletion records under review services at any point? If those files have lost their deletion record, you'd both have the blurhash since it was a previously imported file, but it wouldn't have a deletion record for 'all my files' (any more) and thus doesn't get the trash can icon. You can also right-click on them, and the top-row flyout menu should say 'deleted from x 3 months ago' kind of thing. If it says 'deleted from the client x months ago', it should have a trash icon. Let me know if things are wrong here! It took me a while to figure out but oops, yes I did. I had a hydownloader related mishap where i accidentally imported around 20k tweets picked at near random (i wanted to make a sub for a twitter search for a topic i want even poor quality images of. unfortunately, twitter search changed how it handles japanese somewhat recently, and so i got 20k random tweets.) i did a delete without records because I didn't want to waste time and brain power on figuring out if any of them were anything i'd care about, but i was concerned that the sample may contain things i wanted and figured that after fixing my sub i wouldnt see any of the unwanted tweets again. unfortunately the sheer scale of this incident means i have a huge chunk of deleted files lying around with no records. sorry about that! my duplicate auto-resolution does seem to be leaving deletion records as expected
>>23689 >I suspect the exceptions are not applying correctly when you do a manual delete, only when you delete as part of a duplicate-resolving action--I'll look into it. The files in question weren't manually deleted in the duplicate filter with the delete key. they were deleted as worse dupes, or at least that's what Hydrus has set for the deletion reason. All of them are also in alternate groups, so maybe that's related like I suspected before, but if you say nothing's wrong with that kind of situation of "set alternates = archive --> set worse dupe = delete" in the same duplicate batch, then I'm not sure. hope you can figure it out
>>23625 >The duplicates filter now fetches pairs using the new fast auto-resolution fetch tech. Now there is another place to wait (sometimes): when I click its launch button
>>23625 The way it's picking pairs feels better, but I have a backlog of a little under 2 million pairs and it now has to search all of them constantly even if I'm in a different file service than the one with the huge pileup. It's motivated me to shovel through it, but I do wonder if you couldn't do anything to improve that
>>23642 the true solution to this is more advanced grouping capabilities. i patiently wait for the day that hydrus can turn a set of images into a single "taggable object" with internal page ordering.
>>23703 >i patiently wait for the day that hydrus can turn a set of images into a single "taggable object" with internal page ordering. And how would you go about creating this "group" object? Why not just make a tag? I do so for any collection of sequential images that aren't alternates and call it "set:*", mostly because I don't want to deal with some other group/collect function when a tag by definition already creates a group/collection of files. Search the set:[tag]. Select all, you can then tag all files in the set. >>23642 >It's annoying as shit to browse and see children/parent images split up otherwise and there's no easy way to sort them right since they'll go back to default as soon as you change your sort options Select the files you want sorted together while they're in the correct order. Right click, Manage, Times, select all times, Edit, enter 1ms, Apply, Apply. Now they're in order from oldest to newest and grouped together even if they're not particularly what your searching for so long as all the tags in them on them are in your search. And of course so long as you're sorting by time, which I believe is the default.
>>23704 Make the parent feature so many websites have work the same as on Hydrus. You set an image as parent and link some others as its children and the parent appears first and the children follow and you make make it take precedent over other forms of sorting as a toggleable option.
>>23707 That's good for downloading. I don't trust boorus to be accurate and don't much rely on their tagging myself. Only a small minority of the grouped images I have, have had proper parents and children on boorus.
Small issue with locked pages: removing files in a collection doesn't seem to update the list of files in the locked page, even though the "update when files removed from page" option is ticked.
(518.62 KB 600x1003 4chan_sickos.png)

For halfchan PEE Hydrus integration, do I use the PTR access key or a personal access key and if so, where could I find my key?
>>23712 You need to make a client api key, assuming client api is enabled already (I forget how to enable it, it's probably mentioned in the hydrus docs), services>review>client api>add>manually>set name, set perms (search and fetch files)>apply>select the entry you just made>copy api access key>paste into PEE.
I had an ok week. I fixed some bugs and figured out an easy way to replace the icons and other small assets in the program. The release should be as normal tomorrow.
https://www.youtube.com/watch?v=qRcYjJQ0JHg
[Embed]
windows zip: https://github.com/hydrusnetwork/hydrus/releases/download/v631/Hydrus.Network.631.-.Windows.-.Extract.only.zip exe: https://github.com/hydrusnetwork/hydrus/releases/download/v631/Hydrus.Network.631.-.Windows.-.Installer.exe macOS app: https://github.com/hydrusnetwork/hydrus/releases/download/v631/Hydrus.Network.631.-.macOS.-.App.zip linux tar.zst: https://github.com/hydrusnetwork/hydrus/releases/download/v631/Hydrus.Network.631.-.Linux.-.Executable.tar.zst I had an ok week. I fixed some bugs and added a way to theme some assets. Full changelog: https://hydrusnetwork.github.io/hydrus/changelog.html highlights You can now override any of the asset files (program icons and stuff) in install_dir/static by creating a replacement in db_dir/static. It works like many vidya mod folders do, where any time hydrus wants to load a static file, it check to see if one exists in the user dir first. So, if you want to use a different splash image, put a new file in db_dir/static/hydrus_splash.png, and hydrus will load that one instead. This is mostly just for fun, so feel free to have a play around and see what happens. There's also some clever virtual directory merging in a couple places, and this is going to be the recommended way to install custom stylesheets and rating star shapes going forward, rather than inserting into the main install_dir. More here: https://hydrusnetwork.github.io/hydrus/custom_assets.html I fixed some issues with the media viewer's hover panels. I reworked their show/hide logic last week, and while I fixed some things, they weren't showing at all when there were many windows open. The whole thing is simpler now, and the mouse show/hide tech too. Let me know if you still run into any problems. If you do a lot of manual cookie work, it is now easy to move and copy cookies around inside hydrus.Also, setting the 'expires' on a cookie is less of a headache. next week I didn't find time to do the duplicate filter pair sort, so that's top of my list.
(104.84 KB 250x178 0df30ab.gif)

>>23720 >Ozzy video /)
When manually filtering duplicates and with larger images (e.g. 50 MB 8K pngs) the panel that displays the comparisons between filetypes/resolutions/size now can take a few seconds or more to appear. I presume that the slowdown is because it is calculating whether the images are visual duplicates, but it appears much slower than it was previously. Generally I can tell what image to pick based on the attributes fairly quickly so it is pretty annoying having to wait. Can you make it so it displays the attribute comparisons of the images immediately then updates the panel to display their visual duplicates status after its finished?
>>23720 Windows Defender flagging hydrus_client.exe again.
>>23723 What the fuck I downloaded Hydrus and suddenly my bank account got emptied???

Index Catalog Archive Top Reply 793
241
142

Forms
Delete
Report
Quick Reply
Drag files here to upload or
click here to select them
No Cookies?
0