Keeps forgetting hidden threads #1910

alidan · 2018-05-09T23:25:03Z

Long story short, I open and hide threads, I keep the threads saved, and I load them up when they 404 to scrape images.
I have been opening threads with a middle click and shift click macro for each thread I want to keep up with, then closing them out in tab outliner
However I just went to most of the boards I do this to, and they move slow enough that there is no way in hell I only have 4 hidden threads (the threads that I hide based on filters)

im on 1.13.15.11 of the extension version.

alidan · 2018-05-10T01:49:10Z

Got updated to 1.13.15.12 shortly after this was written
chrome crashed
the extension forgot every single post I made.

Corridor89 · 2018-05-10T15:47:23Z

this has been an on-going issue for the last few weeks. see #1875 and #1881
Best thing to try is the beta version of the extension/script

alidan · 2018-05-11T02:38:47Z

Ok on the beta version and on the script rather than extension, someone said that one loses the data less.
there any major difference between script and extension performance wise?

either way, going to re make all the hidden threads and shit, and see if it remembers it for more then 1 day

alidan · 2018-05-11T04:30:14Z

Ok, Initial threads watched/hidden and everything is remembered. If anyone wants updates reply back in a few days

so far, beta script is doing better than non beta extension.

alidan · 2018-05-14T21:40:28Z

Ok, I watch threads on all the porn boards but yaoi yuri and handsome men
the 1.14.0.15 version script has forgotten everything after 4 days, which while its not good, is better than 1.13.15.12 given that this one forgot it multiple times a day.

I use ublock origin and umartix, is it possible that a conflict is happening there?
also, I don't know how extensions work, is it possible to have an extension lookup a file on your computer, use&write data to it, and just go on with its day? doing this all in browser seems like it has issues.
I know you have import and export settings, would it be possible to have import and export settings for the hide lists? It wouldn't be the ideal solution, but a work around till a more permanent solution is found, along with an extra 'security' measure in case this issue pops up again.

Corridor89 · 2018-05-14T22:16:55Z

I don't think an ad blocker would affect it. I have a different ad blocker than you and it still happens.
And according to the posts in the other threads, the issue has been happening on different browsers. I think they issue would have to be either the script itself of 4chan having some changes that stopped it from working like it did a month ago.

alidan · 2018-05-14T23:18:00Z

well, and I have no idea how anything works but I have an idea.
my filters work perfectly, there is no issue with them picking up anything
so my guess here is that the hidden thread list works like filters, but instead of a permanent list of shit to block, its a list that culls itself every now and then, I notice when I leave a board open every now and then everything disappears and reappears, i assume that is it checking, because lets say a few hundred threads to check isn't an issue, how about a few thousand, that would likely cause issues.

so its either something in the 4chanx is causing a full page rather than procedural
web browsers are screwing with what's saved by 4chanx
an extension is screwing with it

I want to rule 4chan out entirely, because if I want to filter
https://boards.4chan.org/s/thread/18148662
as an example you are going to either filter

https://boards.4chan.org/s/thread/18148662
*/s/thread/18148662
*/18148662
/TV3vOHcSJVlJYmxuTeS0ag==/ + Date
/TV3vOHcSJVlJYmxuTeS0ag==/

doing this small test, I filtered the image md5 and reloaded, thread was filtered
I removed the image md5 and reloaded and it was no longer filtered.
This is seems like its the most likely thing to happen, that 4chanx is losing its hide list.
a save the list to desktop and load list from desktop would be the most likely fix/workaround till the problem is properly addressed.

alidan · 2018-05-15T11:23:49Z

it has now lost all the yous across every thread

gotmilk0112 · 2018-05-17T20:38:39Z

Even using the beta script, it's still happening, albeit a bit less troublesome. It forgot all of my hidden threads, but (You)s are still intact.

ccd0 · 2018-05-18T06:40:43Z

Are you doing anything like clearing cookies periodically?

alidan · 2018-05-18T07:07:12Z

the only cookies I clear out are youtube ones due to the way the great suspender works with it, it will cause an error 400 if left to long, and 4chan more rarely with errors caused by that, but haven't had any in I want to say 5 months with 4chan and even at that, its a very noticeable 'geoscrollpos - *****' that shits everything up and only those get taken out.

ccd0 · 2018-05-18T07:13:59Z

I know you have import and export settings, would it be possible to have import and export settings for the hide lists?

The exported settings includes the hide list.

ccd0 · 2018-05-18T07:50:26Z

I found something in the list pruning that might cause a problem if 4chan started sending false 404s. Can you see the issue still happens in v1.14.1.1 (current beta)?

This wouldn't explain watch list additions/removals as in #1881 but that might be a separate issue and possibly already fixed by the other stuff I've done; I'll have to check back on it.

alidan · 2018-05-18T09:03:32Z

Ok, updated and will go through
/s/ /h/ /e/ /d/ /hr/ /gif/ /aco/ and hide everything older then 5/18/18 12:44am as that is the last time I checked everything.

will be able to get back in I want to say a week and tell you results, possibly sooner if it didn't fix anything.

----------edit-----------------
also on the 'The exported settings includes the hide list.' bit, sure it has the hide settings, but it's also
a drop down menu that doesn't drop down all the way sometimes, clicking export, saving the specific file name, then drop down again, and import, each time you update. a front facing quick option would be preferable if this is unfixed.

gotmilk0112 · 2018-05-18T13:03:47Z

Nope, I don't touch any of my cookies or browsing data unless I have to.

Also went ahead and updated, will see if it happens again.

alidan · 2018-05-18T16:14:51Z

so I hid everything on those boards,
/s/ reverted
/h/ reverted
/hc/ reverted
/hr/ reverted
I think its not fixed yet.

ccd0 · 2018-05-18T22:29:43Z

What do you see when you open
https://a.4cdn.org/s/threads.json
?

gotmilk0112 · 2018-05-18T22:57:47Z

https://puu.sh/AoKUJ/2ed02dd9ed.png

That's what it shows for me.

alidan · 2018-05-19T05:43:04Z

that's what I got. keep in mind, I had hidden 9 boards worth of threads,

alidan · 2018-05-19T05:45:12Z

I just went to every board, nothing beyond the normal filters are there.

alidan · 2018-05-19T06:34:05Z

ok went in and re hid everything again,

is what it shows now.

alidan · 2018-05-20T13:02:55Z

Ok, after re hiding everything, only the stickly on /s/ is still hidden.
This is what it looks like after everything unhid itself.
Just as a note, the actual filters are still working perfectly fine.

on a side note, I had an idea and I posted it #1933
If there was a way to quick filter only the catalogue view by date, and a quick way to set the date to current time/time of last refresh, that would, at least for me, be a very valuable feature on most boards.

alidan · 2018-05-23T00:24:43Z

yea, thread watcher is near worthless at this point along with hiding threads as it resets so often.
able to give any thoughts on what the issues may be with this?

ccd0 · 2018-05-23T23:14:12Z

When you hide all the threads on /s/ and it gets unhidden, does that include the stickies?

ccd0 · 2018-05-23T23:32:55Z

If the stickies are getting unhidden, can you try this?
Install this test build: https://pomf.pyonpyon.moe/cdbwca.user.js
Ignore any alert windows that pop up until the next step.
Hide the sticky /s/9112225 - questionable age
When it comes unhidden, an alert should pop up. Copy the message from it and paste it here.
Also copy any alert messages from other tabs, if they're different.

alidan · 2018-05-24T06:27:46Z

ok, the questionable age sticky got unhidden at some point, however the other one, the s is not for requests one did stay hidden it seems... when everything was hidden it appeared the stickies stayed hidden a bit longer.

so I clicked the js and reinstalled, went to /s/ and there was an error, im guessing thats what I was to ignore, and I hid the underage thread alone.

got a question, is the error/popup up ignoreable/missable at all?
Also, am I able to hide on other boards and it wont effect what you need from this?

ccd0 · 2018-05-24T06:32:31Z

is the error/popup up ignoreable/missable at all?

The only way you could miss it is by closing the tab that it showed up in without checking it first.

Also, am I able to hide on other boards and it wont effect what you need from this?

It shouldn't make any difference.

alidan · 2018-05-26T00:20:51Z

I got no error message at all, the questionable age sticky is now not hidden. 4 of the 9 pages I have been hiding everything have decided to no longer hide threads.

ccd0 · 2018-05-26T10:50:21Z

Did it update to v1.14.1.2? That would explain the lack of message.

Can you see if you can trigger the issue by installing a version of the script over the old one?

And if that doesn't work, can you try again with
https://pomf.pyonpyon.moe/wagxji.user.js
which should have auto-updating disabled?

By the way, what userscript manager are you using?

ccd0 · 2018-05-26T10:52:20Z

Also, please check whether you might have multiple copies of 4chan X enabled somehow. If different copies are loading at different times, it could explain your problem.

ccd0 · 2018-06-05T05:33:00Z

If I'm right about what's causing it this time, this was caused by improper handling of occasional I/O errors. Since these could be originating from the browser or even from the OS itself, the choice of Tampermonkey vs Violentmonkey might not matter here.

alidan · 2018-06-05T05:39:42Z

Ok, going to turn tampermonkey on then, the issue was ublock was not letting the script load, and I was getting nowhere without whitelisting 4chan which I can't bring myself to do due to the sketchy ads

Ok, tamper is back up, with the new version installed, fingers crossed this is the one that does it.

saxamaphone69 · 2018-06-05T06:13:50Z

FWIW, I've been having stickies randomly/periodically unhide themselves over the last 2-3 weeks (I feel like it coincided with when the "new" version of the bottom ads appeared) , and have been keeping an eye on this issue.

ccd0 · 2018-06-05T07:08:54Z

You may want to try adding the exception filter
@@||boards.4chan.org^$csp
or other solutions mentioned in #1968 if you're having trouble with ad blocker-userscript engine conflicts.

alidan · 2018-06-06T07:57:10Z

new version almost immediately forgot every single thing that was hidden on 8 of the 9 boards that I hide things on, however everything in a normal filter still catches everything.

Honestly speaking, after screwing around with creation filtering, bump filtering feels kind of useless, I mean either I watch what I want to keep up with, or the thread served its purpose, if you could make a creation time filter, have an enable it button in options, and then an update button to the left of the sort methods, this would solve most of my problems. I only see what's new, I watch what I want to keep up with, and the rest is filtered and stored in the user defined method, as that one seems to not lose its filters at all.

as for violent monkey, anywhere I stick
@@||boards.4chan.org^$csp
It doesn't do anything, along with every permutation I can think of and in every field I could stick it in so I can't test with that to see if it works.

alidan · 2018-06-07T04:58:41Z

Ok, its been nearly a day since my last post.

I just went to every board where I hid shit and did a tally,
158 threads are hidden, either manually hidden or through a filter
however 4chanx still claims 831
https://i.imgur.com/Xd7a0u8.png

just looking at all my boards I hide everything on, the number should come to 1350, I saw that number often enough when everything is hidden properly, however, it seems like things are still in memory but are not being hidden.

im going to clear the hide after exporting and re hide things. any thoughts on what is going on with this?

ccd0 · 2018-06-08T19:10:17Z

The number may include archived threads. You can check exactly which threads by looking at your exported settings.

gotmilk0112 · 2018-06-08T19:22:15Z

It's having a bit of a different issue, now. I'll wake up in the morning and manually hide a few threads, and then a little while later, only those few threads that I hid, will un-hide again. But only once; they stay hidden the rest of the day.

This happens once every 2-3 days.

Running version 1.14.1.2

alidan · 2018-06-09T14:26:37Z

Ok, after hiding everything, I had 1300~ tabs hidden,
There are now 2048 tabs hidden
I know for a fact I did not hide that many, and I know there is no way I hid an aditional 700~ tabs in 2 days.

ccd0 · 2018-06-09T18:08:16Z

Can you post your exported settings?

alidan · 2018-06-09T18:20:36Z

New WinRAR ZIP archive.zip

Have no idea if this worked, it should have 2016 hidden, have no idea where a little less then half of them came from because the boards I hide dont have the turn around to in 2 days have 700 new threads to hide.

ccd0 · 2018-06-09T19:03:06Z

Yeah, something is odd there. I see threads that were archived as far back as May 28. Are you positive you cleared the list of hidden threads on June 6? Did you use the button in the settings to clear the list? Have you been using incognito mode and/or the native catalog during any of this?

alidan · 2018-06-10T02:57:14Z

I exported everything before clearing it, then hid everything and went on, im nearly 100% positive it was clear and something happened in the meantime.

I wasn't really keeping a daily look at it, I only noticed it when I was looking for a setting to do something else.

would it be possible for me to clear the hidden threads in one tab, not closing other ones and having the hidden tabs that should have been cleared re construct themselves based on other open tabs? that's really the only way I can see them coming back through a fault of my own.

ccd0 · 2018-06-10T02:59:05Z

Have you been using incognito mode and/or the native catalog during any of this?

alidan · 2018-06-10T03:44:12Z

in the last since cleared the hidden, I shouldn't have.
settings with the catalog have likely never been changed

ccd0 · 2018-06-11T02:05:17Z

would it be possible for me to clear the hidden threads in one tab, not closing other ones and having the hidden tabs that should have been cleared re construct themselves based on other open tabs?

It could happen if you hid/unhid threads in one of those tabs after clearing the list.

alidan · 2018-06-11T05:41:55Z

nah, the tabs that were left open were just threads that I have yet to read through, nothing about hiding when to there.

alidan · 2018-06-12T09:12:40Z

Ok, going to do it again now that it has forgotten every single one of the hidden threads
checking the scripts page, it says 800 tabs are hidden

21 hidden things accross d h gif aco e trash s hc hr.zip

however only 21 are hidden on any of the boards i go to and hide things.
This is a number that seems to pop up a bit too, are you able to see anything weird with it?
It honestly seems like its 2 files that are conflicting with each other as to which one is going to be used and it keeps going back to a really old file for some reason.

going to clear it and make sure I don't use incognito for a while.

alidan · 2018-06-12T09:36:00Z

just a note, I cleared the hidden, it went to 0, I reloaded to make sure, and it was still 800
I cleared it again, and refreshed several times, the 800 was no longer there. I then went and refreshed every page, and I noticed something

filter hides aren't tracked as hidden

I have to ask, is there a functional difference between hides and filters? It seems filters are never forgotten but hides are kind of routinely forgotten now.
would a stop gap of rolling page hides into user filters work? it would need to be manually culled every so often for performance sure, but till its able to work automatically without issue.

On a side note I have been trying to figure out if there is a way in script to filter dates/time

let's give an example, I cull through boards to see what threads I want to see and what ones I dont,
lets use hr as an example, as of posting this, https://boards.4chan.org/hr/thread/3172450 is the most recent thread, and 06/11/18(Mon)9:27:55 pm is the time,

If I culled through the thread now, it would be 6/12/18(Tue)4:31:55 am
Is there a way to apply this to a general filter that would filter out anything older than the time I input with another filter for boards:d,h,gif,aco,e,trash,s,hc,hr;
while it wouldn't be ideal for what I do, and having one set up for those boards and then possibly other ones would be a pain in the ass to keep up with manually, it would at least not constantly revert like it is now for reasons i'm not able to identify.

ccd0 · 2018-06-12T19:00:36Z

Ok, going to do it again now that it has forgotten every single one of the hidden threads

Is there any possibility these thread hides could be simply not be getting saved in the first place? Was any thread hide lost that was at one point there when the page was loaded/reloaded?

It honestly seems like its 2 files that are conflicting with each other as to which one is going to be used and it keeps going back to a really old file for some reason.

It might be worth double-checking again that you do not have two versions of 4chan X enabled anywhere, including the extension, Tampermonkey scripts, Violentmonkey scripts, etc.

just a note, I cleared the hidden, it went to 0, I reloaded to make sure, and it was still 800

Is it possible to hide a bunch of threads and reproduce this again? If so, it would be useful to check if an error was logged in the console when you cleared the threads.

would a stop gap of rolling page hides into user filters work?

If there's a data storage bug, we have to fix it. It's quite possible that you would notice your filters getting reverted if you changed them more often.

saxamaphone69 · 2018-06-13T06:20:11Z

Personally, my filters are still working with no issues (but I only have highlight filters not hiding ones).

I have not been to 4chan in Incognito but my threads still find themselves unhidden.

My settings says Hidden: 0, I hide the sticky on /fit/ (which found itself unhidden), refresh the page, and it still says Hidden: 0 but the sticky is now hidden.

I had console open this entire time and no errors or warnings appeared.

alidan · 2018-06-13T14:33:12Z

everything that would be a second version has been disabled, I can outright remove everything that would be a second version, ill do that when/if it reverts again.

as of right now everything is currently hidden, however I'm also not getting and status on how much is hidden and it says 0 for me too.

alidan · 2018-06-20T00:47:58Z

Ok sometime in the last two days a few of the boards forgot their hides, going to go about removing every other disabled version I have
and just as a note, hidden still reads as zero

bakugo · 2018-06-22T05:45:03Z

Found the issue (I think)

It's actually not related to storage at all, it's caused by DataBoard's ajaxClean function. Occasionally, when the second callback (for archive.json) is executed, the response of the first request (for threads.json) e1.target.response is null and this gets passed to ajaxCleanParse which clears every active thread as a result. I have no idea what causes the response to become null over time (this might be worth investigating) but simply storing it in a variable during the first callback should fix it. I'm using Chrome 67, in case this behavior is browser specific.

The Hidden button in the settings is also broken due to another problem: it was not updated for multisite support. The hiddenThreads and hiddenPosts storage keys can contain data split by site, but the button doesn't handle that, it just tries to read hiddenThreads.boards directly when it can be at hiddenThreads["4chan.org"].boards instead.

…1910

ccd0 · 2018-06-22T06:25:14Z

Thanks. I've pushed a fix (let's hope) for the more important and simpler-to-fix data cleaning issue. Will follow up on the button later.

ccd0 · 2019-07-16T19:37:31Z

The button count was fixed by 23c7643, so closing.

ccd0 pushed a commit that referenced this issue Jun 22, 2018

Fix for data loss issues. e1.target.response reported to become null. #…

08fffa2

…1910

ccd0 added the bug label Jul 13, 2018

ccd0 closed this as completed Jul 16, 2019

ccd0 mentioned this issue Jan 14, 2021

4chan X forgetting (you)s and last spot in threads #1875

Closed

Keeps forgetting hidden threads #1910

Keeps forgetting hidden threads #1910

Comments

alidan commented May 9, 2018

alidan commented May 10, 2018

Corridor89 commented May 10, 2018 • edited Loading

alidan commented May 11, 2018

alidan commented May 11, 2018

alidan commented May 14, 2018

Corridor89 commented May 14, 2018

alidan commented May 14, 2018

alidan commented May 15, 2018

gotmilk0112 commented May 17, 2018 • edited Loading

ccd0 commented May 18, 2018

alidan commented May 18, 2018

ccd0 commented May 18, 2018

ccd0 commented May 18, 2018

alidan commented May 18, 2018 • edited Loading

gotmilk0112 commented May 18, 2018 • edited Loading

alidan commented May 18, 2018

ccd0 commented May 18, 2018

gotmilk0112 commented May 18, 2018

alidan commented May 19, 2018

alidan commented May 19, 2018

alidan commented May 19, 2018

alidan commented May 20, 2018

alidan commented May 23, 2018

ccd0 commented May 23, 2018

ccd0 commented May 23, 2018

alidan commented May 24, 2018 • edited Loading

ccd0 commented May 24, 2018

alidan commented May 26, 2018

ccd0 commented May 26, 2018

ccd0 commented May 26, 2018

ccd0 commented Jun 5, 2018

alidan commented Jun 5, 2018 • edited Loading

saxamaphone69 commented Jun 5, 2018

ccd0 commented Jun 5, 2018

alidan commented Jun 6, 2018

alidan commented Jun 7, 2018

ccd0 commented Jun 8, 2018

gotmilk0112 commented Jun 8, 2018

alidan commented Jun 9, 2018

ccd0 commented Jun 9, 2018

alidan commented Jun 9, 2018

ccd0 commented Jun 9, 2018

alidan commented Jun 10, 2018

ccd0 commented Jun 10, 2018

alidan commented Jun 10, 2018

ccd0 commented Jun 11, 2018

alidan commented Jun 11, 2018

alidan commented Jun 12, 2018

alidan commented Jun 12, 2018

ccd0 commented Jun 12, 2018

saxamaphone69 commented Jun 13, 2018

alidan commented Jun 13, 2018

alidan commented Jun 20, 2018

bakugo commented Jun 22, 2018

ccd0 commented Jun 22, 2018

ccd0 commented Jul 16, 2019

Corridor89 commented May 10, 2018 •

edited

Loading

gotmilk0112 commented May 17, 2018 •

edited

Loading

alidan commented May 18, 2018 •

edited

Loading

gotmilk0112 commented May 18, 2018 •

edited

Loading

alidan commented May 24, 2018 •

edited

Loading

alidan commented Jun 5, 2018 •

edited

Loading