[UPDATE ANNOUNCEMENT]
I've just finished a first working version of the /polfren/ thread harvester. Pic rel.
>QRD
You launch the program and enter the url of a digging thread. It then scrapes data entries, according to the following syntax:
(((id)))
[[[source,label,target]]]
A practical example:
(((The Bill and Melinda Gates Foundation)))
(((Event 201)))
[[[The Bill and Melinda Gates Foundation,co-hosted,Event 201]]]
The first two (2) lines write the contents inside the tags to a data table called 'vertices.csv'
The third line writes the contents inside the tags to another data table called 'edges.csv'
>How To Harvest
1. OP creates a digging thread about a specific globohomo topic
2. anons join and dig in, pulling articles and other resources to start discussion
3. obvious players like corporations, organisations, people and events are mapped using the vertex tags.
4. connections between the vertices are then mapped using the edge tags.
5. if you mess up the syntax, the program will either not be able to read it or it will make an incorrect entry; in this case, delete your post if possible or ask a mod to it for you.
6. if spammers enter the thread, signal a mod and ask them to kindly remove said intruder from the premises and remove their posts as to not spoil the data
7. when a thread reaches its harvest peak, contact someone who has the /polfren/ harvesting app, or download it yourself (release will be planned soon).
8. upload the data table files (vertices.csv and edges.csv) to
https://catbox.moe/ and post their URL's in the comment box here:
https://workable-death.surge.sh/polfren
9. I will then include your files into the master database which will then be uploaded to https:// workable-death .surge .sh/polfren where anyone can view and query it.
10. if you're an OSint enthusiast, feel free to plot your own graphs from the data and share them with all of us!
>What's next?
Up next I will create a proof of concept for a UI that visualises our graphs. This will be done using the sigma js Javascript library. A demo of what it could look like here: https:// www.sigmajs (Please use archive.today)/demo/index.html
This is slightly above my ability to program so if anyone feels called to reach out and help, please do so here: https:// workable-death .surge .sh/polfren
Thank you for reading!