I think it just kept accumulating these because it had to finish adding the other millions of files first.
The best way would be to just keep these in one place and de-duplicate these fsnotify notifications before trying to process them.
Also ipfs-sync tends to take up to 30GB of ram a lot of times.
I think it just kept accumulating these because it had to finish adding the other millions of files first.
The best way would be to just keep these in one place and de-duplicate these fsnotify notifications before trying to process them.
Also ipfs-sync tends to take up to 30GB of ram a lot of times.