ticky on 3/3/2020 at 18:19
Alright, could you tell me a couple more things:
-For each directory where your unpacked FMs are, tell me how many folders are in there, but not in the entire directory structure, just how many folders are in the base unpacked FM directory for each game.
T2: 166 folders
Tg: 37 folders
-For each archive directory, tell me how many files are in the entire directory structure.
t2: 305 zipped files in the FM folder, 236,516 files in the unpacked FM folder (within its entire structure)
tg: 60 zipped files in the FM folder, 10,815 files in the unpacked FM folder (within its entire structure)
I hope I got your second question right. If not, please clarify and I'll provide an answer.
FenPhoenix on 3/3/2020 at 18:53
Nothing looks out of place there. I've made a debug version of AngelLoader.exe where it will log the amount of time it took to do various startup things. If you would, could you try
(http://fenphoenix.com/apps/AngelLoader/test_versions/AngelLoader_io_timer_test1.zip) downloading it here? Rename your original AngelLoader.exe to AngelLoader.exe.bak and then extract the one in the zip into your AngelLoader directory. Then, on a fresh Windows boot, run AngelLoader, wait for its window to pop up, and then close it. Then paste the contents of AngelLoader_log.txt here, and I'll take a look to see if I can find the problem.
ticky on 3/3/2020 at 19:24
Quote Posted by FenPhoenix
Nothing looks out of place there. I've made a debug version of AngelLoader.exe where it will log the amount of time it took to do various startup things. If you would, could you try
(http://fenphoenix.com/apps/AngelLoader/test_versions/AngelLoader_io_timer_test1.zip) downloading it here? Rename your original AngelLoader.exe to AngelLoader.exe.bak and then extract the one in the zip into your AngelLoader directory. Then, on a fresh Windows boot, run AngelLoader, wait for its window to pop up, and then close it. Then paste the contents of AngelLoader_log.txt here, and I'll take a look to see if I can find the problem.
Done! Here's the log file (it was too long to paste it here, others may be bored to scroll through it):
(
https://gofile.io/?c=L6xJBw) https://gofile.io/?c=L6xJBw
FenPhoenix on 3/3/2020 at 19:35
Okay, I see the problem. According to the log, your FM archive directories contain 7,529 and 884 subfolders respectively. What are your FM archive paths? You should make sure they contain only FMs and/or .FMSelBak.zip files and nothing else. And if they contain any subfolders, make sure those subfolders don't contain anything unrelated either. Alternatively, just uncheck "Include subfolders" and make sure all your FM archives are stored directly in one of your FM archive paths and not in any subfolders thereof. At the moment, AngelLoader (and NewDarkLoader) are having to enumerate through 247,331 files, for which 60-90 seconds on a cold boot sounds about right.
ticky on 3/3/2020 at 20:23
Quote Posted by FenPhoenix
Okay, I see the problem. According to the log, your FM archive directories contain 7,529 and 884 subfolders respectively. What are your FM archive paths? You should make sure they contain only FMs and/or .FMSelBak.zip files and nothing else. And if they contain any subfolders, make sure those subfolders don't contain anything unrelated either. Alternatively, just uncheck "Include subfolders" and make sure all your FM archives are stored directly in one of your FM archive paths and not in any subfolders thereof. At the moment, AngelLoader (and NewDarkLoader) are having to enumerate through 247,331 files, for which 60-90 seconds on a cold boot sounds about right.
Okay, tried to make my folders cleaner (although nothing really unrelated was found there), and also unchecked the "include subfolders" options. Made a PC restart then an Angel coldstart.
Here's the newest log with the debug version of the exe:
2020/3/3 21:17:57 1.4 Started session
2020/3/3 21:17:57 Init
create required directories took: 00:00:00.0000476
2020/3/3 21:17:57 Init
Config read and associated stuff took: 00:00:00.0457970
2020/3/3 21:17:57 Init
lang read took: 00:00:00.0215611
2020/3/3 21:17:57 Find
total installed dir enumeration took: 00:00:00.0231978
2020/3/3 21:17:57 GetFMArchivePaths
Config.FMArchivePaths count: 2
2020/3/3 21:17:57 Find
GetFMArchivePaths took: 00:00:00.0017845
2020/3/3 21:17:57 Find
FindFMs.Find(): archivePaths.Count: 2
2020/3/3 21:17:57 Find
archive path 0 files count: 60
2020/3/3 21:17:57 Find
archive path 1 files count: 300
2020/3/3 21:17:57 Find
total files in all archive dirs: 360
2020/3/3 21:17:57 Find
total archive enumeration took: 00:00:00.0266654
2020/3/3 21:17:57 Find
FindFMs.Find() took: 00:00:00.0724841
2020/3/3 21:17:57 Init
View construct and InitThreadable took: 00:00:00.1995713
2020/3/3 21:17:57 Init
View.FinishInitAndShow() took: 00:00:00.0827774
2020/3/3 21:17:57 Init
Core.Init() took: 00:00:00.0827774
Think it's much much better in terms of time! Thank you for the help, I think (I hope) that's a solution. Will make a couple of further tries and if something comes up, will let you know.
FenPhoenix on 3/3/2020 at 20:43
No problem :)
thieff on 10/3/2020 at 22:37
I've got FEATURE REQUESTS, please Mr. Fen, consider:
* adding path column with a full (direct) path to mission archive file AND the ability to export current fan mission list (filtered, only visible columns) to a text file in CSV format
* adding support for 7z (ultra) compressed fan mission archives
* replacing ZIP compression with 7z (ultra) for Backup folder
reason for 1:
after playing and rating several hundreds of missions at this point, I want to remove the ones that suck the most (zero replay value) to free up space
reason for 2 and 3:
saving even more space (I don't care how long it will take to scan archives/install/reinstall)
Thanks for your hard work, Mr. Fen.
caqo on 11/3/2020 at 02:48
Hey Fen.
Which is the link to the translation changes?, is it always the same?
FenPhoenix on 11/3/2020 at 03:59
Quote Posted by thieff
I've got FEATURE REQUESTS, please Mr. Fen, consider:
* adding
path column with a
full (direct) path to mission archive file AND the ability to
export current fan mission list (filtered, only visible columns) to a text file in CSV format * adding support for 7z (ultra) compressed fan mission archives
* replacing ZIP compression with 7z (ultra) for Backup folder
reason for 1:
after playing and rating several hundreds of missions at this point, I want to remove the ones that suck the most (zero replay value) to free up space
reason for 2 and 3:
saving even more space (I don't care how long it will take to scan archives/install/reinstall)
Thanks for your hard work, Mr. Fen.
Okay, I'll consider an FM remove / delete feature and a 7z backup option.
Regarding your point #2, AL does support 7z FM archives. Do you mean it doesn't support 7z files that have been compressed with "Ultra" settings? Does it crash or display an error dialog?
Quote Posted by caqo
Hey Fen.
Which is the link to the translation changes?, is it always the same?
Yep, the link always leads to the latest changelog. :)
thieff on 11/3/2020 at 09:09
Quote Posted by FenPhoenix
Okay, I'll consider an FM remove / delete feature and a 7z backup option.
Regarding your point #2, AL does support 7z FM archives. Do you mean it doesn't support 7z files that have been compressed with "Ultra" settings? Does it crash or display an error dialog?[...]
CORRECT! AL does support .7z archives. I was testing it wrong.
what I did was unpacked RANDOM_MISSION.ZIP, but forgot I have Bandizip set up so it creates parent folder if it finds multiple files inside the archive (so you don't make a mess by accident) and thought the folder was a part of the mission.
of course that was the error and despite AL finding such .7z archive and scannig it, the mission wasn't showing up in the list.
I corrected that, and now all is good.
alas the scan takes really slow ie. 3-4 seconds per 1 .7z archive. I have to reconsider having a bit bigger files. disk space can be extended, our life time cannot.
so, please scratch that part.
thank you.