Oom On Startup/loading Screen

Discussion in 'Technical Reports' started by ajpardy, Aug 25, 2022.

  1. ajpardy

    ajpardy Member

    Joined:
    Feb 7, 2021
    Messages:
    167
    Likes Received:
    7
    Hi, I’m experiencing a strange issue;
    When I went to load TS this morning, it crashed/dumped while updating scenario database,it won’t go last this. 30 mins . I’ve unsubbed from all WS ,do I need to reinstall ts to fix it? I’ve tried deleting the cache files.
    my log files: https://easyupload.io/m/cakk4k
    Any advice is appreciated
    Thanks
     
  2. triznya.andras

    triznya.andras Well-Known Member

    Joined:
    Jun 29, 2019
    Messages:
    2,315
    Likes Received:
    2,760
    Unsubbing from workshop using Steam doesn't remove the extracted scenarios.
    (Sad that it's still a persistent problem.)

    You may be able to pinpoint the offending files by searching by date.
    Alternatively, you can remove every Scenarios folder in your TS installation (or rename to ScenariosBackup) and run a verification (Check Integrity...) from Steam, which should restore all official scenarios.

    It's a bit of arcane business, you could also try and locate any invalid XML files in your installation and remove their folders.
    Most of them don't cause issues beyond funny titles but there is the rare, deadly one.

    This is how they look like and you can imagine any sorts of faults they cause.

    upload_2022-8-25_20-43-52.png

    For comparison's sake, the healthy one, extracted previously:

    upload_2022-8-25_20-45-36.png
     
    • Like Like x 1
  3. ajpardy

    ajpardy Member

    Joined:
    Feb 7, 2021
    Messages:
    167
    Likes Received:
    7
    Ok, thanks
    how would I know which scenario folders are Workshop,does it say in the xml file? triznya.andras
     
  4. torfmeister

    torfmeister Guest

    This has been mentioned before, and Cyclone has written a guide about it.

    Again I want to show you a safe method of using workshop content, if you're familiar with the folder structure and file management.

    The way I do it, you'll never run into these issues and workshop syncing is off - because TS workshop items cannot get an update, it is useless anyway and only slows down starting of TS.

    In the Steam client, subscribe to as many workshop items as you like.
    Then open the folder Steam\steamapps\workshop\content\24010. For every item subscribed there is a zip or bin file (the bin's actually a zip too.)
    Open them and copy the "Content" folder to the RailWorks folder. The full path is included in the downloads.
    Using 7zip file manager with two views (left side: 24010 folder, right side: RailWorks folder) this can be done very quickly.

    After that, delete all files from the 24010 folder and then unsubscribe all the items via Steam Libray > Train Simulator > Properties > Workshop. As you have cleared the workshop 24010 folder, Steam can't remove the items from your installation because it doesn't know where they are. They are safe now.

    TS must not be running while you do all this.

    This way, the workshop tab is clean. No syncing and monitoring active. No corrupt files which occur when TS modifies the downloaded xmls to insert Workshop Tags.

    I've got more than 400 WS items without slowing anything down because they're just like any other content to TS.

    I am keeping a backup tree of the content folder only including workshop stuff, which can then be simply restored after a new installation with two mouse clicks...
     
    Last edited by a moderator: Aug 26, 2022
    • Like Like x 1
  5. ajpardy

    ajpardy Member

    Joined:
    Feb 7, 2021
    Messages:
    167
    Likes Received:
    7
    yes I saw Cyclones Guide, I followed his guide and you instructions. But now my TS won’t start.
     
  6. torfmeister

    torfmeister Guest

    That's because you have to find and remove the corrupt scenario first. Only you can do that. Try to remember when it last worked and then find it via file date stamp.
     
  7. triznya.andras

    triznya.andras Well-Known Member

    Joined:
    Jun 29, 2019
    Messages:
    2,315
    Likes Received:
    2,760
    Near the end of the XML, there are three tags:
    upload_2022-8-26_14-4-45.png

    So you can indeed search for them:
    upload_2022-8-26_14-5-59.png

    When TS doesn't start it must have come across a file it cannot properly read (could also be the bin, although that's a bit more rare). Many formats rely on sequencing blocks, size+type+content, and if the size data is corrupt, it could cause any sort of issue. A very typical example is when content length doesn't match size, something that every other buffer overflow exploit used. In this case it looks more like a threading issue, but if you ponder my above screenshots you can see how the content is mixed up.

    Also there is a chance that the actual culprit isn't the loading but the scenario cache. One time I could start up the game, it would extract some, and then never start again. So: clear cache!
     
    • Like Like x 1
  8. ajpardy

    ajpardy Member

    Joined:
    Feb 7, 2021
    Messages:
    167
    Likes Received:
    7
    thanks I’m investigating. I regularly clear my cache anyway triznya.andras
     
  9. ajpardy

    ajpardy Member

    Joined:
    Feb 7, 2021
    Messages:
    167
    Likes Received:
    7
    upload_2022-8-27_9-59-12.png maybe someone could send me these files?
    upload_2022-8-27_9-59-12.png upload_2022-8-27_9-59-12.png
     
  10. torfmeister

    torfmeister Guest

    These files will be created by TS itself. Just delete them.

    SDBCache.bin = list of all scenarios, used for the Drive menu
    RVDBCache.bin = list of all rail vehicles used for QD custom consist editor

    So nobody mentioned Logmate.exe yet?

    It's in the RailWorks folder, just start it before running TS, and when TS crashes stop it and post the logfiles (also found in RailWorks folder then).
     
    Last edited by a moderator: Aug 27, 2022
    • Like Like x 1
  11. ajpardy

    ajpardy Member

    Joined:
    Feb 7, 2021
    Messages:
    167
    Likes Received:
    7
    usually yes,but in this case they don't,it crashes.dumps while updating scenario database,files don't regenerate.
    my logs from log mate i attached earlier;https://easyupload.io/m/cakk4k torfmeister
     
  12. torfmeister

    torfmeister Guest

    Sorry, didn't see them.

    Just went through the logs - there's a load of corrupted scenarios on your system. You have to remove them all. Not every corrupt scenario will cause TS to crash - depends on the structural damage of the file. TS can self-repair some unplausible scenario data in memory.

    Go through each RailWorks\Content\Routes\<GUID>\Scenarios folder. Enter each subfolder and look at ScenarioProperties.xml with Notepad++, it will make xml errors visible.

    Or make a backup of the whole Routes folder, and then delete the "Scenarios" folder from each one. TS should be starting up without errors. Now one after another add the Scenarios folders back until you find it crashing to encircle the bad files.

    Edit:

    The crash actually occurs on scanning the route folder {9a729b8c-4d82-4612-842ee9057fe178de}.
    I have not been able to get information on what route that is, likely some 3rd party route - looking at its RouteProperties.xml will tell you. Rename its "Scenarios" folder to "Scenarios.bak" and see if TS starts.
     
    Last edited by a moderator: Aug 27, 2022
    • Like Like x 1
  13. ajpardy

    ajpardy Member

    Joined:
    Feb 7, 2021
    Messages:
    167
    Likes Received:
    7
    ok, I did check a couple of the scenario.xml’s for errors I did all of 1st ones but there’s a lot!
    So there’s 2 things I can do?
    1.Back up my routes folder,then delete ,try to launch TS,if ok,slowly 1 by 1 put my routes back until crash happens.
    2. Rename scenario folder of 9a729b8c-4d82-4612-842ee9057fe178de to scenarios.back,and try to load TS: this route is ATS ecml York/Leeds merge torfmeister
     
  14. torfmeister

    torfmeister Guest

    So when renaming the Scenarios folder of the ATS route merger, does TS fire up? If not, completely remove the {9a72...} folder.

    You also have to unsubscribe ALL your WS items, and add them later by resubscribing one after another or using the method I've described.

    As I see it the reason for your issues is presumably mass subscribing of WS scenarios.
     
    Last edited by a moderator: Aug 27, 2022
    • Like Like x 1
  15. ajpardy

    ajpardy Member

    Joined:
    Feb 7, 2021
    Messages:
    167
    Likes Received:
    7
    I’ll try 2. tomorrow.
    Yes I un subbed to all WS items,and deleted all of them from the steam,steamapps,2410 folder.
    I’ve learnt how to install WS items without errors now; sub to item on steam,open the 24010 folder,find the download folder copy folder manually then delete it un unsubscribe,check for errors in xml to. torfmeister
     
  16. torfmeister

    torfmeister Guest

    No need to check the xmls for errors when copying them manually. The download is ok. The corruption happens when the Workshop code installs them, because it inserts the workshop tags into the RouteProperties.xml and fails if there's more than one subscription pending for automatic installation.
     
    Last edited by a moderator: Aug 28, 2022
    • Like Like x 1
  17. triznya.andras

    triznya.andras Well-Known Member

    Joined:
    Jun 29, 2019
    Messages:
    2,315
    Likes Received:
    2,760
    Just for pedancy - the problem isn't Steam, it's perfectly capable of delivering the files.
    It's a big content delivery system.

    The problem is TS itself, for some reason when extracting multiple scenarios at once - in sequence or paralel - it tends to mess up the 2nd or 3rd onwards.

    That's why I never actually unsubscribe, simply delete the extracted file (presumably that's what Cyclone's guide is also about).
    Thus when the game starts it doesn't cause problems, and when the game checks for workshop updates, it finds it, and extracts it properly.
    Unless there are many others anyway. Once I ran into an unresolvable deadlock-like situation.

    I don't know what could be wrong with the extractor but I could offer to take a look at it, probably some threading / state / resourcing issue.
    Literally every job interview asks about tasks and threads so I guess it's a pain point for everyone.
     
  18. ajpardy

    ajpardy Member

    Joined:
    Feb 7, 2021
    Messages:
    167
    Likes Received:
    7
    Screenshot_1.jpg Screenshot_2.jpg great news, TS now loads,do i slowly add the scenarios back into 9a729b8c-4d82-4612-842e-e9057fe178de Screenshot_1.jpg Screenshot_2.jpg ? how did yu tell 9a729b8c-4d82-4612-842e-e9057fe178de was the buggy folder? torfmeister
     
  19. torfmeister

    torfmeister Guest

    Glad you got that sorted!

    I just looked at your logfiles to see where it crashes, you see it as it stops while outputting the term "Missing" and the last folder scanned was this one...

    2022/08/25 18:12:10.865 - [Data Management] - Trace cScenarioDatabase.cpp : 848 = New Route {9a729b8c-4d82-4612-842ee9057fe178de}
    2022/08/25 18:12:10.865 - [Scheduler] - Trace cSchedulerModule.cpp : 377 = cSchedulerModule::unregisterRenderable
    2022/08/25 18:12:10.865 - [Data Management] - Trace Scenario.cpp : 1174 = Scenario::ScenarioStatistics::ScenarioStatistics new 1338496
    2022/08/25 18:12:15.919 - [Content] - Trace cEntity.cpp : 1272 = Missing blueprint " "
    2022/08/25 18:12:15.919 - [Content] -
    2022/08/25 18:12:15.919 - [Content] - Trace cBlueprintLibrary.cpp : 417 = Blueprint set not found : Kuju, (ulaNo ACaop roe
    2022/08/25 18:12:15.919 - [Content] - Trace cBlueprintLibrary.cpp : 448 = Blueprint set not found for: l4
    2022/08/25 18:12:15.919 - [Content] - Trace cBlueprintLibrary.cpp : 417 = Blueprint set not found : Kuju, (ulaNo ACaop roe
    2022/08/25 18:12:15.919 - [Content] - Trace cEntity.cpp : 1256 = Missing blueprint set "Kuju\(ulaNo ACaop roe "
    2022/08/25 18:12:15.919 - [Content] - Trace cBlueprintLibrary.cpp : 266 = Blueprint set not found : Kuju, (ulaNo ACaop roe
    2022/08/25 18:12:15.919 - [Content] - Trace cBlueprintLibrary.cpp : 417 = Blueprint set not found : Kuju, (ulaNo ACaop roe
    2022/08/25 18:12:15.919 - [Content] - Trace cBlueprintLibrary.cpp : 448 = Blueprint set not found for: l4
    2022/08/25 18:12:15.919 - [Content] - Trace cEntity.cpp : 1272 = Miss
    <<<CRASH!

    And here you see the xml corruption: "Kuju\(ulaNo ACaop roe "
     
    Last edited by a moderator: Aug 29, 2022
    • Like Like x 1
  20. ajpardy

    ajpardy Member

    Joined:
    Feb 7, 2021
    Messages:
    167
    Likes Received:
    7
    ok,thanks ,do i need that blueprint to fix it? torfmeister

    is there a way to delete conists from this menu,i don't have them installed. Screenshot_1.jpg
     
    Last edited: Aug 29, 2022
  21. torfmeister

    torfmeister Guest

    You only need to delete the broken scenarios and resubscribe to them.

    You mean the one without an image? Maybe it's referring to a custom consist you made, which you have to delete in Custom Consist Editor. Everything else that shows up with an image is installed.
     
  22. ajpardy

    ajpardy Member

    Joined:
    Feb 7, 2021
    Messages:
    167
    Likes Received:
    7
    ok
     
  23. ajpardy

    ajpardy Member

    Joined:
    Feb 7, 2021
    Messages:
    167
    Likes Received:
    7
    hi guy's, i'm slowly adding back scenarios to my 9a... folder,going well.
    on another note, were in scenario file is "tile reference", i'm told i can change were scenario loads by changing this to coordinates in-game. triznya.andras torfmeister
     
  24. triznya.andras

    triznya.andras Well-Known Member

    Joined:
    Jun 29, 2019
    Messages:
    2,315
    Likes Received:
    2,760
    I don't precisely know, sorry.
    When you load up the editor, there is a marker in the world that you can move. It's rather cumbersome, though.
     
  25. ajpardy

    ajpardy Member

    Joined:
    Feb 7, 2021
    Messages:
    167
    Likes Received:
    7
    Yh. It’s Handy if know the coordinates,which you can put into the navigation bar and ‘fly ‘ direct to location then place new marker here.
     
  26. ajpardy

    ajpardy Member

    Joined:
    Feb 7, 2021
    Messages:
    167
    Likes Received:
    7
    does anyone here have this route(9a729b8c-4d82-4612-842ee9057fe178de),I've found a buggy signal that has no post, it's just in the air
     

Share This Page