MirageUK

FYI we're on our way toways identifying this data and have made some progress towards reading it into the toolkit. You still won't be able to "export" or "save" this out to anything other than the JSON that ASV currently supports though so no ".arkprofile" export will be available.

292,000 tames in Valguero 544!!

@arkark - Interesting, how does it clean things up? I have an app that will at least now load the save data and show what is in there to help manual clean-up but wasn't aware there was any reliable way to write the data back out without breaking more things so it's all read-only and provides copy/paste commands with pre-populated tribe id's etc. to clean them up manually in-game. https://survivetheark.com/index.php?/forums/topic/491802-admin-trusted-player-tool-game-save-visualiser/ ..edit.. Guessing you use something similar but then RCON onto the server to issue the command without being in-game?

4.6.1.2 now available to download: https://drive.google.com/file/d/1pRtEZVz7yJpXzGhy5VusgBboIjShUegZ/view?usp=sharing Fixes Tribe name was not displayed on Tames tab when creature is in cryo. @MroczneZakamarki

I'm logging for the evening but I'm off work tomorrow so will sort it in the morning. It's due to the way I check for and re-parent any cryo creature to the inventory it is in - my check is failing and so it's not allocating the TargetingTeam or TamingTeamID properties used to determine the tribe name later down the work flow.

4.6.1.1 now available: https://drive.google.com/file/d/1SQldPKGKuksYKpfA0KVEBcTdYUASgn6I/view?usp=sharing Just a quick tidy up of the screen so it's easier to identify which structures are genuinely locked and lock-able and which structures are capable of being powered but either are or are not currently switched on. Fixes Only show value on structures for "locked" or "power on" when structure is appropriate. Only export "locked" and "isSwitchedOn" in JSON when structure is appropriate. Hide tribes without tames on tames dropdown when selected in configuration options to do so. @MroczneZakamarki

Quick lunch time fix and release. 4.6.1.0 now available for download: https://drive.google.com/file/d/1qas2ui7pC0uZLZ6-4tKJvIeu8R0GGA0K/view?usp=sharing Features Added "Tribe name" to Structures tab results grid. @MroczneZakamarki Added "Power On" to Structures tab results grid. Showing "Yes" for structures that are "turned on". Added "Clone" to Tames tab results grid. Removed code to de-dupe the tamed creature results to expose "duplicated" tames with the same Id. Added "isClone" for Tames and "isSwitchedOn" for Structures to JSON command line and settings page exports. Fixes Tamed tab results used "Yes/No" for some columns but "TRUE/FALSE" for stored. Amended to consistently use "Yes/No". Fixed a crash when item data has bad location information. ASV will now handle this and show infinity in the grid results and exclude them from the map draw. @Oli4

I don't actualy play the game anymore and haven't for a couple of years so if you can provide a backup with this data in I can see where it is an get it exposed. I will look into the available export fields from grid after work this evening. You do know there are command line options to export more complete data? Also available in the Export tab of the Settings page.

@MroczneZakamarki The data behind the AllyInRange hasn't changed - this is what was used previously when it said "Tribe". Only the header text has changed to more accurately reflect what the save game property is defined as - Ally In Range. Export including Tribe - I assumed it already did, at least a TribeId? It also does Dino/Creature Id so you can use this to spot any dupes? I never had any issues with duplication on my tiny private server when I did play a couple years ago so not something I have personally tested. Customised column selection I could look into adding. Structures that are "on" - leave that with me, I imagine such information should be avialable for me to find. Visibility of tribes/players without dinos showing in the dropdowns of tame tab I will investigate after work. A button for donations - I really have been reluctant to do this. I'm happy just to see people getting use of it without feeling they need to "donate" anything, but if you guys insist I might look into it. Hadn't realised we've been working on this for almost 4 years!!!

The way it works is players request link verification to their in-game character. Once that's linked they only have access to view things for that tribe.

4.6.0.5 now available to download: https://drive.google.com/file/d/1AhthJGwMdn33jNzyrDmulOjKkiBeOXUY/view?usp=sharing Features Support for Soul Trap in new file format.

If I get chance I'll check it at lunch (1 hour yet) but if not it'll be after work at approx. 17:00 UK time.

@MroczneZakamarki / @Alpha Prime - Any mods? Been told that I need to implement it slightly differently for Soul Traps. If no MODS can I have a copy of your backup to replicate and work on a fix. Cheers @Larkfields - to be honest I was expecting more people just to use the json data. It is nice to see others also use the "Visual" side - that's where it all started for me

4.6.0.4 now available for download: https://drive.google.com/file/d/1F-n6PPSrIlkrfdUw8_EujDVMGm4UY8Dj/view?usp=sharing Features Better support for new file format and official server backups. Big thanks to Alex and Cadon who worked with me on this to bring the same support to ASB (Ark Smart Breeding) - check it out if you haven't already. https://github.com/cadon - Ark Stats Extractor. Support for larger backup files (previously limited to reading in up to 2GB) - looks like new format supports up to 10GB based on the number of new pointers available but I would seriously consider the sanity of any server owner running something that large Updated progress status when a save is being loaded. Updated error reporting screen wording and provided link to ASV.log - a lot of new users say the screen is "unhelpful" and I don't believe they are aware more detail is available in the log file. As usual if there's anything I can help with (time permitting) please let me know.

Cracked it!.. this one still takes far too long to load @ 5.3GB but it does now load.. eventually. 292k tames in Valguero 544!! I'll put together a release after work this evening. There doesn't appear to be a "poll" available here but out of interest as I have no idea how many use ASV or what for - if you do, or have used ASV how/what do you use it for? As a viewer (ArkViewer.exe) to visually see what's goin on within the saved map data either as admin or a player. As a viewer (ArkViewer.exe), but mainly to use the commands and export options where I use JSON elsewhere. As an export tool (ASVExport.exe) to use the JSON elsewhere. As a Discord BOT to allow members to query ASV data themselves. Thanks in advance Mirage

Quick upate. I think we finally got there!! Between myself, Alex and Cadei who help with the ASB team it appears we can now finally read in Island892. I'll re-test all the other maps mentioned and a couple of older ones I have just to make sure but if no issues are found after work with them I'll put together a release this evening. Over 110k tames in cryo.. total of 117,259 tames!! No wonder it was still going after I left it 5 hours this morning. Thankfully I got a fix.. this backup now loads on my machine in approx. 15 minutes. ... edit .. Tested and working with: The Island 892 Aberration 266 Ragnarok 210 The Island 763 Still working on fixes to read in Valguero 544 - the stored creatures appear to be split between two portions of the file with it being more than 4GB in size.

@METALGOD - Work in progress, changes to the file format have led to me spending a number of hours working through byte by byte to see what has changed and if possible re-write the toolkit code to read in the new format. I'm working through debugging against Island PVE 892 and will update you all once I know more and hopefully have a fix to release. @MroczneZakamarki - Regardless of any fix I come up with ASV will always still attempt to parse .arktribe and .arkprofile data if it is available along with the .ark save file itself if that's what you mean? I can't even recall what is used from the .arkprofile data in ASV tbh. Also - I wasn't aware that my app was actually used by so many but have never accepted any donation. It started as something to benefit myself and my small tribe on our own private server, if it benefits others I'm happy to continue supporting it in what free time I have. Hopefully getting somewhere though - I managed to painfully reduce the .ark file size of 892 from 2.8GB to 1.5GB and got it all loading in ASV but when I tried the original it still errors out so I'm now working on that again to see why and what is causing the issues. ..edit.. FYI THIS has been my "bedtime reading" for the last week after work in my spare time - not the usual well defined "specification" I'm used to working with on the day job.

5.1GB... guess I should stop moaning I'm having to debug a 2.8GB save then 🤣

@darkradeon I might be able to read some of this data but I definitely won't be abe to write any of it. I honestly do not understand the ARK file format and changes I make to the reading of raw data are purely exploratory and not with any knowledge of how it is truly defined. This is why I have so many issues and it takes me so long to come up with fixes when the file format itself changes and the toolkit I use no longer reads them in. I'm not one to quit though and still doing what I can to work out a fix. It just takes so long to load everything so not getting very far each evevning in what time I have spare. Even trying to load the Islan892 file up in single player to verify my findings is horrid. 15-20 minute load time then it's like "turn based" ARK. I move forward a few steps.. then wait 30 seconds to move any further lol. I did find that there are additional bytes in the Hibernation section that I thought I had worked around after spotting there was always a certain byte before the "count" of the hibernation entries started. Turns out with Island892 there are multiple occurrences of this byte before the count so it's throwing everything out. I really need to do some investigation and see if I can work out what the additional bytes are and how they lead into the actual hibernation entry data to fix this. There is also a variance in how many bytes are saved in a cryopod - so might be more work around reading them in once I've solved the hibernation change. ...edit.. Sources for what project? ASV? - all on my Github. https://github.com/miragedmuk/ASV If you mean the toolkit I use - there are a few forks but the main one that's active is the one used by ARK Smark Breeding and the team. They are also actively looking into how to fix the reads for v11.

Apologies for the delay. I actually took a couple days off after the disheartening result of waiting 1.5 hours for The Island 892 to finally fail without pointing at anything obvious I had done wrong. Back to work today but will try get back to it this evening and hopefully make some more progress.

@Zargh - 45 minutes to load up but got there in the end with a few minor modifications to my code. Shutting down for the night now but will test it against the larger Island file from earlier today and if it works on that too I'll put together a release. 64k tames is quite a few lol.

@Alpha Prime if it's less than 2GB can I have a copy so I can investigate? Trying to trim the fat on these officials to a reasonable size atm so it doesn't take an hour each time I want to try read it into ASV to investigate further.

I can increase the 2GB file size limitation but the format still needs further investigation. My test files with -newsaveformat and -usestore I didn't actually do anything other than spawn and tame a dino and put it in cryo. Looking at this official Island file where the property "pointer" says to start there actually appears to be player tribe log looking data. I'll try and reproduce in my smaller game file to hopefully come up with a fix.

Peaked at approx. 24GB... seems to be hovering around 22GB atm but still loading after all this time.

@Alpha Prime using official backups or your own server? Is the file size for .ark larger than 2GB? Do you have a copy I can download to investigate? Still loading "NA-PVE-Official-TheIsland892" on my machine and no issues so far - other than the length of time and amount of RAM it is using. 22GB and counting.