Admin / Trusted Player Tool - Game Save Visualiser

[MirageUK]

On 12/10/2024 at 1:46 AM, jrole said:

is there a way to read files quicker for big files. as im just needing certain data from a export but big files take 10 minutes + . Im using asv export

Do you have a copy of that backup I could have?

I'm going to be re-writing the parsing code for ASA saves with a view of trying to improve the performance.

Same goes for everybody else - if you have a big save file please feel free to send me a copy.  It will be nice to have mulitple saves to do comparrisons of new vs old parsing when I get that far.

[Elgar]

Hi Mirage,

I noticed that for Extinction ASV detects a lot of creatures with negative latitude or longitude values. Values as low as -15 for latitude and -12 for longitude. Does that mean that these creatures spawned outside of the map boundaries, or that it's an issue with "calibration" of Extinction's map in ASV ?

[MirageUK]

I'm not sure if they are "out of bounds" but them co-ords do appear to be genuine.  Confirmed by checking my map after doing setplayerpos.

I don't show them as markers on my drawn map though as the top of my grid alignment is ZERO so no space before to show them.

[MirageUK]

Who has the biggest?...

... Ark Ascended save file size?

The re-write is coming along much better/faster than I had originally thought and I've almost got it completely coded.  I just have to parse cryo stored creature saddle data and it will match what is parsed in the current version.

In my limited testing on my own tiny Aberration save (61mb) I've improved the read from 1.7 seconds... to 1.4 seconds

In testing one provided here previously, Aberration save (321mb) the read time has been improved from 66 (sixty-six or one-minute-six) to... 6 (six) seconds!!!! Still some code to complete as that's missing approx. 1.5k objects that I'm going to guess relate to saddle/costume data I've not yet read but with almost 450k objects in total it's not going to affect performance THAT much reading them in too.

Be intersting to see what gains there are with other maps before I also start to re-write ASV/ASVExport etc. to take advantage of the new parser.

With this in mind, if you can, please provide me with some meaty backups to test more.

Thanks in advance

Mirage

[StevenB]

Sent you a 700MB Island save if you want to test with that 😛

[MirageUK]

18 hours ago, StevenB said:

Sent you a 700MB Island save if you want to test with that 😛

Ok - maybe I don't need the largest file size but any saves that take the current ASV a long time to parse.

• Current parser on your data =  32.08 seconds.
• New parser on your data = 14.58 seconds.

 

@Larkfields - not as much improvement on your data.  The Island @ 263mb.

• Current parser = 6.99 seconds.
• New parser = 4.79 seconds.

Interested to find out what's in the save mentioned by @jrole that takes 10 minutes to export.

Edited December 28, 2024 by MirageUK

[MirageUK]

Currently working on a 1.2gb Island backup provided to me.  

New parser is a little heavier on the cpu but much more efficient on the memory use.

New (Top) vs Current (Bottom)

Edited December 28, 2024 by MirageUK

[Elgar]

Hi Mirage, since you work on a new version, could you please check the "Copy .arkprofile filename" function when you right-click a player's name ? It doesn't work anymore. Thank you ^^

[MirageUK]

1 hour ago, Elgar said:

Hi Mirage, since you work on a new version, could you please check the "Copy .arkprofile filename" function when you right-click a player's name ? It doesn't work anymore. Thank you ^^

Since -usestore? .. maybe because there are no ".arkprofile" files read in now it's taking them from .ark itself?

[Elgar]

2 hours ago, MirageUK said:

Since -usestore? .. maybe because there are no ".arkprofile" files read in now it's taking them from .ark itself?

No, I still have a few servers in my cluster using the classic save format, I guess, since I can see the .arkprofile files' timestamps being updated as players play. According to what I read on Discord, it seems that Nitrado enabled the new save format on new servers, but old servers still have the classic format.

I don't like that, to have such a mix in my cluster, but we don't have any way to control that so far. (Fortunately there is seemingly no issue as players transfer between servers with different save format.)

Also, I think I noticed that the function stopped working a while ago, but I forgot to report it, sorry.

EDIT : That makes me think, would it be possible to have a visual clue showing us which save format is used by the server currently loaded in ASV...?

Edited December 29, 2024 by Elgar

[MirageUK]

There is a "SaveVersion" property I could easily expose.

 

[StevenB]

Looking forward to testing the new parser, very good improvements!

[pleinx]

On 12/27/2024 at 2:14 PM, StevenB said:

Sent you a 700MB Island save if you want to test with that 😛

Damn, crazy!  Is that a general cluster? Or playing with friends?

 

@MirageUK sent you DM with savegames of all maps

[MirageUK]

... I got plenty left to uncover. 

Been hacking away for days and when not working the day job this Matrix is slowly being burnt into my retinas...

[Larkfields]

Hi Mirage.   I think you need to check your system clock...   
Those timestamps suggest you've been in Ark since 30th December 1899 🙂

[MirageUK]

5 minutes ago, Larkfields said:

Hi Mirage.   I think you need to check your system clock...   
Those timestamps suggest you've been in Ark since 30th December 1899 🙂

The data I was interested in for this case was the int value (669651493) which using a name table pair I read in earlier tells me this property name is "CustomFolderItemIds".... but it's a Struct Array within a Struct within a Struct Array.  My brain hurts.

Edited January 2 by MirageUK

[Graviphoton]

2 hours ago, MirageUK said:

The data I was interested in for this case was the int value (669651493) which using a name table pair I read in earlier tells me this property name is "CustomFolderItemIds".... but it's a Struct Array within a Struct within a Struct Array.  My brain hurts.

I have to admire your work all the more when I see what you're struggling with...
Good luck with these "...tricks within tricks within tricks..."

[StevenB]

14 hours ago, pleinx said:

Damn, crazy!  Is that a general cluster? Or playing with friends?

A general cluster, when it was the most active it was 1.2 GB, but on ASE I had 2.1 GB on one map

[pleinx]

2 hours ago, StevenB said:

A general cluster, when it was the most active it was 1.2 GB, but on ASE I had 2.1 GB on one map

Holy moly! Crazy 🙂 I don't wanna spy, but are you fine that you sent me this big savegame? Its great for my performance benchmarks (i love to test new hardware for ASA servers :-D). But my test savegame is just 400mb.

 

If not, its really no problem, can understand 🙂
My Discord, if you wanna add me: pleinx

Edited January 2 by pleinx

[MirageUK]

Had a couple days off coding.. fresh brain and I worked out easier way to find the property names without having to eye-ball the byes in an hex editor.  I'm a programmer.. no idea why I was doing this manually 🤠  List of start positions and known named properties.

Now I have a visual representation of what to expect I can work on the nuances of each data type to crack them all

{[102, InventoryItems]}
	{[110, ArrayProperty]}
	{[126, ObjectProperty]}

{[1399, bInitializedMe]}
	{[1407, BoolProperty]}

{[1425, LastInventoryRefreshTime]}
	{[1433, DoubleProperty]}

{[1458, CustomFolderItems]}
  {[1466, ArrayProperty]}
      {[1482, StructProperty]}
          {[1495, CustomFolderItems]}
          {[1503, StructProperty]}
              {[1519, ServerCustomFolder]}

              {[1544, InventoryCompType]}
              {[1552, IntProperty]}
              {[1573, FolderName]}
              {[1581, StrProperty]}
              {[1608, CustomFolderItemIds]}
              {[1616, ArrayProperty]}
                  {[1632, StructProperty]}
                      {[1645, CustomFolderItemIds]}
                      {[1653, StructProperty]}
                          {[1669, ItemNetID]}
              {[1694, None]}

              {[1702, InventoryCompType]}
              {[1710, IntProperty]}
              {[1731, FolderName]}
              {[1739, StrProperty]}
              {[1767, CustomFolderItemIds]}
              {[1775, ArrayProperty]}
                  {[1791, StructProperty]}
                      {[1804, CustomFolderItemIds]}
                      {[1812, StructProperty]}
                          {[1828, ItemNetID]}
              {[1853, None]}

              {[1861, InventoryCompType]}
              {[1869, IntProperty]}
              {[1890, FolderName]}
              {[1898, StrProperty]}
              {[1926, CustomFolderItemIds]}
              {[1934, ArrayProperty]}
                  {[1950, StructProperty]}
                      {[1963, CustomFolderItemIds]}
                      {[1971, StructProperty]}
                          {[1987, ItemNetID]}
              {[2012, None]}

              {[2020, InventoryCompType]}
              {[2028, IntProperty]}
              {[2049, FolderName]}
              {[2057, StrProperty]}
              {[2090, CustomFolderItemIds]}
              {[2098, ArrayProperty]}
                  {[2114, StructProperty]}
                      {[2127, CustomFolderItemIds]}
                      {[2135, StructProperty]}
                          {[2151, ItemNetID]}
                              {[2176, ItemID1]}
                              {[2184, UInt32Property]}
                              {[2205, ItemID2]}
                              {[2213, UInt32Property]}
                              {[2234, None]}

              {[2242, None]}

          {[2250, None]}

 

[Myrmecoleon]

Just wondering, is there an issue with stored Gachas currently or an issue on my end? Seems I can't find them when they're stored in cryopods from the viewer, but when outside pods they read fine. They're vanilla gachas.

[MirageUK]

On 1/8/2025 at 2:28 AM, Myrmecoleon said:

Just wondering, is there an issue with stored Gachas currently or an issue on my end? Seems I can't find them when they're stored in cryopods from the viewer, but when outside pods they read fine. They're vanilla gachas.

Quite possible based on the number of property types the current parser doesn't handle. 

It may have reached a property in the cryo data that it doesn't know how to handle, skipped the remaining properties and therefore hasn't got enough data for ASV to assign to the tribe etc.

I'm currently playing again so not had chance to finish off the new parser - stil working on it though.

[Myrmecoleon]

11 hours ago, MirageUK said:

Quite possible based on the number of property types the current parser doesn't handle. 

It may have reached a property in the cryo data that it doesn't know how to handle, skipped the remaining properties and therefore hasn't got enough data for ASV to assign to the tribe etc.

I'm currently playing again so not had chance to finish off the new parser - stil working on it though.

Yeah that sounds about right, I think ARK Smart Breeding originally had issues with Gachas back in ASE. They've got some weird stuff going on.

 

If you want me to grab a list of gacha's savegame variables (afaik that's what gets stored into dino data, and not non-savegame vars) in order, I can pull up the devkit. Could help for finding which one is breaking it.

 

Another thing to note - could it be possible to add modded traits to the Filter by Trait list? It does display mod traits on the dino list but not when you filter by traits.

Edited January 9 by Myrmecoleon

[MirageUK]

14 hours ago, Myrmecoleon said:

Yeah that sounds about right, I think ARK Smart Breeding originally had issues with Gachas back in ASE. They've got some weird stuff going on.

 

If you want me to grab a list of gacha's savegame variables (afaik that's what gets stored into dino data, and not non-savegame vars) in order, I can pull up the devkit. Could help for finding which one is breaking it.

 

Another thing to note - could it be possible to add modded traits to the Filter by Trait list? It does display mod traits on the dino list but not when you filter by traits.

I'll look into changing the traits filter list to populate it dynamically from the data available.  Currently its hard-coded to the original traits I found.

If you have a save file that I can download with the cryo'd Gacha issue I can investigate.   

Not sure how much the dev kit stuff is going to help tbh.  Everything I've done so far I've hacked away at until I found the information I needed - adding some official stuff in might just confuse me and/or force me to re-think how I've done it all

I would say the re-write of the parser is approx. 90% complete so hopefully that doesn't have same issues moving forward.

Edited January 10 by MirageUK

[pleinx]

Hrello

JFYI Corrupted ones are not tamable

    {
      "id": 112742002277141761,
      "creature": "Gigant_Character_BP_Corrupt_C",
      "sex": "Male",
      "lvl": 50,
      ...
      "ccc": "12443,845 -258488,6 -4203,476",
      "dinoid": "112742002277141761",
      "tameable": true, <--
      "trait": ""
    },