Ciakon/racesm
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

idk

Browse Source
This commit is contained in:
Ciakon
2024-05-03 13:41:30 +02:00
parent 1e53774e99
commit 34adad0d55
159 changed files with 5919 additions and 163 deletions
Download Patch File Download Diff File Expand all files Collapse all files

306
MLAgents/results/IcecreamTrack2/run_logs/Player-0.log Normal file
View File

@@ -0,0 +1,306 @@
Mono path[0] = 'C:/Users/SukkertoppenDDU/Desktop/MLagents/Builds/IcecreamTrack2 part2/Racesm_L_Data/Managed'
Mono config path = 'C:/Users/SukkertoppenDDU/Desktop/MLagents/Builds/IcecreamTrack2 part2/MonoBleedingEdge/etc'
[Physics::Module] Initialized MultithreadedJobDispatcher with 15 workers.
Initialize engine version: 2022.3.11f1 (d00248457e15)
[Subsystems] Discovering subsystems at path C:/Users/SukkertoppenDDU/Desktop/MLagents/Builds/IcecreamTrack2 part2/Racesm_L_Data/UnitySubsystems
GfxDevice: creating device client; threaded=1; jobified=1
Direct3D:
Version: Direct3D 11.0 [level 11.1]
Renderer: NVIDIA GeForce RTX 3070 (ID=0x2488)
Vendor: NVIDIA
VRAM: 8043 MB
Driver: 30.0.14.9729
Begin MonoManager ReloadAssembly
- Loaded All Assemblies, in 1.417 seconds
- Finished resetting the current domain, in 0.001 seconds
<RI> Initializing input.
<RI> Input initialized.
<RI> Initialized touch support.
UnloadTime: 0.595500 ms
Setting up 8 worker threads for Enlighten.
Memory Statistics:
[ALLOC_TEMP_TLS] TLS Allocator
StackAllocators :
[ALLOC_TEMP_MAIN]
Peak usage frame count: [1.0 KB-2.0 KB]: 58415 frames, [2.0 KB-4.0 KB]: 475 frames, [4.0 KB-8.0 KB]: 2 frames, [8.0 KB-16.0 KB]: 16 frames, [16.0 KB-32.0 KB]: 3 frames, [32.0 KB-64.0 KB]: 3343 frames, [2.0 MB-4.0 MB]: 1 frames
Initial Block Size 4.0 MB
Current Block Size 4.0 MB
Peak Allocated Bytes 2.1 MB
Overflow Count 0
[ALLOC_TEMP_Background Job.worker 4]
Initial Block Size 32.0 KB
Current Block Size 32.0 KB
Peak Allocated Bytes 54 B
Overflow Count 0
[ALLOC_TEMP_Loading.PreloadManager]
Initial Block Size 256.0 KB
Current Block Size 340.0 KB
Peak Allocated Bytes 218.7 KB
Overflow Count 4
[ALLOC_TEMP_Background Job.worker 3]
Initial Block Size 32.0 KB
Current Block Size 32.0 KB
Peak Allocated Bytes 54 B
Overflow Count 0
[ALLOC_TEMP_Background Job.worker 11]
Initial Block Size 32.0 KB
Current Block Size 32.0 KB
Peak Allocated Bytes 54 B
Overflow Count 0
[ALLOC_TEMP_Background Job.worker 7]
Initial Block Size 32.0 KB
Current Block Size 32.0 KB
Peak Allocated Bytes 54 B
Overflow Count 0
[ALLOC_TEMP_Background Job.worker 6]
Initial Block Size 32.0 KB
Current Block Size 32.0 KB
Peak Allocated Bytes 54 B
Overflow Count 0
[ALLOC_TEMP_Job.worker 11]
Initial Block Size 256.0 KB
Current Block Size 256.0 KB
Peak Allocated Bytes 48.0 KB
Overflow Count 0
[ALLOC_TEMP_Background Job.worker 12]
Initial Block Size 32.0 KB
Current Block Size 32.0 KB
Peak Allocated Bytes 54 B
Overflow Count 0
[ALLOC_TEMP_Background Job.worker 2]
Initial Block Size 32.0 KB
Current Block Size 32.0 KB
Peak Allocated Bytes 54 B
Overflow Count 0
[ALLOC_TEMP_Background Job.worker 9]
Initial Block Size 32.0 KB
Current Block Size 32.0 KB
Peak Allocated Bytes 54 B
Overflow Count 0
[ALLOC_TEMP_Job.worker 0]
Initial Block Size 256.0 KB
Current Block Size 256.0 KB
Peak Allocated Bytes 48.0 KB
Overflow Count 0
[ALLOC_TEMP_Job.worker 4]
Initial Block Size 256.0 KB
Current Block Size 256.0 KB
Peak Allocated Bytes 48.0 KB
Overflow Count 0
[ALLOC_TEMP_Job.worker 5]
Initial Block Size 256.0 KB
Current Block Size 256.0 KB
Peak Allocated Bytes 48.0 KB
Overflow Count 0
[ALLOC_TEMP_Job.worker 14]
Initial Block Size 256.0 KB
Current Block Size 256.0 KB
Peak Allocated Bytes 24.0 KB
Overflow Count 0
[ALLOC_TEMP_Background Job.worker 10]
Initial Block Size 32.0 KB
Current Block Size 32.0 KB
Peak Allocated Bytes 54 B
Overflow Count 0
[ALLOC_TEMP_Job.worker 13]
Initial Block Size 256.0 KB
Current Block Size 256.0 KB
Peak Allocated Bytes 48.0 KB
Overflow Count 0
[ALLOC_TEMP_Background Job.worker 1]
Initial Block Size 32.0 KB
Current Block Size 32.0 KB
Peak Allocated Bytes 54 B
Overflow Count 0
[ALLOC_TEMP_EnlightenWorker] x 8
Initial Block Size 64.0 KB
Current Block Size 64.0 KB
Peak Allocated Bytes 54 B
Overflow Count 0
[ALLOC_TEMP_Job.worker 1]
Initial Block Size 256.0 KB
Current Block Size 256.0 KB
Peak Allocated Bytes 48.0 KB
Overflow Count 0
[ALLOC_TEMP_Job.worker 3]
Initial Block Size 256.0 KB
Current Block Size 256.0 KB
Peak Allocated Bytes 48.0 KB
Overflow Count 0
[ALLOC_TEMP_Background Job.worker 5]
Initial Block Size 32.0 KB
Current Block Size 32.0 KB
Peak Allocated Bytes 54 B
Overflow Count 0
[ALLOC_TEMP_Background Job.worker 8]
Initial Block Size 32.0 KB
Current Block Size 32.0 KB
Peak Allocated Bytes 54 B
Overflow Count 0
[ALLOC_TEMP_Job.worker 12]
Initial Block Size 256.0 KB
Current Block Size 256.0 KB
Peak Allocated Bytes 48.0 KB
Overflow Count 0
[ALLOC_TEMP_UnityGfxDeviceWorker]
Initial Block Size 256.0 KB
Current Block Size 256.0 KB
Peak Allocated Bytes 14.2 KB
Overflow Count 0
[ALLOC_TEMP_AssetGarbageCollectorHelper] x 15
Initial Block Size 64.0 KB
Current Block Size 64.0 KB
Peak Allocated Bytes 138 B
Overflow Count 0
[ALLOC_TEMP_Background Job.worker 13]
Initial Block Size 32.0 KB
Current Block Size 32.0 KB
Peak Allocated Bytes 54 B
Overflow Count 0
[ALLOC_TEMP_Background Job.worker 15]
Initial Block Size 32.0 KB
Current Block Size 32.0 KB
Peak Allocated Bytes 54 B
Overflow Count 0
[ALLOC_TEMP_Job.worker 2]
Initial Block Size 256.0 KB
Current Block Size 256.0 KB
Peak Allocated Bytes 48.0 KB
Overflow Count 0
[ALLOC_TEMP_Job.worker 10]
Initial Block Size 256.0 KB
Current Block Size 256.0 KB
Peak Allocated Bytes 48.0 KB
Overflow Count 0
[ALLOC_TEMP_Job.worker 7]
Initial Block Size 256.0 KB
Current Block Size 256.0 KB
Peak Allocated Bytes 24.0 KB
Overflow Count 0
[ALLOC_TEMP_Job.worker 9]
Initial Block Size 256.0 KB
Current Block Size 256.0 KB
Peak Allocated Bytes 48.0 KB
Overflow Count 0
[ALLOC_TEMP_Background Job.worker 0]
Initial Block Size 32.0 KB
Current Block Size 32.0 KB
Peak Allocated Bytes 54 B
Overflow Count 0
[ALLOC_TEMP_Job.worker 6]
Initial Block Size 256.0 KB
Current Block Size 256.0 KB
Peak Allocated Bytes 48.0 KB
Overflow Count 0
[ALLOC_TEMP_Job.worker 8]
Initial Block Size 256.0 KB
Current Block Size 256.0 KB
Peak Allocated Bytes 48.0 KB
Overflow Count 0
[ALLOC_TEMP_Background Job.worker 14]
Initial Block Size 32.0 KB
Current Block Size 32.0 KB
Peak Allocated Bytes 54 B
Overflow Count 0
[ALLOC_TEMP_Loading.AsyncRead]
Initial Block Size 64.0 KB
Current Block Size 64.0 KB
Peak Allocated Bytes 345 B
Overflow Count 0
[ALLOC_TEMP_BatchDeleteObjects]
Initial Block Size 64.0 KB
Current Block Size 64.0 KB
Peak Allocated Bytes 54 B
Overflow Count 0
[ALLOC_DEFAULT] Dual Thread Allocator
Peak main deferred allocation count 31
[ALLOC_BUCKET]
Large Block size 4.0 MB
Used Block count 1
Peak Allocated bytes 1.8 MB
[ALLOC_DEFAULT_MAIN]
Peak usage frame count: [16.0 MB-32.0 MB]: 62255 frames
Requested Block Size 16.0 MB
Peak Block count 2
Peak Allocated memory 24.0 MB
Peak Large allocation bytes 8.0 MB
[ALLOC_DEFAULT_THREAD]
Peak usage frame count: [16.0 MB-32.0 MB]: 62255 frames
Requested Block Size 16.0 MB
Peak Block count 1
Peak Allocated memory 21.8 MB
Peak Large allocation bytes 16.0 MB
[ALLOC_TEMP_JOB_1_FRAME]
Initial Block Size 2.0 MB
Used Block Count 0
Overflow Count (too large) 0
Overflow Count (full) 0
[ALLOC_TEMP_JOB_2_FRAMES]
Initial Block Size 2.0 MB
Used Block Count 0
Overflow Count (too large) 0
Overflow Count (full) 0
[ALLOC_TEMP_JOB_4_FRAMES (JobTemp)]
Initial Block Size 2.0 MB
Used Block Count 1
Overflow Count (too large) 0
Overflow Count (full) 0
[ALLOC_TEMP_JOB_ASYNC (Background)]
Initial Block Size 1.0 MB
Used Block Count 1
Overflow Count (too large) 0
Overflow Count (full) 0
[ALLOC_GFX] Dual Thread Allocator
Peak main deferred allocation count 1
[ALLOC_BUCKET]
Large Block size 4.0 MB
Used Block count 1
Peak Allocated bytes 1.8 MB
[ALLOC_GFX_MAIN]
Peak usage frame count: [32.0 KB-64.0 KB]: 62254 frames, [64.0 KB-128.0 KB]: 1 frames
Requested Block Size 16.0 MB
Peak Block count 1
Peak Allocated memory 66.0 KB
Peak Large allocation bytes 0 B
[ALLOC_GFX_THREAD]
Peak usage frame count: [2.0 MB-4.0 MB]: 108 frames, [4.0 MB-8.0 MB]: 62147 frames
Requested Block Size 16.0 MB
Peak Block count 1
Peak Allocated memory 5.4 MB
Peak Large allocation bytes 0 B
[ALLOC_CACHEOBJECTS] Dual Thread Allocator
Peak main deferred allocation count 2
[ALLOC_BUCKET]
Large Block size 4.0 MB
Used Block count 1
Peak Allocated bytes 1.8 MB
[ALLOC_CACHEOBJECTS_MAIN]
Peak usage frame count: [2.0 MB-4.0 MB]: 62255 frames
Requested Block Size 4.0 MB
Peak Block count 1
Peak Allocated memory 2.2 MB
Peak Large allocation bytes 0 B
[ALLOC_CACHEOBJECTS_THREAD]
Peak usage frame count: [2.0 MB-4.0 MB]: 62254 frames, [4.0 MB-8.0 MB]: 1 frames
Requested Block Size 4.0 MB
Peak Block count 2
Peak Allocated memory 6.8 MB
Peak Large allocation bytes 0 B
[ALLOC_TYPETREE] Dual Thread Allocator
Peak main deferred allocation count 0
[ALLOC_BUCKET]
Large Block size 4.0 MB
Used Block count 1
Peak Allocated bytes 1.8 MB
[ALLOC_TYPETREE_MAIN]
Peak usage frame count: [4.0 KB-8.0 KB]: 62255 frames
Requested Block Size 2.0 MB
Peak Block count 1
Peak Allocated memory 4.1 KB
Peak Large allocation bytes 0 B
[ALLOC_TYPETREE_THREAD]
Peak usage frame count: [0-1.0 KB]: 62254 frames, [1.0 KB-2.0 KB]: 1 frames
Requested Block Size 2.0 MB

320
MLAgents/results/IcecreamTrack2/run_logs/timers.json Normal file
View File

@@ -0,0 +1,320 @@
{
"name": "root",
"gauges": {
"IcecreamTrack2.Policy.Entropy.mean": {
"value": 1.6836251020431519,
"min": 1.6389111280441284,
"max": 1.9409809112548828,
"count": 166
},
"IcecreamTrack2.Policy.Entropy.sum": {
"value": 16795.84375,
"min": 15331.83984375,
"max": 19529.755859375,
"count": 166
},
"IcecreamTrack2.Step.mean": {
"value": 2369992.0,
"min": 719941.0,
"max": 2369992.0,
"count": 166
},
"IcecreamTrack2.Step.sum": {
"value": 2369992.0,
"min": 719941.0,
"max": 2369992.0,
"count": 166
},
"IcecreamTrack2.Policy.ExtrinsicValueEstimate.mean": {
"value": 5.2892374992370605,
"min": 3.332066535949707,
"max": 5.377326965332031,
"count": 166
},
"IcecreamTrack2.Policy.ExtrinsicValueEstimate.sum": {
"value": 893.8811645507812,
"min": 439.65057373046875,
"max": 925.701416015625,
"count": 166
},
"IcecreamTrack2.Environment.EpisodeLength.mean": {
"value": 411.88,
"min": 389.84,
"max": 655.125,
"count": 166
},
"IcecreamTrack2.Environment.EpisodeLength.sum": {
"value": 10297.0,
"min": 5241.0,
"max": 11799.0,
"count": 166
},
"IcecreamTrack2.Environment.CumulativeReward.mean": {
"value": 23.876385838985442,
"min": 14.857213143991041,
"max": 24.77216062322259,
"count": 166
},
"IcecreamTrack2.Environment.CumulativeReward.sum": {
"value": 596.9096459746361,
"min": 135.58335151150823,
"max": 621.592950552702,
"count": 166
},
"IcecreamTrack2.Policy.ExtrinsicReward.mean": {
"value": 23.876385838985442,
"min": 14.857213143991041,
"max": 24.77216062322259,
"count": 166
},
"IcecreamTrack2.Policy.ExtrinsicReward.sum": {
"value": 596.9096459746361,
"min": 135.58335151150823,
"max": 621.592950552702,
"count": 166
},
"IcecreamTrack2.IsTraining.mean": {
"value": 1.0,
"min": 1.0,
"max": 1.0,
"count": 166
},
"IcecreamTrack2.IsTraining.sum": {
"value": 1.0,
"min": 1.0,
"max": 1.0,
"count": 166
},
"IcecreamTrack2.Losses.PolicyLoss.mean": {
"value": 0.11521556020765333,
"min": 0.10424994623299069,
"max": 0.12242641909160591,
"count": 161
},
"IcecreamTrack2.Losses.PolicyLoss.sum": {
"value": 0.11521556020765333,
"min": 0.10424994623299069,
"max": 0.12242641909160591,
"count": 161
},
"IcecreamTrack2.Losses.ValueLoss.mean": {
"value": 0.28940156726696625,
"min": 0.26852792455413477,
"max": 0.4486245407838545,
"count": 161
},
"IcecreamTrack2.Losses.ValueLoss.sum": {
"value": 0.28940156726696625,
"min": 0.26852792455413477,
"max": 0.4486245407838545,
"count": 161
},
"IcecreamTrack2.Policy.LearningRate.mean": {
"value": 0.00015803410732197998,
"min": 0.00015803410732197998,
"max": 0.0002566459944513401,
"count": 161
},
"IcecreamTrack2.Policy.LearningRate.sum": {
"value": 0.00015803410732197998,
"min": 0.00015803410732197998,
"max": 0.0002566459944513401,
"count": 161
},
"IcecreamTrack2.Policy.Epsilon.mean": {
"value": 0.15267802,
"min": 0.15267802,
"max": 0.18554866000000003,
"count": 161
},
"IcecreamTrack2.Policy.Epsilon.sum": {
"value": 0.15267802,
"min": 0.15267802,
"max": 0.18554866000000003,
"count": 161
},
"IcecreamTrack2.Policy.Beta.mean": {
"value": 0.026343742198000005,
"min": 0.026343742198000005,
"max": 0.042775775134,
"count": 161
},
"IcecreamTrack2.Policy.Beta.sum": {
"value": 0.026343742198000005,
"min": 0.026343742198000005,
"max": 0.042775775134,
"count": 161
}
},
"metadata": {
"timer_format_version": "0.1.0",
"start_time_seconds": "1714038933",
"python_version": "3.9.13 (tags/v3.9.13:6de2ca5, May 17 2022, 16:36:42) [MSC v.1929 64 bit (AMD64)]",
"command_line_arguments": "C:\\Users\\SukkertoppenDDU\\AppData\\Local\\Programs\\Python\\Python39\\Scripts\\mlagents-learn config/LLL.yaml --run-id=IcecreamTrack2 --resume --env=Builds\\IcecreamTrack2 part2\\Racesm_L.exe",
"mlagents_version": "0.30.0",
"mlagents_envs_version": "0.30.0",
"communication_protocol_version": "1.5.0",
"pytorch_version": "2.3.0+cpu",
"numpy_version": "1.21.2",
"end_time_seconds": "1714041422"
},
"total": 2489.8108151,
"count": 1,
"self": 1.5384680000001936,
"children": {
"run_training.setup": {
"total": 0.06798219999999988,
"count": 1,
"self": 0.06798219999999988
},
"TrainerController.start_learning": {
"total": 2488.2043648999997,
"count": 1,
"self": 4.468781500012028,
"children": {
"TrainerController._reset_env": {
"total": 8.1476572,
"count": 1,
"self": 8.1476572
},
"TrainerController.advance": {
"total": 2475.5358802999876,
"count": 210218,
"self": 3.9878212000571693,
"children": {
"env_step": {
"total": 1403.6403923999546,
"count": 210218,
"self": 1048.2107893998573,
"children": {
"SubprocessEnvManager._take_step": {
"total": 352.9421941000317,
"count": 210218,
"self": 13.424491700014244,
"children": {
"TorchPolicy.evaluate": {
"total": 339.51770240001747,
"count": 207515,
"self": 339.51770240001747
}
}
},
"workers": {
"total": 2.487408900065615,
"count": 210217,
"self": 0.0,
"children": {
"worker_root": {
"total": 2476.504360199979,
"count": 210217,
"is_parallel": true,
"self": 1654.1055837999997,
"children": {
"steps_from_proto": {
"total": 0.0018059999999993082,
"count": 1,
"is_parallel": true,
"self": 0.0006997999999995841,
"children": {
"_process_rank_one_or_two_observation": {
"total": 0.001106199999999724,
"count": 6,
"is_parallel": true,
"self": 0.001106199999999724
}
}
},
"UnityEnvironment.step": {
"total": 822.3969703999794,
"count": 210217,
"is_parallel": true,
"self": 26.482695000002195,
"children": {
"UnityEnvironment._generate_step_input": {
"total": 47.884226299945226,
"count": 210217,
"is_parallel": true,
"self": 47.884226299945226
},
"communicator.exchange": {
"total": 669.2123821000014,
"count": 210217,
"is_parallel": true,
"self": 669.2123821000014
},
"steps_from_proto": {
"total": 78.81766700003058,
"count": 210217,
"is_parallel": true,
"self": 30.366130199898784,
"children": {
"_process_rank_one_or_two_observation": {
"total": 48.4515368001318,
"count": 1261302,
"is_parallel": true,
"self": 48.4515368001318
}
}
}
}
}
}
}
}
}
}
},
"trainer_advance": {
"total": 1067.9076666999758,
"count": 210217,
"self": 6.0882385999675535,
"children": {
"process_trajectory": {
"total": 173.2478836000081,
"count": 210217,
"self": 173.04350010000815,
"children": {
"RLTrainer._checkpoint": {
"total": 0.20438349999994898,
"count": 3,
"self": 0.20438349999994898
}
}
},
"_update_policy": {
"total": 888.5715445000003,
"count": 161,
"self": 341.4306103999651,
"children": {
"TorchPPOOptimizer.update": {
"total": 547.1409341000352,
"count": 98982,
"self": 547.1409341000352
}
}
}
}
}
}
},
"trainer_threads": {
"total": 6.999998731771484e-07,
"count": 1,
"self": 6.999998731771484e-07
},
"TrainerController._save_models": {
"total": 0.05204520000006596,
"count": 1,
"self": 0.005272200000035809,
"children": {
"RLTrainer._checkpoint": {
"total": 0.04677300000003015,
"count": 1,
"self": 0.04677300000003015
}
}
}
}
}
}
}

65
MLAgents/results/IcecreamTrack2/run_logs/training_status.json Normal file
View File

@@ -0,0 +1,65 @@
{
"IcecreamTrack2": {
"checkpoints": [
{
"steps": 712324,
"file_path": "results\\IcecreamTrack2\\IcecreamTrack2\\IcecreamTrack2-712324.onnx",
"reward": 18.69851303845644,
"creation_time": 1714038906.973998,
"auxillary_file_paths": [
"results\\IcecreamTrack2\\IcecreamTrack2\\IcecreamTrack2-712324.pt"
]
},
{
"steps": 999980,
"file_path": "results\\IcecreamTrack2\\IcecreamTrack2\\IcecreamTrack2-999980.onnx",
"reward": null,
"creation_time": 1714039363.0503757,
"auxillary_file_paths": [
"results\\IcecreamTrack2\\IcecreamTrack2\\IcecreamTrack2-999980.pt"
]
},
{
"steps": 1499997,
"file_path": "results\\IcecreamTrack2\\IcecreamTrack2\\IcecreamTrack2-1499997.onnx",
"reward": 22.733712602938926,
"creation_time": 1714040109.1068733,
"auxillary_file_paths": [
"results\\IcecreamTrack2\\IcecreamTrack2\\IcecreamTrack2-1499997.pt"
]
},
{
"steps": 1999957,
"file_path": "results\\IcecreamTrack2\\IcecreamTrack2\\IcecreamTrack2-1999957.onnx",
"reward": 23.865171190351248,
"creation_time": 1714040862.6291006,
"auxillary_file_paths": [
"results\\IcecreamTrack2\\IcecreamTrack2\\IcecreamTrack2-1999957.pt"
]
},
{
"steps": 2372203,
"file_path": "results\\IcecreamTrack2\\IcecreamTrack2\\IcecreamTrack2-2372203.onnx",
"reward": 24.51099300171648,
"creation_time": 1714041421.426924,
"auxillary_file_paths": [
"results\\IcecreamTrack2\\IcecreamTrack2\\IcecreamTrack2-2372203.pt"
]
}
],
"final_checkpoint": {
"steps": 2372203,
"file_path": "results\\IcecreamTrack2\\IcecreamTrack2.onnx",
"reward": 24.51099300171648,
"creation_time": 1714041421.426924,
"auxillary_file_paths": [
"results\\IcecreamTrack2\\IcecreamTrack2\\IcecreamTrack2-2372203.pt"
]
}
},
"metadata": {
"stats_format_version": "0.3.0",
"mlagents_version": "0.30.0",
"torch_version": "2.3.0+cpu"
}
}