Ciakon/racesm
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

idk

Browse Source
This commit is contained in:
Ciakon
2024-05-03 13:41:30 +02:00
parent 1e53774e99
commit 34adad0d55
159 changed files with 5919 additions and 163 deletions
Download Patch File Download Diff File Expand all files Collapse all files

306
MLAgents/results/RacecarTrack2/run_logs/Player-0.log Normal file
View File

@@ -0,0 +1,306 @@
Mono path[0] = 'C:/Users/SukkertoppenDDU/Desktop/MLagents/Builds/RacecarTrack2 part2/Racesm_L_Data/Managed'
Mono config path = 'C:/Users/SukkertoppenDDU/Desktop/MLagents/Builds/RacecarTrack2 part2/MonoBleedingEdge/etc'
[Physics::Module] Initialized MultithreadedJobDispatcher with 15 workers.
Initialize engine version: 2022.3.11f1 (d00248457e15)
[Subsystems] Discovering subsystems at path C:/Users/SukkertoppenDDU/Desktop/MLagents/Builds/RacecarTrack2 part2/Racesm_L_Data/UnitySubsystems
GfxDevice: creating device client; threaded=1; jobified=1
Direct3D:
Version: Direct3D 11.0 [level 11.1]
Renderer: NVIDIA GeForce RTX 3070 (ID=0x2488)
Vendor: NVIDIA
VRAM: 8043 MB
Driver: 30.0.14.9729
Begin MonoManager ReloadAssembly
- Loaded All Assemblies, in 0.085 seconds
- Finished resetting the current domain, in 0.001 seconds
<RI> Initializing input.
<RI> Input initialized.
<RI> Initialized touch support.
UnloadTime: 0.465400 ms
Setting up 8 worker threads for Enlighten.
Memory Statistics:
[ALLOC_TEMP_TLS] TLS Allocator
StackAllocators :
[ALLOC_TEMP_MAIN]
Peak usage frame count: [1.0 KB-2.0 KB]: 44373 frames, [2.0 KB-4.0 KB]: 227 frames, [4.0 KB-8.0 KB]: 2 frames, [8.0 KB-16.0 KB]: 17 frames, [16.0 KB-32.0 KB]: 1 frames, [32.0 KB-64.0 KB]: 4705 frames, [2.0 MB-4.0 MB]: 1 frames
Initial Block Size 4.0 MB
Current Block Size 4.0 MB
Peak Allocated Bytes 2.1 MB
Overflow Count 0
[ALLOC_TEMP_Background Job.worker 4]
Initial Block Size 32.0 KB
Current Block Size 32.0 KB
Peak Allocated Bytes 54 B
Overflow Count 0
[ALLOC_TEMP_Loading.PreloadManager]
Initial Block Size 256.0 KB
Current Block Size 332.0 KB
Peak Allocated Bytes 218.7 KB
Overflow Count 4
[ALLOC_TEMP_Background Job.worker 3]
Initial Block Size 32.0 KB
Current Block Size 32.0 KB
Peak Allocated Bytes 54 B
Overflow Count 0
[ALLOC_TEMP_Background Job.worker 11]
Initial Block Size 32.0 KB
Current Block Size 32.0 KB
Peak Allocated Bytes 54 B
Overflow Count 0
[ALLOC_TEMP_Background Job.worker 7]
Initial Block Size 32.0 KB
Current Block Size 32.0 KB
Peak Allocated Bytes 54 B
Overflow Count 0
[ALLOC_TEMP_Background Job.worker 6]
Initial Block Size 32.0 KB
Current Block Size 32.0 KB
Peak Allocated Bytes 54 B
Overflow Count 0
[ALLOC_TEMP_Job.worker 11]
Initial Block Size 256.0 KB
Current Block Size 256.0 KB
Peak Allocated Bytes 48.0 KB
Overflow Count 0
[ALLOC_TEMP_Background Job.worker 12]
Initial Block Size 32.0 KB
Current Block Size 32.0 KB
Peak Allocated Bytes 54 B
Overflow Count 0
[ALLOC_TEMP_Background Job.worker 2]
Initial Block Size 32.0 KB
Current Block Size 32.0 KB
Peak Allocated Bytes 54 B
Overflow Count 0
[ALLOC_TEMP_Background Job.worker 10]
Initial Block Size 32.0 KB
Current Block Size 32.0 KB
Peak Allocated Bytes 54 B
Overflow Count 0
[ALLOC_TEMP_Job.worker 0]
Initial Block Size 256.0 KB
Current Block Size 256.0 KB
Peak Allocated Bytes 24.0 KB
Overflow Count 0
[ALLOC_TEMP_Job.worker 4]
Initial Block Size 256.0 KB
Current Block Size 256.0 KB
Peak Allocated Bytes 48.0 KB
Overflow Count 0
[ALLOC_TEMP_Job.worker 5]
Initial Block Size 256.0 KB
Current Block Size 256.0 KB
Peak Allocated Bytes 48.0 KB
Overflow Count 0
[ALLOC_TEMP_Job.worker 14]
Initial Block Size 256.0 KB
Current Block Size 256.0 KB
Peak Allocated Bytes 24.0 KB
Overflow Count 0
[ALLOC_TEMP_Background Job.worker 15]
Initial Block Size 32.0 KB
Current Block Size 32.0 KB
Peak Allocated Bytes 54 B
Overflow Count 0
[ALLOC_TEMP_Job.worker 13]
Initial Block Size 256.0 KB
Current Block Size 256.0 KB
Peak Allocated Bytes 48.0 KB
Overflow Count 0
[ALLOC_TEMP_Background Job.worker 1]
Initial Block Size 32.0 KB
Current Block Size 32.0 KB
Peak Allocated Bytes 54 B
Overflow Count 0
[ALLOC_TEMP_EnlightenWorker] x 8
Initial Block Size 64.0 KB
Current Block Size 64.0 KB
Peak Allocated Bytes 54 B
Overflow Count 0
[ALLOC_TEMP_Job.worker 1]
Initial Block Size 256.0 KB
Current Block Size 256.0 KB
Peak Allocated Bytes 48.0 KB
Overflow Count 0
[ALLOC_TEMP_Background Job.worker 9]
Initial Block Size 32.0 KB
Current Block Size 32.0 KB
Peak Allocated Bytes 54 B
Overflow Count 0
[ALLOC_TEMP_Job.worker 3]
Initial Block Size 256.0 KB
Current Block Size 256.0 KB
Peak Allocated Bytes 48.0 KB
Overflow Count 0
[ALLOC_TEMP_Background Job.worker 5]
Initial Block Size 32.0 KB
Current Block Size 32.0 KB
Peak Allocated Bytes 54 B
Overflow Count 0
[ALLOC_TEMP_Background Job.worker 8]
Initial Block Size 32.0 KB
Current Block Size 32.0 KB
Peak Allocated Bytes 54 B
Overflow Count 0
[ALLOC_TEMP_Job.worker 12]
Initial Block Size 256.0 KB
Current Block Size 256.0 KB
Peak Allocated Bytes 24.0 KB
Overflow Count 0
[ALLOC_TEMP_UnityGfxDeviceWorker]
Initial Block Size 256.0 KB
Current Block Size 256.0 KB
Peak Allocated Bytes 14.2 KB
Overflow Count 0
[ALLOC_TEMP_AssetGarbageCollectorHelper] x 15
Initial Block Size 64.0 KB
Current Block Size 64.0 KB
Peak Allocated Bytes 138 B
Overflow Count 0
[ALLOC_TEMP_Background Job.worker 13]
Initial Block Size 32.0 KB
Current Block Size 32.0 KB
Peak Allocated Bytes 54 B
Overflow Count 0
[ALLOC_TEMP_Job.worker 2]
Initial Block Size 256.0 KB
Current Block Size 256.0 KB
Peak Allocated Bytes 48.0 KB
Overflow Count 0
[ALLOC_TEMP_Job.worker 10]
Initial Block Size 256.0 KB
Current Block Size 256.0 KB
Peak Allocated Bytes 24.0 KB
Overflow Count 0
[ALLOC_TEMP_Job.worker 7]
Initial Block Size 256.0 KB
Current Block Size 256.0 KB
Peak Allocated Bytes 24.0 KB
Overflow Count 0
[ALLOC_TEMP_Job.worker 9]
Initial Block Size 256.0 KB
Current Block Size 256.0 KB
Peak Allocated Bytes 48.0 KB
Overflow Count 0
[ALLOC_TEMP_Background Job.worker 0]
Initial Block Size 32.0 KB
Current Block Size 32.0 KB
Peak Allocated Bytes 54 B
Overflow Count 0
[ALLOC_TEMP_Job.worker 6]
Initial Block Size 256.0 KB
Current Block Size 256.0 KB
Peak Allocated Bytes 24.0 KB
Overflow Count 0
[ALLOC_TEMP_Job.worker 8]
Initial Block Size 256.0 KB
Current Block Size 256.0 KB
Peak Allocated Bytes 24.0 KB
Overflow Count 0
[ALLOC_TEMP_Background Job.worker 14]
Initial Block Size 32.0 KB
Current Block Size 32.0 KB
Peak Allocated Bytes 54 B
Overflow Count 0
[ALLOC_TEMP_Loading.AsyncRead]
Initial Block Size 64.0 KB
Current Block Size 64.0 KB
Peak Allocated Bytes 342 B
Overflow Count 0
[ALLOC_TEMP_BatchDeleteObjects]
Initial Block Size 64.0 KB
Current Block Size 64.0 KB
Peak Allocated Bytes 54 B
Overflow Count 0
[ALLOC_DEFAULT] Dual Thread Allocator
Peak main deferred allocation count 31
[ALLOC_BUCKET]
Large Block size 4.0 MB
Used Block count 1
Peak Allocated bytes 1.8 MB
[ALLOC_DEFAULT_MAIN]
Peak usage frame count: [16.0 MB-32.0 MB]: 49326 frames
Requested Block Size 16.0 MB
Peak Block count 2
Peak Allocated memory 23.9 MB
Peak Large allocation bytes 8.0 MB
[ALLOC_DEFAULT_THREAD]
Peak usage frame count: [16.0 MB-32.0 MB]: 49326 frames
Requested Block Size 16.0 MB
Peak Block count 1
Peak Allocated memory 21.8 MB
Peak Large allocation bytes 16.0 MB
[ALLOC_TEMP_JOB_1_FRAME]
Initial Block Size 2.0 MB
Used Block Count 0
Overflow Count (too large) 0
Overflow Count (full) 0
[ALLOC_TEMP_JOB_2_FRAMES]
Initial Block Size 2.0 MB
Used Block Count 0
Overflow Count (too large) 0
Overflow Count (full) 0
[ALLOC_TEMP_JOB_4_FRAMES (JobTemp)]
Initial Block Size 2.0 MB
Used Block Count 1
Overflow Count (too large) 0
Overflow Count (full) 0
[ALLOC_TEMP_JOB_ASYNC (Background)]
Initial Block Size 1.0 MB
Used Block Count 1
Overflow Count (too large) 0
Overflow Count (full) 0
[ALLOC_GFX] Dual Thread Allocator
Peak main deferred allocation count 1
[ALLOC_BUCKET]
Large Block size 4.0 MB
Used Block count 1
Peak Allocated bytes 1.8 MB
[ALLOC_GFX_MAIN]
Peak usage frame count: [32.0 KB-64.0 KB]: 49325 frames, [64.0 KB-128.0 KB]: 1 frames
Requested Block Size 16.0 MB
Peak Block count 1
Peak Allocated memory 66.0 KB
Peak Large allocation bytes 0 B
[ALLOC_GFX_THREAD]
Peak usage frame count: [2.0 MB-4.0 MB]: 414 frames, [4.0 MB-8.0 MB]: 48912 frames
Requested Block Size 16.0 MB
Peak Block count 1
Peak Allocated memory 5.2 MB
Peak Large allocation bytes 0 B
[ALLOC_CACHEOBJECTS] Dual Thread Allocator
Peak main deferred allocation count 2
[ALLOC_BUCKET]
Large Block size 4.0 MB
Used Block count 1
Peak Allocated bytes 1.8 MB
[ALLOC_CACHEOBJECTS_MAIN]
Peak usage frame count: [2.0 MB-4.0 MB]: 49326 frames
Requested Block Size 4.0 MB
Peak Block count 1
Peak Allocated memory 2.2 MB
Peak Large allocation bytes 0 B
[ALLOC_CACHEOBJECTS_THREAD]
Peak usage frame count: [2.0 MB-4.0 MB]: 49325 frames, [4.0 MB-8.0 MB]: 1 frames
Requested Block Size 4.0 MB
Peak Block count 2
Peak Allocated memory 6.1 MB
Peak Large allocation bytes 0 B
[ALLOC_TYPETREE] Dual Thread Allocator
Peak main deferred allocation count 0
[ALLOC_BUCKET]
Large Block size 4.0 MB
Used Block count 1
Peak Allocated bytes 1.8 MB
[ALLOC_TYPETREE_MAIN]
Peak usage frame count: [4.0 KB-8.0 KB]: 49326 frames
Requested Block Size 2.0 MB
Peak Block count 1
Peak Allocated memory 4.1 KB
Peak Large allocation bytes 0 B
[ALLOC_TYPETREE_THREAD]
Peak usage frame count: [0-1.0 KB]: 49325 frames, [1.0 KB-2.0 KB]: 1 frames
Requested Block Size 2.0 MB

320
MLAgents/results/RacecarTrack2/run_logs/timers.json Normal file
View File

@@ -0,0 +1,320 @@
{
"name": "root",
"gauges": {
"RacecarTrack2.Policy.Entropy.mean": {
"value": 1.3993903398513794,
"min": 1.3993903398513794,
"max": 1.8428030014038086,
"count": 132
},
"RacecarTrack2.Policy.Entropy.sum": {
"value": 13993.9033203125,
"min": 8835.998046875,
"max": 18604.939453125,
"count": 132
},
"RacecarTrack2.Step.mean": {
"value": 2029969.0,
"min": 719975.0,
"max": 2029969.0,
"count": 132
},
"RacecarTrack2.Step.sum": {
"value": 2029969.0,
"min": 719975.0,
"max": 2029969.0,
"count": 132
},
"RacecarTrack2.Policy.ExtrinsicValueEstimate.mean": {
"value": 7.826251983642578,
"min": 4.873648643493652,
"max": 7.84055233001709,
"count": 132
},
"RacecarTrack2.Policy.ExtrinsicValueEstimate.sum": {
"value": 1361.767822265625,
"min": 360.6499938964844,
"max": 1361.767822265625,
"count": 132
},
"RacecarTrack2.Environment.EpisodeLength.mean": {
"value": 236.46666666666667,
"min": 235.62790697674419,
"max": 421.25,
"count": 132
},
"RacecarTrack2.Environment.EpisodeLength.sum": {
"value": 10641.0,
"min": 3370.0,
"max": 11103.0,
"count": 132
},
"RacecarTrack2.Environment.CumulativeReward.mean": {
"value": 24.35301135579745,
"min": 16.950463268905878,
"max": 24.41715809371736,
"count": 132
},
"RacecarTrack2.Environment.CumulativeReward.sum": {
"value": 1095.8855110108852,
"min": 135.60370615124702,
"max": 1095.8855110108852,
"count": 132
},
"RacecarTrack2.Policy.ExtrinsicReward.mean": {
"value": 24.35301135579745,
"min": 16.950463268905878,
"max": 24.41715809371736,
"count": 132
},
"RacecarTrack2.Policy.ExtrinsicReward.sum": {
"value": 1095.8855110108852,
"min": 135.60370615124702,
"max": 1095.8855110108852,
"count": 132
},
"RacecarTrack2.IsTraining.mean": {
"value": 1.0,
"min": 1.0,
"max": 1.0,
"count": 132
},
"RacecarTrack2.IsTraining.sum": {
"value": 1.0,
"min": 1.0,
"max": 1.0,
"count": 132
},
"RacecarTrack2.Losses.PolicyLoss.mean": {
"value": 0.11060398251198732,
"min": 0.10318752745090941,
"max": 0.1207956799904142,
"count": 127
},
"RacecarTrack2.Losses.PolicyLoss.sum": {
"value": 0.11060398251198732,
"min": 0.10318752745090941,
"max": 0.1207956799904142,
"count": 127
},
"RacecarTrack2.Losses.ValueLoss.mean": {
"value": 0.1292799282001286,
"min": 0.09924579720671584,
"max": 0.5470766848180352,
"count": 127
},
"RacecarTrack2.Losses.ValueLoss.sum": {
"value": 0.1292799282001286,
"min": 0.09924579720671584,
"max": 0.5470766848180352,
"count": 127
},
"RacecarTrack2.Policy.LearningRate.mean": {
"value": 0.00017878480040508003,
"min": 0.00017878480040508003,
"max": 0.00025645633451456005,
"count": 127
},
"RacecarTrack2.Policy.LearningRate.sum": {
"value": 0.00017878480040508003,
"min": 0.00017878480040508003,
"max": 0.00025645633451456005,
"count": 127
},
"RacecarTrack2.Policy.Epsilon.mean": {
"value": 0.15959492,
"min": 0.15959492,
"max": 0.18548543999999997,
"count": 127
},
"RacecarTrack2.Policy.Epsilon.sum": {
"value": 0.15959492,
"min": 0.15959492,
"max": 0.18548543999999997,
"count": 127
},
"RacecarTrack2.Policy.Beta.mean": {
"value": 0.029801500508000005,
"min": 0.029801500508000005,
"max": 0.042744171456000006,
"count": 127
},
"RacecarTrack2.Policy.Beta.sum": {
"value": 0.029801500508000005,
"min": 0.029801500508000005,
"max": 0.042744171456000006,
"count": 127
}
},
"metadata": {
"timer_format_version": "0.1.0",
"start_time_seconds": "1714033897",
"python_version": "3.9.13 (tags/v3.9.13:6de2ca5, May 17 2022, 16:36:42) [MSC v.1929 64 bit (AMD64)]",
"command_line_arguments": "C:\\Users\\SukkertoppenDDU\\AppData\\Local\\Programs\\Python\\Python39\\Scripts\\mlagents-learn config/LLL.yaml --run-id=RacecarTrack2 --resume --env=Builds\\RacecarTrack2 part2\\Racesm_L.exe",
"mlagents_version": "0.30.0",
"mlagents_envs_version": "0.30.0",
"communication_protocol_version": "1.5.0",
"pytorch_version": "2.3.0+cpu",
"numpy_version": "1.21.2",
"end_time_seconds": "1714035849"
},
"total": 1951.6701458999999,
"count": 1,
"self": 0.2424239999998008,
"children": {
"run_training.setup": {
"total": 0.06349230000000006,
"count": 1,
"self": 0.06349230000000006
},
"TrainerController.start_learning": {
"total": 1951.3642296,
"count": 1,
"self": 3.1981367999824215,
"children": {
"TrainerController._reset_env": {
"total": 5.4445986,
"count": 1,
"self": 5.4445986
},
"TrainerController.advance": {
"total": 1942.6599118000177,
"count": 168232,
"self": 3.1001032000438045,
"children": {
"env_step": {
"total": 1085.9256885000104,
"count": 168232,
"self": 834.5117967000376,
"children": {
"SubprocessEnvManager._take_step": {
"total": 249.48164799997926,
"count": 168232,
"self": 9.625592899954654,
"children": {
"TorchPolicy.evaluate": {
"total": 239.8560551000246,
"count": 164419,
"self": 239.8560551000246
}
}
},
"workers": {
"total": 1.9322437999935467,
"count": 168232,
"self": 0.0,
"children": {
"worker_root": {
"total": 1940.8134554999986,
"count": 168232,
"is_parallel": true,
"self": 1271.5039737000238,
"children": {
"steps_from_proto": {
"total": 0.00046560000000006596,
"count": 1,
"is_parallel": true,
"self": 0.00016540000000198063,
"children": {
"_process_rank_one_or_two_observation": {
"total": 0.00030019999999808533,
"count": 6,
"is_parallel": true,
"self": 0.00030019999999808533
}
}
},
"UnityEnvironment.step": {
"total": 669.3090161999748,
"count": 168232,
"is_parallel": true,
"self": 20.44959419988686,
"children": {
"UnityEnvironment._generate_step_input": {
"total": 32.56759710003403,
"count": 168232,
"is_parallel": true,
"self": 32.56759710003403
},
"communicator.exchange": {
"total": 556.4037336000775,
"count": 168232,
"is_parallel": true,
"self": 556.4037336000775
},
"steps_from_proto": {
"total": 59.888091299976395,
"count": 168232,
"is_parallel": true,
"self": 22.70735709995128,
"children": {
"_process_rank_one_or_two_observation": {
"total": 37.180734200025114,
"count": 1009392,
"is_parallel": true,
"self": 37.180734200025114
}
}
}
}
}
}
}
}
}
}
},
"trainer_advance": {
"total": 853.6341200999634,
"count": 168232,
"self": 4.475069199966924,
"children": {
"process_trajectory": {
"total": 121.44999709999652,
"count": 168232,
"self": 121.23218689999649,
"children": {
"RLTrainer._checkpoint": {
"total": 0.21781020000003082,
"count": 3,
"self": 0.21781020000003082
}
}
},
"_update_policy": {
"total": 727.7090538,
"count": 128,
"self": 272.1004473000106,
"children": {
"TorchPPOOptimizer.update": {
"total": 455.6086064999894,
"count": 78350,
"self": 455.6086064999894
}
}
}
}
}
}
},
"trainer_threads": {
"total": 9.000000318337698e-07,
"count": 1,
"self": 9.000000318337698e-07
},
"TrainerController._save_models": {
"total": 0.06158149999987472,
"count": 1,
"self": 0.009829899999886038,
"children": {
"RLTrainer._checkpoint": {
"total": 0.051751599999988684,
"count": 1,
"self": 0.051751599999988684
}
}
}
}
}
}
}

65
MLAgents/results/RacecarTrack2/run_logs/training_status.json Normal file
View File

@@ -0,0 +1,65 @@
{
"RacecarTrack2": {
"checkpoints": [
{
"steps": 715445,
"file_path": "results\\RacecarTrack2\\RacecarTrack2\\RacecarTrack2-715445.onnx",
"reward": 23.27006483823061,
"creation_time": 1714033876.7167692,
"auxillary_file_paths": [
"results\\RacecarTrack2\\RacecarTrack2\\RacecarTrack2-715445.pt"
]
},
{
"steps": 999941,
"file_path": "results\\RacecarTrack2\\RacecarTrack2\\RacecarTrack2-999941.onnx",
"reward": 24.126434030740157,
"creation_time": 1714034335.5119324,
"auxillary_file_paths": [
"results\\RacecarTrack2\\RacecarTrack2\\RacecarTrack2-999941.pt"
]
},
{
"steps": 1499959,
"file_path": "results\\RacecarTrack2\\RacecarTrack2\\RacecarTrack2-1499959.onnx",
"reward": 24.268331559499106,
"creation_time": 1714035087.5419703,
"auxillary_file_paths": [
"results\\RacecarTrack2\\RacecarTrack2\\RacecarTrack2-1499959.pt"
]
},
{
"steps": 1999970,
"file_path": "results\\RacecarTrack2\\RacecarTrack2\\RacecarTrack2-1999970.onnx",
"reward": 22.941488802433014,
"creation_time": 1714035808.7444036,
"auxillary_file_paths": [
"results\\RacecarTrack2\\RacecarTrack2\\RacecarTrack2-1999970.pt"
]
},
{
"steps": 2030545,
"file_path": "results\\RacecarTrack2\\RacecarTrack2\\RacecarTrack2-2030545.onnx",
"reward": null,
"creation_time": 1714035848.9144044,
"auxillary_file_paths": [
"results\\RacecarTrack2\\RacecarTrack2\\RacecarTrack2-2030545.pt"
]
}
],
"final_checkpoint": {
"steps": 2030545,
"file_path": "results\\RacecarTrack2\\RacecarTrack2.onnx",
"reward": null,
"creation_time": 1714035848.9144044,
"auxillary_file_paths": [
"results\\RacecarTrack2\\RacecarTrack2\\RacecarTrack2-2030545.pt"
]
}
},
"metadata": {
"stats_format_version": "0.3.0",
"mlagents_version": "0.30.0",
"torch_version": "2.3.0+cpu"
}
}