arthur/handson-ml3
1
0
Fork 0
mirror of https://github.com/ArthurDanjou/handson-ml3.git synced 2026-01-14 12:14:36 +01:00
Code Issues Packages Projects Releases Wiki Activity

Add comment about the reshape operation from the training_step function

Browse Source
This commit is contained in:
Aurélien Geron
2020-03-12 22:51:36 +13:00
parent 49715d4b74
commit cd4e2e1313
1 changed files with 3 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
18_reinforcement_learning.ipynb
View File

@@ -1376,7 +1376,9 @@
"cell_type": "markdown", "cell_type": "markdown",
"metadata": {}, "metadata": {},
"source": [ "source": [
"Lastly, let's create a function that will sample some experiences from the replay memory and perform a training step:" "Lastly, let's create a function that will sample some experiences from the replay memory and perform a training step:\n",
"\n",
"**Note**: the first 3 releases of the 2nd edition were missing the `reshape()` operation which converts `target_Q_values` to a column vector (this is required by the `loss_fn()`)."
] ]
}, },
{ {