6955 lines
718 KiB
Plaintext
6955 lines
718 KiB
Plaintext
%PDF-1.5
|
||||
|
|
%ÐÔÅØ
|
|||
|
|
9 0 obj
|
|||
|
|
<< /S /GoTo /D (Outline0.1) >>
|
|||
|
|
endobj
|
|||
|
|
12 0 obj
|
|||
|
|
(The simplest actor-critic \(QAC\))
|
|||
|
|
endobj
|
|||
|
|
13 0 obj
|
|||
|
|
<< /S /GoTo /D (Outline0.2) >>
|
|||
|
|
endobj
|
|||
|
|
16 0 obj
|
|||
|
|
(Advantage actor-critic \(A2C\))
|
|||
|
|
endobj
|
|||
|
|
17 0 obj
|
|||
|
|
<< /S /GoTo /D (Outline0.2.1.12) >>
|
|||
|
|
endobj
|
|||
|
|
20 0 obj
|
|||
|
|
(Baseline invariance)
|
|||
|
|
endobj
|
|||
|
|
21 0 obj
|
|||
|
|
<< /S /GoTo /D (Outline0.2.2.18) >>
|
|||
|
|
endobj
|
|||
|
|
24 0 obj
|
|||
|
|
(The algorithm of advantage actor-critic)
|
|||
|
|
endobj
|
|||
|
|
25 0 obj
|
|||
|
|
<< /S /GoTo /D (Outline0.3) >>
|
|||
|
|
endobj
|
|||
|
|
28 0 obj
|
|||
|
|
(Off-policy actor-critic)
|
|||
|
|
endobj
|
|||
|
|
29 0 obj
|
|||
|
|
<< /S /GoTo /D (Outline0.3.1.25) >>
|
|||
|
|
endobj
|
|||
|
|
32 0 obj
|
|||
|
|
(Illustrative examples)
|
|||
|
|
endobj
|
|||
|
|
33 0 obj
|
|||
|
|
<< /S /GoTo /D (Outline0.3.2.32) >>
|
|||
|
|
endobj
|
|||
|
|
36 0 obj
|
|||
|
|
(Importance sampling)
|
|||
|
|
endobj
|
|||
|
|
37 0 obj
|
|||
|
|
<< /S /GoTo /D (Outline0.3.3.37) >>
|
|||
|
|
endobj
|
|||
|
|
40 0 obj
|
|||
|
|
(The theorem of off-policy policy gradient)
|
|||
|
|
endobj
|
|||
|
|
41 0 obj
|
|||
|
|
<< /S /GoTo /D (Outline0.3.4.40) >>
|
|||
|
|
endobj
|
|||
|
|
44 0 obj
|
|||
|
|
(The algorithm of off-policy actor-critic)
|
|||
|
|
endobj
|
|||
|
|
45 0 obj
|
|||
|
|
<< /S /GoTo /D (Outline0.4) >>
|
|||
|
|
endobj
|
|||
|
|
48 0 obj
|
|||
|
|
(Deterministic actor-critic \(DPG\))
|
|||
|
|
endobj
|
|||
|
|
49 0 obj
|
|||
|
|
<< /S /GoTo /D (Outline0.4.1.47) >>
|
|||
|
|
endobj
|
|||
|
|
52 0 obj
|
|||
|
|
(The theorem of deterministic policy gradient)
|
|||
|
|
endobj
|
|||
|
|
53 0 obj
|
|||
|
|
<< /S /GoTo /D (Outline0.4.2.51) >>
|
|||
|
|
endobj
|
|||
|
|
56 0 obj
|
|||
|
|
(The algorithm of deterministic actor-critic)
|
|||
|
|
endobj
|
|||
|
|
57 0 obj
|
|||
|
|
<< /S /GoTo /D [58 0 R /Fit] >>
|
|||
|
|
endobj
|
|||
|
|
60 0 obj <<
|
|||
|
|
/Length 284
|
|||
|
|
/Filter /FlateDecode
|
|||
|
|
>>
|
|||
|
|
stream
|
|||
|
|
xÚÅ“ÁNÃ0†ï}
|
|||
|
|
ÛCCìÄiÂ
|
|||
|
|
LBp`ô4ÄuíU+Ý�·ÇaH+B01P$Ûù£$>+AÃ,Ñ»Y…XIœ%kQ5GÊ*H!9èkX%7Ó�?Î2k}”Æéü¿NEÉø)ëá=8¯‹ðvöDœÿ¾ß¯V×â7J1’uÊ¡…êécÏX1ÒØ²ïÀ™B8L£ „¼2Ö²UìG*Ú)´d„ŠÛ�Êi™]`(_D„r%%+ @g¶P.á.½ª«aÓ×YnŒIQg¹µœžTC—‘Oûü¬o‡¶Ú._×CÓe¹èËç쾼ܽøràUpÎF[ñíÄ�R¦ð[W·Mû²‘K-¥‹æ¡Û¹ìoòy™¼‡ãR
|
|||
|
|
endstream
|
|||
|
|
endobj
|
|||
|
|
58 0 obj <<
|
|||
|
|
/Type /Page
|
|||
|
|
/Contents 60 0 R
|
|||
|
|
/Resources 59 0 R
|
|||
|
|
/MediaBox [0 0 362.835 272.126]
|
|||
|
|
|
|||
|
|
/Trans << /S /R >>
|
|||
|
|
/Parent 66 0 R
|
|||
|
|
>> endobj
|
|||
|
|
8 0 obj <<
|
|||
|
|
/R 22050
|
|||
|
|
/Length 8
|
|||
|
|
/Filter /FlateDecode
|
|||
|
|
>>
|
|||
|
|
stream
|
|||
|
|
xÚ |