6969 lines
553 KiB
Plaintext
6969 lines
553 KiB
Plaintext
%PDF-1.5
|
||||
|
|
%ÐÔÅØ
|
|||
|
|
9 0 obj
|
|||
|
|
<< /S /GoTo /D (Outline0.1) >>
|
|||
|
|
endobj
|
|||
|
|
12 0 obj
|
|||
|
|
(The simplest actor-critic \(QAC\))
|
|||
|
|
endobj
|
|||
|
|
13 0 obj
|
|||
|
|
<< /S /GoTo /D (Outline0.2) >>
|
|||
|
|
endobj
|
|||
|
|
16 0 obj
|
|||
|
|
(Advantage actor-critic \(A2C\))
|
|||
|
|
endobj
|
|||
|
|
17 0 obj
|
|||
|
|
<< /S /GoTo /D (Outline0.2.1.12) >>
|
|||
|
|
endobj
|
|||
|
|
20 0 obj
|
|||
|
|
(Baseline invariance)
|
|||
|
|
endobj
|
|||
|
|
21 0 obj
|
|||
|
|
<< /S /GoTo /D (Outline0.2.2.18) >>
|
|||
|
|
endobj
|
|||
|
|
24 0 obj
|
|||
|
|
(The algorithm of advantage actor-critic)
|
|||
|
|
endobj
|
|||
|
|
25 0 obj
|
|||
|
|
<< /S /GoTo /D (Outline0.3) >>
|
|||
|
|
endobj
|
|||
|
|
28 0 obj
|
|||
|
|
(Off-policy actor-critic)
|
|||
|
|
endobj
|
|||
|
|
29 0 obj
|
|||
|
|
<< /S /GoTo /D (Outline0.3.1.25) >>
|
|||
|
|
endobj
|
|||
|
|
32 0 obj
|
|||
|
|
(Illustrative examples)
|
|||
|
|
endobj
|
|||
|
|
33 0 obj
|
|||
|
|
<< /S /GoTo /D (Outline0.3.2.32) >>
|
|||
|
|
endobj
|
|||
|
|
36 0 obj
|
|||
|
|
(Importance sampling)
|
|||
|
|
endobj
|
|||
|
|
37 0 obj
|
|||
|
|
<< /S /GoTo /D (Outline0.3.3.37) >>
|
|||
|
|
endobj
|
|||
|
|
40 0 obj
|
|||
|
|
(The theorem of off-policy policy gradient)
|
|||
|
|
endobj
|
|||
|
|
41 0 obj
|
|||
|
|
<< /S /GoTo /D (Outline0.3.4.40) >>
|
|||
|
|
endobj
|
|||
|
|
44 0 obj
|
|||
|
|
(The algorithm of off-policy actor-critic)
|
|||
|
|
endobj
|
|||
|
|
45 0 obj
|
|||
|
|
<< /S /GoTo /D (Outline0.4) >>
|
|||
|
|
endobj
|
|||
|
|
48 0 obj
|
|||
|
|
(Deterministic actor-critic \(DPG\))
|
|||
|
|
endobj
|
|||
|
|
49 0 obj
|
|||
|
|
<< /S /GoTo /D (Outline0.4.1.47) >>
|
|||
|
|
endobj
|
|||
|
|
52 0 obj
|
|||
|
|
(The theorem of deterministic policy gradient)
|
|||
|
|
endobj
|
|||
|
|
53 0 obj
|
|||
|
|
<< /S /GoTo /D (Outline0.4.2.51) >>
|
|||
|
|
endobj
|
|||
|
|
56 0 obj
|
|||
|
|
(The algorithm of deterministic actor-critic)
|
|||
|
|
endobj
|
|||
|
|
57 0 obj
|
|||
|
|
<< /S /GoTo /D [58 0 R /Fit] >>
|
|||
|
|
endobj
|
|||
|
|
60 0 obj <<
|
|||
|
|
/Length 284
|
|||
|
|
/Filter /FlateDecode
|
|||
|
|
>>
|
|||
|
|
stream
|
|||
|
|
xÚÅ“MOÃ0†ïý>¶‡šØÎ'7@0 Á�шê:ÚªVºÿžd &6„`b HvòF±_=V<€‚I¦63†´‹q’-¢ª@,£ì‰-
|
|||
|
|
̳«í‡?Îq¡QIZ§ÿU•b¦O¡hoÁzåªö–8ý}¿_Ý.¢ß$¥ÈÚ¢%
|
|||
|
|
õãÇ™4Äë‘}Î6„ýjŸ@Ø£hd�÷ïT”EÒœ¨%»Q9®²ƒ3Š¥uêÀPÍÁjr@V¡3ªÜæM=.‡¦(…mNê°(µ˜ü¨û‚]>”'C7võëõe3¶}Q²ÏgOÅ]u¾#ùhË@À`ã�®œF-JôÑÝÊÕuÛ=/cS‘ü¦½ï7šýM>²9Yã,
|
|||
|
|
endstream
|
|||
|
|
endobj
|
|||
|
|
58 0 obj <<
|
|||
|
|
/Type /Page
|
|||
|
|
/Contents 60 0 R
|
|||
|
|
/Resources 59 0 R
|
|||
|
|
/MediaBox [0 0 362.835 272.126]
|
|||
|
|
|
|||
|
|
/Trans << /S /R >>
|
|||
|
|
/Parent 66 0 R
|
|||
|
|
>> endobj
|
|||
|
|
8 0 obj <<
|
|||
|
|
/R 22050
|
|||
|
|
/Length 8
|
|||
|
|
/Filter /FlateDecode
|
|||
|
|
>>
|
|||
|
|
stream
|
|||
|
|
xÚ |