Skip to content

(To be discussed) (Idea) feature: multi dimensional reward#225

Open
YuriCat wants to merge 13 commits intoDeNA:developfrom
YuriCat:feature/multi_dimensional_reward
Open

(To be discussed) (Idea) feature: multi dimensional reward#225
YuriCat wants to merge 13 commits intoDeNA:developfrom
YuriCat:feature/multi_dimensional_reward

Conversation

@YuriCat
Copy link
Copy Markdown
Contributor

@YuriCat YuriCat commented Nov 18, 2021

Do we delete OUTCOME, or use OUTCOME as the first dimension of REWARD if it is defined?

@ikki407
Copy link
Copy Markdown
Member

ikki407 commented Nov 22, 2021

My first impression was that this change could be closer to the implementation of general reinforcement learning. Also, it can be a simple code 👍
However, I think a user must pay attention to the first dimension of multi-reward is the outcome. How can we set gamma
in games with no outcome? like gamma: [1, 0.99]?

@YuriCat
Copy link
Copy Markdown
Contributor Author

YuriCat commented Nov 22, 2021

Yes, gamm: [1, 0.99] will work.
Warnings for over length need to be added.

losses['ent'] = entropy.sum()

base_loss = losses['p'] + losses.get('r', 0)
base_loss = losses['p'] + losses.get('v', 0)
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

wow, thank you

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants