Towards a 3D BabyAI-like environment, starting with PickUp#89
Towards a 3D BabyAI-like environment, starting with PickUp#89Near32 wants to merge 17 commits intoFarama-Foundation:masterfrom
Conversation
… Pickup environment in 3D.
pseudo-rnd-thoughts
left a comment
pseudo-rnd-thoughts
left a comment
There was a problem hiding this comment.
Hey, this looks really cool.
Do you have any training performance with the environment? Could you add some rendered images of the environment to understand what the world looks like
|
I have not yet run any training on the environment, so no training performance to show yet. Here is a screenshot of the environment when using the manual_control.py script (with the mission/instruction being printed out in the terminal stdout) : |
|
Hello, Still new to all of this, thus, may I inquire what would remains for me to do to make this pull request progress, please ? |
Hi, sorry, we have been a bit slow |
|
@Near32 Hey, have you had time to do any training on the environment yet? |
change size: obs_size=(64,64) window_size=(640,640) add new maps: MazeS4 ~ MazeS7
- window_width/height of rendering: 640 -> 128 - forward_step: 1.2 -> 0.4 - fixed agent's initial direction
2 participants
Description
Following the same motivations as the BabyAI benchmark, this pull request aims to emulate the BabyAI's Pickup environment, but this time using a 3D environment.
Why is it important to propose a 3D BabyAI-like environment?
[Hill et al., 2020]'s work identified the egocentric viewpoint within a 3D environment as an important factor impacting trained agent's systematicity (cf. Section 4.3 and 4.4).
Given that the BabyAI benchmark is a prominent systematicity benchmark, it would be interesting to be able to verify that insight in an apple-to-apple comparison, whcih was not possible until now since there exists no environment like a 3D BabyAI.
This pull request proposes to start to fix that gap.
Dependencies have not changed.
Type of change
Please delete options that are not relevant.
Screenshots
Please attach before and after screenshots of the change if applicable.
Checklist:
pre-commitchecks withpre-commit run --all-files(seeCONTRIBUTING.mdinstructions to set it up)