1. Homepage
  2. Programming
  3. 6CCS3AIN Artificial Intelligence Reasoning and Decision Making - Coursework: Packman

6CCS3AIN Artificial Intelligence Reasoning and Decision Making - Coursework: Packman

Engage in a Conversation
KCL6CCS3AINArtificial Intelligence Reasoning and Decision MakingPackmanMDP-solverPython

1 Introduction CourseNana.COM

6CCS3AIN CourseNana.COM

Coursework CourseNana.COM

This coursework exercise asks you to write code to create an MDP-solver to work in the Pacman environment that we used for the practical exercises. CourseNana.COM

Read all these instructions before starting. This exercise will be assessed. CourseNana.COM

2 Getting started CourseNana.COM

You should download the file pacman-cw.zip from KEATS. This contains a familiar set of files that implement Pacman, and version 6 of api.py which defines the observability of the environment that you will have to deal with, and the same non-deterministic motion model that the practicals used. CourseNana.COM

Version 6 of api.py, further extends what Pacman can know about the world. In addition to knowing the location of all the objects in the world (walls, food, capsules, ghosts), Pacman can now see what state the ghosts are in, and so can decide whether they have to be avoided or not. CourseNana.COM

3 What you need to do 3.1 Write code CourseNana.COM

This coursework requires you to write code to control Pacman and win games using an MDP-solver. For each move, you will need to have the model of Pacman’s world, which consists of all the elements of a Markov Decision Process, namely: CourseNana.COM

A finite set of states S;
A finite set of actions A;
A state-transition function P (s|s, a); A reward function R;
A discount factor γ [0, 1]; CourseNana.COM

Following this you can then compute the action to take, either via Value Iteration, Policy Iteration or Modified Policy Iteration. It is expected that you will correctly implement such a solver and optimize the choice of the parameters. There is a (rather familiar) skeleton piece of code to take as your starting point in the file mdpAgents.py. This code defines the class MDPAgent. CourseNana.COM

There are two main aims for your code: CourseNana.COM

(a) Win hard in smallGrid
(b) Win hard in mediumClassic CourseNana.COM

To win games, Pacman has to be able to eat all the food. In this coursework, for these objectives, “winning” just means getting the environment to report a win. Score is irrelevant. CourseNana.COM

3.1.1 Getting Excellence points CourseNana.COM

There is a difference between winning a lot and winning well. This is why completing aim (a) and (b) from previous section allows you to collect up to 80 points in the Coursework. The remaining 20 points are obtained by having a high Excellence Score Difference in the mediumClassic layout, a metric that directly comes from having a high average winning score. This can be done through different strategies, for example through chasing eatable ghosts. CourseNana.COM

A couple of things to be noted. Let W be the set of games won, i.e., |W | ∈ [0, 25]. For any won game i W define sw(i) to be the score obtained in game/run i. CourseNana.COM

  • Se in the marksheet is the Excellence Score Difference. You can use the following formula to calculate it when you test your code and compare the result against the values in Table 3 CourseNana.COM

    Se = X(sw(i) 1500) (1) iW CourseNana.COM

    Losses count as 0 score and are not considered. If Se < 0, we set it to 0 (you cannot have a negative excellence score difference). CourseNana.COM

  • Because smallGrid does not have room for score improvement, we will only look at the mediumClassic layout CourseNana.COM

  • Note however that marking points are assigned such that it is not convenient for you to directly aim for a higher average winning score without securing previous sections’s aims (a) and (b) first
    CourseNana.COM

  • We will use the same runs in mediumClassic to derive the marks for Table 2 and Table 3. CourseNana.COM

3.2 Things to bear in mind CourseNana.COM

Some things that you may find helpful: CourseNana.COM

  1. (a)  We will evaluate whether your code can win games in smallGrid by running: python pacman.py -q -n 25 -p MDPAgent -l smallGrid CourseNana.COM

    -l is shorthand for -layout. -p is shorthand for -pacman. -q runs the game without the interface (making it faster). CourseNana.COM

  2. (b)  We will evaluate whether your code can win games in mediumClassic by running: python pacman.py -q -n 25 -p MDPAgent -l mediumClassic
    The -n 25 runs 25 games in a row. CourseNana.COM

(c) The time limit for evlauation is 25 minute for mediumClassic and 5 minutes for small grid. It will run on a high performance computer with 26 cores and 192 Gb of RAM. The time constraints are chosen after repeated practical experience and reflect a fair time bound. CourseNana.COM

  1. (d)  When using the -n option to run multiple games, the same agent (the same instance of MDPAgent.py) is run in all the games. CourseNana.COM

    That means you might need to change the values of some of the state variables that control Pacman’s behaviour in between games. You can do that using the final() function. CourseNana.COM

  2. (e)  There is no requirement to use any of the methods described in the practicals, though you can use these if you wish. CourseNana.COM

  3. (f)  If you wish to use the map code I provided in MapAgent, you may do this, but you need to include comments that explain what you used and where it came from (just as you would for any code that you make use of but don’t write yourself). CourseNana.COM

  4. (g)  You can only use libraries that are part of a the standard Python 2.7 distribution. This ensures that (a) everyone has access to the same libraries (since only the standard distribution is available on the lab machines) and (b) we don’t have trouble running your code due to some library incompatibilities. CourseNana.COM

  5. (h)  You should comment your code and have a consistent style all over the file. CourseNana.COM

3.3 Limitations CourseNana.COM

There are some limitations on what you can submit. CourseNana.COM

  1. (a)  Your code must be in Python 2.7. Code written in a language other than Python will not be marked. CourseNana.COM

    Code written in Python 3.X is unlikely to run with the clean copy of pacman-cw that we will test it against. If is doesn’t run, you will lose marks. CourseNana.COM

    (b)  Your code must only interact with the Pacman environment by making calls through func- tions in Version 6 of api.py. Code that finds other ways to access information about the environment will lose marks.
    CourseNana.COM

  2. The idea here is to have everyone solve the same task, and have that task explore issues with non-deterministic actions. CourseNana.COM

  3. (c)  You are not allowed to modify any of the files in pacman-cw.zip except mdpAgents.py. CourseNana.COM

    Similar to the previous point, the idea is that everyone solves the same problem — you can’t change the problem by modifying the base code that runs the Pacman environment. Therefore, you are not allowed to modify the api.py file. CourseNana.COM

  4. (d)  You are not allowed to copy, without credit, code that you might get from other students or find lying around on the Internet. We will be checking. CourseNana.COM

    This is the usual plagiarism statement. When you submit work to be marked, you should only seek to get credit for work you have done yourself. When the work you are submitting is code, CourseNana.COM

(e) (f) (g) CourseNana.COM

you can use code that other people wrote, but you have to say clearly that the other person wrote it — you do that by putting in a comment that says who wrote it. That way we can adjust your mark to take account of the work that you didn’t do. CourseNana.COM

Your code must be based on solving the Pacman environment as an MDP. If you don’t submit a program that contains a recognisable MDP solver, you will lose marks. CourseNana.COM

The only MDP solvers we will allow are the ones presented in the lecture, i.e., Value iteration, Policy iteration and Modified policy iteration. In particular, Q-Learning is unacceptable. CourseNana.COM

Your code must only use the results of the MDP solver to decide what to do. If you submit code which makes decisions about what to do that uses other information in addition to what the MDP-solver generates (like ad-hoc ghost avoiding code, for example), you will lose marks. CourseNana.COM

This is to ensure that your MDP-solver is the thing that can win enough games to pass the functionality test. CourseNana.COM

What you have to hand in CourseNana.COM

Your submission should consist of a single ZIP file. (KEATS will be configured to only accept a single file.) This ZIP file must include a single Python .py file (your code). CourseNana.COM

The ZIP file must be named: CourseNana.COM

cw <lastname> <firstname>.zip
so my ZIP file would be named cw mallmann-trenn frederik.zip.
Remember that we are going to evaluate your code by running your code by using variations on
CourseNana.COM

     python pacman.py -p MDPAgent

(see Section 5 for the exact commands we will use) and we will do this in a vanilla copy of the pacman-cw folder, so the base class for your MDP-solving agent must be called MDPAgent. CourseNana.COM

To streamline the marking of the coursework, you must put all your code in one file, and this file must be called mdpAgents.py, CourseNana.COM

Do not just include the whole pacman-cw folder. You should only include the one file that includes the code you have written. CourseNana.COM

Submissions that do not follow these instructions will lose marks. That includes submissions which are RAR files. RAR is not ZIP. CourseNana.COM

5 How your work will be marked CourseNana.COM

See cw-marksheet.pdf for more information about the marking. There will be six components of the mark for your work: CourseNana.COM

(a) Functionality CourseNana.COM

We will test your code by running your .py file against a clean copy of pacman-cw. CourseNana.COM

Since we have a lot of coursework to mark, we will limit how long your code has to demonstrate that it can win. We will terminate the run of the 25smallGrid games after 5 minutes, and will terminate the run of the 25 mediumClassic games after 25 minutes. If your code has failed to win enough games within these times, we will mark it as if it lost. Note that we will use the -q command, which runs Pacman without the interface, to speed things up.
CourseNana.COM

Code not written in Python will not be marked. CourseNana.COM

  1. (b)  Style There are no particular requirements on the way that your code is structured, but it should follow standard good practice in software development and will be marked accordingly. CourseNana.COM

    Remember that your code is only allowed to interact with the Pacman environment through version 6 of api.py. Code that does not follow this rule will lose marks. CourseNana.COM

  2. (c)  Documentation CourseNana.COM

    All good code is well documented, and your work will be partly assessed by the comments you provide in your code. If we cannot understand from the comments what your code does, then you will lose marks. At the same time, comments are not intended to be paragraph-long, but brief sentences. Good code should explain itself for the most part. CourseNana.COM

A copy of the marksheet, which shows the distribution of marks across the different elements of the coursework, will be available from KEATS. CourseNana.COM

Get in Touch with Our Experts

QQ QQ
Wechat WeChat
Whatsapp Whatsapp
KCL代写,6CCS3AIN代写,Artificial Intelligence Reasoning and Decision Making代写,Packman代写,MDP-solver代写,Python代写,KCL代编,6CCS3AIN代编,Artificial Intelligence Reasoning and Decision Making代编,Packman代编,MDP-solver代编,Python代编,KCL代考,6CCS3AIN代考,Artificial Intelligence Reasoning and Decision Making代考,Packman代考,MDP-solver代考,Python代考,KCLhelp,6CCS3AINhelp,Artificial Intelligence Reasoning and Decision Makinghelp,Packmanhelp,MDP-solverhelp,Pythonhelp,KCL作业代写,6CCS3AIN作业代写,Artificial Intelligence Reasoning and Decision Making作业代写,Packman作业代写,MDP-solver作业代写,Python作业代写,KCL编程代写,6CCS3AIN编程代写,Artificial Intelligence Reasoning and Decision Making编程代写,Packman编程代写,MDP-solver编程代写,Python编程代写,KCLprogramming help,6CCS3AINprogramming help,Artificial Intelligence Reasoning and Decision Makingprogramming help,Packmanprogramming help,MDP-solverprogramming help,Pythonprogramming help,KCLassignment help,6CCS3AINassignment help,Artificial Intelligence Reasoning and Decision Makingassignment help,Packmanassignment help,MDP-solverassignment help,Pythonassignment help,KCLsolution,6CCS3AINsolution,Artificial Intelligence Reasoning and Decision Makingsolution,Packmansolution,MDP-solversolution,Pythonsolution,