1. Homepage
  2. Programming
  3. SOFT3202: Software Construction and Design 2 Assignment: Test and Monitor Software Development

SOFT3202: Software Construction and Design 2 Assignment: Test and Monitor Software Development

Engage in a Conversation
SydneyCOMP9202Software Construction and Design 2PythonCoverage TestingWhite-box TestingFuzzerGrammar-Based Fuzzing

SOFT3202/COMP9202 Assignment Software Construction and Design 2 CourseNana.COM

Task Description CourseNana.COM

Software development relies heavily on testing and monitoring to ensure the quality, reliability and performance of the software in production. In this assignment, you will develop a series of tools that can be used to test and monitor software during the software development pipeline. CourseNana.COM

Assignment Breakdown CourseNana.COM

The requirements for completing this assignment are dependent on the course you are taking. The assignment is due on the 12th of May, 2024. CourseNana.COM

SOFT3202: CourseNana.COM

Students taking SOFT3202 must complete the following sections to attain the correspond- ing marks: CourseNana.COM

Part 1 (15%) CourseNana.COM

Select one of: CourseNana.COM

Part 2
Part 3
(15%) CourseNana.COM

Note: Students may not combine marks from Parts 2 and 3. You will only receive marks for the higher scoring of either implementation. CourseNana.COM

COMP9202: CourseNana.COM

Students taking COMP9202 must complete the following sections to attain the correspond- ing marks: CourseNana.COM

Part 1 Part 2 Part 3 CourseNana.COM

(10%) (10%) (10%) CourseNana.COM

Example Submissions SOFT3202 CourseNana.COM

Examples for SOFT3202 CourseNana.COM

• Example 1:
Part 1: 5 marks Part 2: 15 marks Total marks: 20 CourseNana.COM

• Example 2:
Part 1: 7 marks Part 3: 18 marks Total marks: 25 CourseNana.COM

• Example 3:
Part 1: 6 marks Part 2: 15 marks Part 3: 18 marks Total marks: 24 CourseNana.COM

COMP9202 CourseNana.COM

Examples for COMP9202 CourseNana.COM

• Example 1: Part 1: 7 marks CourseNana.COM

Part 2: 8 marks Total marks: 15 CourseNana.COM

• Example 2:
Part 1: 8 marks Part 2: 7 marks Part 3: 9 marks Total marks: 24 CourseNana.COM

Part 1: Coverage Introduction CourseNana.COM

This component requires the development of a comprehensive tool to analyse a provided test suite for a piece of software. The analysis must cover two key white-box testing metrics: statement coverage and branch coverage. The aim is to assess the efficacy and thoroughness of the test suite in detecting faults and ensuring robustness in the software. CourseNana.COM

Objectives CourseNana.COM

  • Implement a tool that takes a series of given test inputs and runs them on a program. CourseNana.COM

  • Report the statement coverage and branch coverage for the program when run using the series CourseNana.COM

    of test inputs. CourseNana.COM

    Requirements
    1. Statement Coverage CourseNana.COM

    Objective: Determine the percentage of executable statements in the software that are executed by the test cases in the test suite. CourseNana.COM

    2. Branch Coverage
    Objective:
    Identify and report the number of branches through the program’s control flow graph that CourseNana.COM

    are covered by the test suite. CourseNana.COM

    Input Specifications CourseNana.COM

    Your program should take 2 command-line arguments:
    1. The path to a Python script
    2. The path to a directory containing a set of input (
    .in) files CourseNana.COM

    It should be called using the following command: CourseNana.COM

    python coverage.py <python_program> <input_file_dir>
    

    Output Specifications CourseNana.COM

    Your program should produce output indicating: CourseNana.COM

  1. 1  Statement Coverage: The count of statements executed during testing. CourseNana.COM

  2. 2  Branch Coverage: The count of branches executed during testing. CourseNana.COM

For example: CourseNana.COM

  1. 1  Statement Coverage: 50% CourseNana.COM

  2. 2  Branch Coverage: 50% CourseNana.COM

Part 2: Fuzzing with Mutated Inputs Introduction CourseNana.COM

In this part of the assignment, you will develop a fuzzer designed to automate the generation and mutation of test inputs to maximise the branch coverage of a test suite. The primary goal is to expand the test coverage by identifying and adding inputs that expose new branches in the software under test. CourseNana.COM

Objectives CourseNana.COM

• Develop a fuzzer capable of generating and mutating test inputs.
• Implement a method to measure the increase in branch coverage.
• Automate the process of enhancing the test suite with inputs that increase branch coverage.
CourseNana.COM

Requirements CourseNana.COM

This task requires you to take a program along with a series of inputs and mutate the inputs to achieve a minimum branch coverage (note that in Part I we ask for statement coverage and branch coverage). You must automatically improve the test suite by adding mutated inputs that increase the branch coverage. CourseNana.COM

Implementation Specifications CourseNana.COM

  • Use the fuzzer to apply mutations to the initial set of inputs. CourseNana.COM

  • For each mutated input, execute the test suite to determine if the mutation results in increased CourseNana.COM

    branch coverage. CourseNana.COM

  • If an input increases branch coverage (by reaching new conditions not previously tested), add CourseNana.COM

    it to a ’population’ of effective test inputs. CourseNana.COM

  • Continuethisprocessuntilnofurtherincreaseinbranchcoverageisobserved,aimingtoachieve CourseNana.COM

    the largest possible branch coverage. CourseNana.COM

  • Write the final set of test inputs that collectively provide the highest branch coverage observed CourseNana.COM

    to a file. CourseNana.COM

    Input Specifications CourseNana.COM

    Your program should take 2 command-line arguments: 1. The path to a Python script
    2. The path to a single text (
    .in) file CourseNana.COM

    It should be called using the following command: CourseNana.COM

    python mutation_fuzzer.py <python_program> <input_file>
    

    The text file will contain a set of inputs, each on a new line. For example: CourseNana.COM

  1. 1  Never CourseNana.COM

  2. 2  Gonna CourseNana.COM

  3. 3  Give CourseNana.COM

  4. 4  You CourseNana.COM

  5. 5  Up CourseNana.COM

Output Specifications CourseNana.COM

Your program should write back to the provided input (.in) file with exactly the same number of input strings as was provided initially. CourseNana.COM

For example: CourseNana.COM

  1. 1  Never CourseNana.COM

  2. 2  Gonna CourseNana.COM

  3. 3  Let CourseNana.COM

  4. 4  You CourseNana.COM

  5. 5  Down CourseNana.COM

Part 3: Grammar-Based Fuzzing Introduction CourseNana.COM

Grammar-based fuzzing is a commonly used method to test programs that consume structured inputs, particularly input parsers. CourseNana.COM

Objectives CourseNana.COM

• Implement a grammar-based fuzzer to generate structured inputs for testing.
• Explore various grammar structures to hit or exceed a branch coverage threshold specified.
CourseNana.COM

Requirements CourseNana.COM

This task requires implementing a grammar-based fuzzer capable of generating structured inputs based on a specified grammar. The goal is to hit or exceed a branch coverage threshold by gener- ating a test suite that effectively tests the target program. CourseNana.COM

Implementation Specifications CourseNana.COM

  • Develop algorithms to interpret grammar specifications and generate inputs accordingly. CourseNana.COM

  • Explore different paths and options within the grammar to maximise the branch coverage. CourseNana.COM

  • Test the generated inputs on the target program to assess its branch coverage. CourseNana.COM

  • Implement mechanisms to adjust the generation process to hit or exceed the input and code CourseNana.COM

    coverage threshold. CourseNana.COM

    Input Specifications CourseNana.COM

    Your program should take 3 command-line arguments: CourseNana.COM

  1. The path to a Python script CourseNana.COM

  2. ThepathtoasinglePython(.py)scriptcontainingthegrammarspecificationsusingthesyntax taught in the lectures and tutorials; the grammar will be stored as the variable ’grammar’ CourseNana.COM

  3. The number of strings your program should generate for the test suite CourseNana.COM

It should be called using the following command:
python grammar_fuzzer.py <python_program> <grammar_file> <num_strings> CourseNana.COM

Output Specifications CourseNana.COM

The program should generate structured inputs based on the grammar specifications provided and write them to an output file. The output file should contain the specified number of strings each on a new line, where each string represents a test input. The generated inputs should cover various paths and options within the grammar, aiming to hit or exceed the branch coverage threshold defined for the target program. CourseNana.COM

For example, if the desired number of strings is 100: CourseNana.COM

  1. 1  input_1 CourseNana.COM

  2. 2  input_2 CourseNana.COM

  3. 3  ... CourseNana.COM

  4. 4  input_100 CourseNana.COM

Make sure that the generated inputs cover as many grammar rules and options as possible to effectively test the target program and meet the input and code coverage threshold. CourseNana.COM

Getting Started CourseNana.COM

Review Tutorials and Lectures: Begin by reviewing the tutorials and lectures. Remember that everything you need for each component has already been covered in this unit. CourseNana.COM

Understand the Fundamentals: Go through the revision slides on Ed and make sure that you understand all of the content covered so far. CourseNana.COM

Ask Questions: If you have any questions or uncertainties about the material covered, don’t hesitate to ask on Ed for clarification and a TA will get back to you shortly. CourseNana.COM

Frequently Asked Questions CourseNana.COM

  • Hard coding will result in a 0 for all tasks. CourseNana.COM

  • No external libraries (i.e. those installed using pip or another package manager) may be CourseNana.COM

    used - this is a limitation of Edstem. CourseNana.COM

  • You have unlimited attempts before the deadline. CourseNana.COM

  • There are public, private and hidden test cases for all tasks. CourseNana.COM

  • Test cases will gradually be released over the coming days, and you should check Ed for CourseNana.COM

    announcements. CourseNana.COM

  • You may reuse their code from Quiz 1 and any other task from this unit. CourseNana.COM

  • All code, even your own, must be referenced as per the university’s policy. CourseNana.COM

  • You may structure your program as you wish as long as it is written in Python and gets CourseNana.COM

    called using the described commands. CourseNana.COM

CourseNana.COM

Academic Declaration CourseNana.COM

By submitting this assignment, you declare the following: CourseNana.COM

I declare that I have read and understood the University of Sydney Student Plagiarism: Coursework Policy and Procedure, and except where specifically acknowledged, the work contained in this as- signment/project is my own work, and has not been copied from other sources or been previously submitted for award or assessment. CourseNana.COM

I understand that failure to comply with the Student Plagiarism: Coursework Policy and Procedure can lead to severe penalties as outlined under Chapter 8 of the University of Sydney By-Law 1999 (as amended). These penalties may be imposed in cases where any significant portion of my submit- ted work has been copied without proper acknowledgement from other sources, including published works, the Internet, existing programs, the work of other students, or work previously submitted for other awards or assessments. CourseNana.COM

I realise that I may be asked to identify those portions of the work contributed by me and required to demonstrate my knowledge of the relevant material by answering oral questions or by undertaking supplementary work, either written or in the laboratory, in order to arrive at the final assessment mark. CourseNana.COM

I acknowledge that the School of Computer Science, in assessing this assignment, may reproduce it entirely, may provide a copy to another member of faculty, and/or communicate a copy of this assignment to a plagiarism checking service or in-house computer program, and that a copy of the assignment may be maintained by the service or the School of Computer Science for the purpose of future plagiarism checking. CourseNana.COM

Page 7  CourseNana.COM

Get in Touch with Our Experts

WeChat (微信) WeChat (微信)
Whatsapp WhatsApp
Sydney代写,COMP9202代写,Software Construction and Design 2代写,Python代写,Coverage Testing代写,White-box Testing代写,Fuzzer代写,Grammar-Based Fuzzing代写,Sydney代编,COMP9202代编,Software Construction and Design 2代编,Python代编,Coverage Testing代编,White-box Testing代编,Fuzzer代编,Grammar-Based Fuzzing代编,Sydney代考,COMP9202代考,Software Construction and Design 2代考,Python代考,Coverage Testing代考,White-box Testing代考,Fuzzer代考,Grammar-Based Fuzzing代考,Sydneyhelp,COMP9202help,Software Construction and Design 2help,Pythonhelp,Coverage Testinghelp,White-box Testinghelp,Fuzzerhelp,Grammar-Based Fuzzinghelp,Sydney作业代写,COMP9202作业代写,Software Construction and Design 2作业代写,Python作业代写,Coverage Testing作业代写,White-box Testing作业代写,Fuzzer作业代写,Grammar-Based Fuzzing作业代写,Sydney编程代写,COMP9202编程代写,Software Construction and Design 2编程代写,Python编程代写,Coverage Testing编程代写,White-box Testing编程代写,Fuzzer编程代写,Grammar-Based Fuzzing编程代写,Sydneyprogramming help,COMP9202programming help,Software Construction and Design 2programming help,Pythonprogramming help,Coverage Testingprogramming help,White-box Testingprogramming help,Fuzzerprogramming help,Grammar-Based Fuzzingprogramming help,Sydneyassignment help,COMP9202assignment help,Software Construction and Design 2assignment help,Pythonassignment help,Coverage Testingassignment help,White-box Testingassignment help,Fuzzerassignment help,Grammar-Based Fuzzingassignment help,Sydneysolution,COMP9202solution,Software Construction and Design 2solution,Pythonsolution,Coverage Testingsolution,White-box Testingsolution,Fuzzersolution,Grammar-Based Fuzzingsolution,