Problem 44521. Make your own Test Suite (part 3)

Created by David Verrelli

Solve Later

{"relationships":[{"relationshipType":"http://schemas.mathworks.com/matlab/code/2013/relationships/document","targetMode":"","relationshipId":"rId1","target":"/matlab/document.xml"},{"relationshipType":"http://schemas.mathworks.com/matlab/code/2013/relationships/output","targetMode":"","relationshipId":"rId2","target":"/matlab/output.xml"}],"parts":[{"partUri":"/matlab/document.xml","relationship":[],"contentType":"application/vnd.mathworks.matlab.code.document+xml","content":"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<w:document xmlns:w=\"http://schemas.openxmlformats.org/wordprocessingml/2006/main\"><w:body><w:p><w:pPr><w:pStyle w:val=\"text\"/></w:pPr><w:r><w:t>In this task you need to imagine that you —</w:t></w:r><w:r><w:t> </w:t></w:r><w:r><w:rPr><w:i/></w:rPr><w:t>yes, YOU</w:t></w:r><w:r><w:t> — have developed a problem on Cody for</w:t></w:r><w:r><w:t> </w:t></w:r><w:r><w:rPr><w:i/></w:rPr><w:t>me</w:t></w:r><w:r><w:t> to solve, and now</w:t></w:r><w:r><w:t> </w:t></w:r><w:r><w:rPr><w:b/></w:rPr><w:t>you need to implement a robust Test Suite</w:t></w:r><w:r><w:t> to check whether</w:t></w:r><w:r><w:t> </w:t></w:r><w:r><w:rPr><w:i/></w:rPr><w:t>my</w:t></w:r><w:r><w:t> submitted solutions meet</w:t></w:r><w:r><w:t> </w:t></w:r><w:r><w:rPr><w:i/></w:rPr><w:t>your</w:t></w:r><w:r><w:t> requirements or not, and to be fairly assured that I am not trying to 'game' the system.</w:t></w:r></w:p><w:p><w:pPr><w:pStyle w:val=\"text\"/></w:pPr><w:r><w:t>So the tables are turned! You are now in the role of Tester! I am in the role of Player!</w:t></w:r></w:p><w:p><w:pPr><w:pStyle w:val=\"text\"/></w:pPr><w:r><w:t>The problem you've set me is to:</w:t></w:r></w:p><w:p><w:pPr><w:pStyle w:val=\"ListParagraph\"/><w:numPr><w:numId w:val=\"1\"/></w:numPr></w:pPr><w:r><w:t>output the</w:t></w:r><w:r><w:t> </w:t></w:r><w:r><w:rPr><w:b/></w:rPr><w:t>sine</w:t></w:r><w:r><w:t> of an angle, when the angle is specified in degrees as a (scalar)</w:t></w:r><w:r><w:t> </w:t></w:r><w:hyperlink w:docLocation=\"https://au.mathworks.com/help/matlab/ref/double.html\"><w:r><w:rPr><w:rFonts w:cs=\"monospace\"/></w:rPr><w:t>double</w:t></w:r></w:hyperlink><w:r><w:t>, with no restriction in the domain,</w:t></w:r></w:p><w:p><w:pPr><w:pStyle w:val=\"ListParagraph\"/><w:numPr><w:numId w:val=\"1\"/></w:numPr></w:pPr><w:r><w:rPr><w:b/></w:rPr><w:t>without</w:t></w:r><w:r><w:t> using</w:t></w:r><w:r><w:t> </w:t></w:r><w:r><w:rPr><w:rFonts w:cs=\"monospace\"/></w:rPr><w:t>regexp</w:t></w:r><w:r><w:t> or</w:t></w:r><w:r><w:t> </w:t></w:r><w:r><w:rPr><w:rFonts w:cs=\"monospace\"/></w:rPr><w:t>regexpi</w:t></w:r><w:r><w:t> or</w:t></w:r><w:r><w:t> </w:t></w:r><w:r><w:rPr><w:rFonts w:cs=\"monospace\"/></w:rPr><w:t>ans</w:t></w:r><w:r><w:t>,</w:t></w:r></w:p><w:p><w:pPr><w:pStyle w:val=\"ListParagraph\"/><w:numPr><w:numId w:val=\"1\"/></w:numPr></w:pPr><w:r><w:rPr><w:b/></w:rPr><w:t>within</w:t></w:r><w:r><w:t> less than 0.01 seconds (10 milliseconds).</w:t></w:r></w:p><w:p><w:pPr><w:pStyle w:val=\"text\"/></w:pPr><w:r><w:t>You provide me with the following example for the function defined as</w:t></w:r><w:r><w:t> </w:t></w:r><w:r><w:rPr><w:rFonts w:cs=\"monospace\"/></w:rPr><w:t>s = SINE(a)</w:t></w:r><w:r><w:t>:</w:t></w:r></w:p><w:p><w:pPr><w:pStyle w:val=\"code\"/></w:pPr><w:r><w:t><![CDATA[ % INPUT\n a = 45 % degrees\n % OUTPUT\n s = 1/sqrt(2)]]></w:t></w:r></w:p><w:p><w:pPr><w:pStyle w:val=\"text\"/></w:pPr><w:r><w:t>Now I have responded by submitting a large number of purported 'solutions', some of which are</w:t></w:r><w:r><w:t> </w:t></w:r><w:r><w:rPr><w:i/></w:rPr><w:t>reasonably accurate</w:t></w:r><w:r><w:t>, and others which are either too imprecise or else logically flawed.</w:t></w:r></w:p><w:p><w:pPr><w:pStyle w:val=\"text\"/></w:pPr><w:r><w:t>Your Test Suite (contained within</w:t></w:r><w:r><w:t> </w:t></w:r><w:r><w:rPr><w:i/></w:rPr><w:t>your</w:t></w:r><w:r><w:t> function</w:t></w:r><w:r><w:t> </w:t></w:r><w:r><w:rPr><w:rFonts w:cs=\"monospace\"/></w:rPr><w:t>testSuite</w:t></w:r><w:r><w:t>) must address each of the elements of your problem specification:</w:t></w:r></w:p><w:p><w:pPr><w:pStyle w:val=\"ListParagraph\"/><w:numPr><w:numId w:val=\"2\"/></w:numPr></w:pPr><w:r><w:t>Check that my submitted code reliably returns</w:t></w:r><w:r><w:t> </w:t></w:r><w:r><w:rPr><w:b/></w:rPr><w:t>sufficiently accurate</w:t></w:r><w:r><w:t> values for sine of many different angles. Use the</w:t></w:r><w:r><w:t> </w:t></w:r><w:hyperlink w:docLocation=\"https://au.mathworks.com/help/matlab/ref/assert.html\"><w:r><w:rPr><w:rFonts w:cs=\"monospace\"/></w:rPr><w:t>assert</w:t></w:r></w:hyperlink><w:r><w:t> function.</w:t></w:r></w:p><w:p><w:pPr><w:pStyle w:val=\"ListParagraph\"/><w:numPr><w:numId w:val=\"2\"/></w:numPr></w:pPr><w:r><w:t>Ensure that the returned</w:t></w:r><w:r><w:t> </w:t></w:r><w:r><w:rPr><w:b/></w:rPr><w:t>data type</w:t></w:r><w:r><w:t> is suitable.</w:t></w:r></w:p><w:p><w:pPr><w:pStyle w:val=\"ListParagraph\"/><w:numPr><w:numId w:val=\"2\"/></w:numPr></w:pPr><w:r><w:t>You</w:t></w:r><w:r><w:t> </w:t></w:r><w:r><w:rPr><w:b/></w:rPr><w:t>cannot</w:t></w:r><w:r><w:t> use (or mention) the functions</w:t></w:r><w:r><w:t> </w:t></w:r><w:r><w:rPr><w:rFonts w:cs=\"monospace\"/></w:rPr><w:t>sind</w:t></w:r><w:r><w:t>,</w:t></w:r><w:r><w:t> </w:t></w:r><w:r><w:rPr><w:rFonts w:cs=\"monospace\"/></w:rPr><w:t>sin</w:t></w:r><w:r><w:t>,</w:t></w:r><w:r><w:t> </w:t></w:r><w:r><w:rPr><w:rFonts w:cs=\"monospace\"/></w:rPr><w:t>cscd</w:t></w:r><w:r><w:t> or</w:t></w:r><w:r><w:t> </w:t></w:r><w:r><w:rPr><w:rFonts w:cs=\"monospace\"/></w:rPr><w:t>cosd</w:t></w:r><w:r><w:t> in your Test Suite; any other functions are allowed. [</w:t></w:r><w:r><w:t> </w:t></w:r><w:r><w:rPr><w:i/></w:rPr><w:t>MOTIVATION: You shouldn't be exposing an efficient way of solving the problem within your Test Suite, otherwise I can just copy and paste your solution and submit it as my own!</w:t></w:r><w:r><w:t> ]</w:t></w:r></w:p><w:p><w:pPr><w:pStyle w:val=\"ListParagraph\"/><w:numPr><w:numId w:val=\"2\"/></w:numPr></w:pPr><w:r><w:t>You must check that I</w:t></w:r><w:r><w:t> </w:t></w:r><w:r><w:rPr><w:b/></w:rPr><w:t>haven't used</w:t></w:r><w:r><w:t> \"regexp\" or \"regexpi\" or \"ans\". You could try using the</w:t></w:r><w:r><w:t> </w:t></w:r><w:hyperlink w:docLocation=\"https://au.mathworks.com/help/coursework/ug/assessfunctionabsence.html\"><w:r><w:rPr><w:rFonts w:cs=\"monospace\"/></w:rPr><w:t>assessFunctionAbsence</w:t></w:r></w:hyperlink><w:r><w:t> function in the form</w:t></w:r><w:r><w:t> </w:t></w:r><w:r><w:rPr><w:rFonts w:cs=\"monospace\"/></w:rPr><w:t>assessFunctionAbsence(..., 'FileName','SINE.m')</w:t></w:r><w:r><w:t>, or else you could try 'manually' opening the file</w:t></w:r><w:r><w:t> </w:t></w:r><w:r><w:rPr><w:rFonts w:cs=\"monospace\"/></w:rPr><w:t>SINE.m</w:t></w:r><w:r><w:t> that corresponds to my submitted solution and then parsing it for occurrence of the prohibited function/variable.</w:t></w:r></w:p><w:p><w:pPr><w:pStyle w:val=\"ListParagraph\"/><w:numPr><w:numId w:val=\"2\"/></w:numPr></w:pPr><w:r><w:t>You must check that my code returns a result within</w:t></w:r><w:r><w:t> </w:t></w:r><w:r><w:rPr><w:b/></w:rPr><w:t>less than 0.01 seconds</w:t></w:r><w:r><w:t> (for a single input of an arbitrary angle). You could use</w:t></w:r><w:r><w:t> </w:t></w:r><w:hyperlink w:docLocation=\"https://au.mathworks.com/help/matlab/ref/tic.html\"><w:r><w:rPr><w:rFonts w:cs=\"monospace\"/></w:rPr><w:t>tic</w:t></w:r></w:hyperlink><w:r><w:t> &amp;</w:t></w:r><w:r><w:t> </w:t></w:r><w:hyperlink w:docLocation=\"https://au.mathworks.com/help/matlab/ref/toc.html\"><w:r><w:rPr><w:rFonts w:cs=\"monospace\"/></w:rPr><w:t>toc</w:t></w:r></w:hyperlink><w:r><w:t> or</w:t></w:r><w:r><w:t> </w:t></w:r><w:hyperlink w:docLocation=\"https://au.mathworks.com/help/matlab/ref/timeit.html\"><w:r><w:rPr><w:rFonts w:cs=\"monospace\"/></w:rPr><w:t>timeit</w:t></w:r></w:hyperlink><w:r><w:t>, or a variety of other MATLAB functions (but not</w:t></w:r><w:r><w:t> </w:t></w:r><w:r><w:rPr><w:rFonts w:cs=\"monospace\"/></w:rPr><w:t>cputime</w:t></w:r><w:r><w:t> in this case). If your Test Suite claims that my submission runs slowly, then you must be confident that it is truly caused only by inefficiency in my submitted code,</w:t></w:r><w:r><w:t> </w:t></w:r><w:r><w:rPr><w:b/></w:rPr><w:t>not</w:t></w:r><w:r><w:t> just general/erratic overheads in 'queuing' or suchlike on the Cody servers.</w:t></w:r></w:p><w:p><w:pPr><w:pStyle w:val=\"ListParagraph\"/><w:numPr><w:numId w:val=\"2\"/></w:numPr></w:pPr><w:r><w:t>Your</w:t></w:r><w:r><w:t> </w:t></w:r><w:r><w:rPr><w:rFonts w:cs=\"monospace\"/></w:rPr><w:t>assert</w:t></w:r><w:r><w:t> (or other) function must throw</w:t></w:r><w:r><w:t> </w:t></w:r><w:hyperlink w:docLocation=\"https://www.mathworks.com/matlabcentral/cody/problems/44357\"><w:r><w:t>errors/exceptions</w:t></w:r></w:hyperlink><w:r><w:t> with the following</w:t></w:r><w:r><w:t> </w:t></w:r><w:r><w:rPr><w:b/></w:rPr><w:t></w:t></w:r><w:r><w:rPr><w:b/><w:rFonts w:cs=\"monospace\"/></w:rPr><w:t>error message</w:t></w:r><w:r><w:rPr><w:b/></w:rPr><w:t> text</w:t></w:r><w:r><w:t> contents.</w:t></w:r></w:p><w:p><w:pPr><w:pStyle w:val=\"ListParagraph\"/><w:numPr><w:numId w:val=\"1\"/></w:numPr></w:pPr><w:r><w:t>'Incorrect value' if the output is too inaccurate.</w:t></w:r></w:p><w:p><w:pPr><w:pStyle w:val=\"ListParagraph\"/><w:numPr><w:numId w:val=\"1\"/></w:numPr></w:pPr><w:r><w:t>'Incorrect data type' if the output is not appropriate.</w:t></w:r></w:p><w:p><w:pPr><w:pStyle w:val=\"ListParagraph\"/><w:numPr><w:numId w:val=\"1\"/></w:numPr></w:pPr><w:r><w:t>'Too slow' if my submitted code is too slow.</w:t></w:r></w:p><w:p><w:pPr><w:pStyle w:val=\"ListParagraph\"/><w:numPr><w:numId w:val=\"1\"/></w:numPr></w:pPr><w:r><w:t>'Banned word' if my submitted code contains the</w:t></w:r><w:r><w:t> </w:t></w:r><w:r><w:rPr><w:rFonts w:cs=\"monospace\"/></w:rPr><w:t>regexp</w:t></w:r><w:r><w:t> or</w:t></w:r><w:r><w:t> </w:t></w:r><w:r><w:rPr><w:rFonts w:cs=\"monospace\"/></w:rPr><w:t>regexpi</w:t></w:r><w:r><w:t> functions or the</w:t></w:r><w:r><w:t> </w:t></w:r><w:hyperlink w:docLocation=\"https://au.mathworks.com/help/matlab/ref/ans.html\"><w:r><w:rPr><w:rFonts w:cs=\"monospace\"/></w:rPr><w:t>ans</w:t></w:r></w:hyperlink><w:r><w:t> variable. For</w:t></w:r><w:r><w:t> </w:t></w:r><w:r><w:rPr><w:i/></w:rPr><w:t>this</w:t></w:r><w:r><w:t> infringement,</w:t></w:r><w:r><w:t> </w:t></w:r><w:r><w:rPr><w:i/></w:rPr><w:t>additional</w:t></w:r><w:r><w:t> text can</w:t></w:r><w:r><w:t> </w:t></w:r><w:r><w:rPr><w:i/></w:rPr><w:t>also</w:t></w:r><w:r><w:t> (optionally!) be present in the message — for example, 'You cannot do that! Banned word (regexp/regexpi)' would also be acceptable.</w:t></w:r></w:p><w:p><w:pPr><w:pStyle w:val=\"text\"/></w:pPr><w:r><w:t>When creating a Test Suite for a Cody problem it is a good habit to try to anticipate the tactics that diverse Players might employ!</w:t></w:r></w:p><w:p><w:pPr><w:pStyle w:val=\"text\"/></w:pPr><w:r><w:t>See also:</w:t></w:r></w:p><w:p><w:pPr><w:pStyle w:val=\"ListParagraph\"/><w:numPr><w:numId w:val=\"1\"/></w:numPr></w:pPr><w:hyperlink w:docLocation=\"https://www.mathworks.com/matlabcentral/cody/problems/44631\"><w:r><w:t>Problem 44631</w:t></w:r></w:hyperlink><w:r><w:t> (part</w:t></w:r><w:r><w:t> </w:t></w:r><w:r><w:rPr><w:b/></w:rPr><w:t>0</w:t></w:r><w:r><w:t>)</w:t></w:r></w:p><w:p><w:pPr><w:pStyle w:val=\"ListParagraph\"/><w:numPr><w:numId w:val=\"1\"/></w:numPr></w:pPr><w:hyperlink w:docLocation=\"https://www.mathworks.com/matlabcentral/cody/problems/44617\"><w:r><w:t>Problem 44617</w:t></w:r></w:hyperlink><w:r><w:t> (part</w:t></w:r><w:r><w:t> </w:t></w:r><w:r><w:rPr><w:b/></w:rPr><w:t>1</w:t></w:r><w:r><w:t>)</w:t></w:r></w:p><w:p><w:pPr><w:pStyle w:val=\"ListParagraph\"/><w:numPr><w:numId w:val=\"1\"/></w:numPr></w:pPr><w:hyperlink w:docLocation=\"https://www.mathworks.com/matlabcentral/cody/problems/44616\"><w:r><w:t>Problem 44616</w:t></w:r></w:hyperlink><w:r><w:t> (part</w:t></w:r><w:r><w:t> </w:t></w:r><w:r><w:rPr><w:b/></w:rPr><w:t>2</w:t></w:r><w:r><w:t>)</w:t></w:r></w:p></w:body></w:document>"},{"partUri":"/matlab/output.xml","contentType":"text/xml","content":"<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\" ?><embeddedOutputs><metaData><evaluationState>manual</evaluationState><layoutState>code</layoutState><outputStatus>ready</outputStatus></metaData><outputArray type=\"array\"/><regionArray type=\"array\"/></embeddedOutputs>"}]}

In this task you need to imagine that you — yes, YOU — have developed a problem on Cody for me to solve, and now you need to implement a robust Test Suite to check whether my submitted solutions meet your requirements or not, and to be fairly assured that I am not trying to 'game' the system.So the tables are turned! You are now in the role of Tester! I am in the role of Player!The problem you've set me is to:<ul><li>output the sine of an angle, when the angle is specified in degrees as a (scalar) <a href = "https://au.mathworks.com/help/matlab/ref/double.html"><tt>double</tt></a>, with no restriction in the domain,</li><li>without using <tt>regexp</tt> or <tt>regexpi</tt> or <tt>ans</tt>,</li><li>within less than 0.01 seconds (10 milliseconds).</li></ul>You provide me with the following example for the function defined as <tt>s = SINE(a)</tt>:<pre> % INPUT
 a = 45 % degrees
 % OUTPUT
 s = 1/sqrt(2)</pre>Now I have responded by submitting a large number of purported 'solutions', some of which are reasonably accurate, and others which are either too imprecise or else logically flawed.Your Test Suite (contained within your function <tt>testSuite</tt>) must address each of the elements of your problem specification:<ol><li>Check that my submitted code reliably returns sufficiently accurate values for sine of many different angles. Use the <a href = "https://au.mathworks.com/help/matlab/ref/assert.html"><tt>assert</tt></a> function.</li><li>Ensure that the returned data type is suitable.</li><li>You cannot use (or mention) the functions <tt>sind</tt>, <tt>sin</tt>, <tt>cscd</tt> or <tt>cosd</tt> in your Test Suite; any other functions are allowed. [ MOTIVATION: You shouldn't be exposing an efficient way of solving the problem within your Test Suite, otherwise I can just copy and paste your solution and submit it as my own! ]</li><li>You must check that I haven't used "regexp" or "regexpi" or "ans". You could try using the <a href = "https://au.mathworks.com/help/coursework/ug/assessfunctionabsence.html"><tt>assessFunctionAbsence</tt></a> function in the form <tt>assessFunctionAbsence(..., 'FileName','SINE.m')</tt>, or else you could try 'manually' opening the file <tt>SINE.m</tt> that corresponds to my submitted solution and then parsing it for occurrence of the prohibited function/variable.</li><li>You must check that my code returns a result within less than 0.01 seconds (for a single input of an arbitrary angle). You could use <a href = "https://au.mathworks.com/help/matlab/ref/tic.html"><tt>tic</tt></a> & <a href = "https://au.mathworks.com/help/matlab/ref/toc.html"><tt>toc</tt></a> or <a href = "https://au.mathworks.com/help/matlab/ref/timeit.html"><tt>timeit</tt></a>, or a variety of other MATLAB functions (but not <tt>cputime</tt> in this case). If your Test Suite claims that my submission runs slowly, then you must be confident that it is truly caused only by inefficiency in my submitted code, not just general/erratic overheads in 'queuing' or suchlike on the Cody servers.</li><li>Your <tt>assert</tt> (or other) function must throw <a href = "https://www.mathworks.com/matlabcentral/cody/problems/44357">errors/exceptions</a> with the following <tt>error message</tt> text contents.</li></ol><ul><li>'Incorrect value' if the output is too inaccurate.</li><li>'Incorrect data type' if the output is not appropriate.</li><li>'Too slow' if my submitted code is too slow.</li><li>'Banned word' if my submitted code contains the <tt>regexp</tt> or <tt>regexpi</tt> functions or the <a href = "https://au.mathworks.com/help/matlab/ref/ans.html"><tt>ans</tt></a> variable. For this infringement, additional text can also (optionally!) be present in the message — for example, 'You cannot do that! Banned word (regexp/regexpi)' would also be acceptable.</li></ul>When creating a Test Suite for a Cody problem it is a good habit to try to anticipate the tactics that diverse Players might employ!See also:<ul><li><a href = "https://www.mathworks.com/matlabcentral/cody/problems/44631">Problem 44631</a> (part 0)</li><li><a href = "https://www.mathworks.com/matlabcentral/cody/problems/44617">Problem 44617</a> (part 1)</li><li><a href = "https://www.mathworks.com/matlabcentral/cody/problems/44616">Problem 44616</a> (part 2)</li></ul>

Solve

Solution Stats

5 Solutions
2 Solvers

Last Solution submitted on Feb 05, 2019

Last 200 Solutions

Problem Comments

Problem Recent Solvers2

Problem Tags

assert assessfunctionabsence cody basics meta-problem speed test suite testing times