webread not returning full html contents

The following call to read a webpage

URL='https://courses.yale.edu/?keyword=energy&srcdb=202203';
data=webread(URL);

does not return the full contents of the html file of the webpage, in the following sense:

If I enter the URL as above in my browser and view the source code of the page, the contents are different from what is returned by webread.

I've tried using various forms of webread (and webwrite) with different weboptions, but every call returns the same limited html content, which is the same as the base html content of

'https://courses.yale.edu'

without the results of the search on the page, with the given query parameters.

[Michael Oristaglio]

Some more detail to clarify the problem.

The webpage displayed when entering the URL in the browser is divided into panels, and it is only by using the INSPECT function of Google Chrome on the panel labelled SEARCH RESULTS (> RIGHT CLICK > INSPECT) that the full html code of the search results is shown.

Answer 1

[DGM]

Webread() just reads the page. It doesn't execute all the tons of scripts that are used to build the DOM.

https://www.mathworks.com/matlabcentral/answers/803631-webread-won-t-read-everything

https://www.mathworks.com/matlabcentral/answers/624818-webread-fails-to-get-all-data