webread can't read the table of a website

Hi, I want to read the table in the left of this website:

https://booleangenenetworks.math.iastate.edu/

I'm using

a=webread("https://booleangenenetworks.math.iastate.edu/")

but the table is hiden inside the source code (line 153) so I can't get the content of the table.

"<table id="rowSelectTable0" onmousedown="toggleSelecting(true)" onmouseup="toggleSelecting(false)"></table>"

How should I get the table?

Thanks!

Answer 1

[Rik]

The reason is that this data is loaded separately from the rest of the web page.

The data seems to be loaded from these two pages:

1. https://booleangenenetworks.math.iastate.edu/static/data/pidToTitle.txt
2. https://booleangenenetworks.math.iastate.edu/static/data/stratification.csv

I found these using the network monitor of my browser. This extra work is an artifact of the modern web, which allows the page itself to be loaded quickly, but also allows editing/updating the data without having to rewrite all pages using this data for display.

You should be able to read these files with webread and do the processing required.