Detect if a web page has completed loading via IE COM calls with check for ReadyState=4 and Busy=False

[JoeWinograd]

I'm using this script to detect if a page has completed loading:

Code: Select all

ReadyState:=0
Busy:=True
ReadyState_Complete:=4
oIE:=ComObjCreate("InternetExplorer.Application")
oIE.Visible:=True
oIE.Navigate("https://www.mlb.com/")
While ((ReadyState<>ReadyState_Complete) or (Busy))
{
  ReadyState:=oIE.ReadyState
  Busy:=oIE.Busy
  Sleep,50
}
MsgBox,4096,Page loaded,ReadyState=%ReadyState%  Busy=%Busy%
oIE.Quit ; comment out if you don't want to close it
ExitApp

While it seems to work on some sites, it clearly is not working at the site in the script above, as the MsgBox appears well before the entire page is loaded. Anyone know how to fix the script above or have a better way to check if a web page has completed loading? Thanks, Joe

[TheDewd]

This works for me:

Code: Select all

IE := ComObjCreate("InternetExplorer.Application")
IE.Visible := 1
IE.Navigate("https://www.mlb.com/")

While (IE.ReadyState <> 4) || (IE.Busy) {
	Sleep, 100
}

MsgBox, 4096, Page Loaded, % "ReadyState=" IE.ReadyState " Busy=" IE.Busy

IE.Quit
ExitApp

[JoeWinograd]

Hi TheDewd,

The only differences between our scripts are:

(1) I assigned the value of ReadyState_Complete (which is 4) to a variable instead of hard-coding it. Doesn't matter.

(2) I use or for logical OR; you use ||. Doesn't matter.

(3) I assigned ReadyState and Busy to variables. Doesn't matter.

(4) I reassign ReadyState and Busy inside the While loop, which I would think is necessary, although I could be wrong about that. Your code doesn't reassign IE.ReadyState or IE.Busy. This may matter.

I ran your code and it has the same problem as mine, i.e., the MsgBox appears before the page is done loading. Here's the result of running your code when the MsgBox appears:

page not loaded.png (140.05 KiB) Viewed 2262 times

Here's what it looks like when the page is really done loading:

page loaded.png (269.55 KiB) Viewed 2262 times

Note the Scores on the left and the graphics at bottom center and bottom right. My code behaves the same as yours. Regards, Joe

[Xtra]

Joe i ran your code 3 times and every time it loaded correctly and then showed message box. (the 3rd time the beer ad wasnt completed but that doesnt matter its coming from another domain)

If you are still having trouble i would check if one of the stat elements exists or has content.
Use a loop with a try block in it and only exit the loop when the conditions are met.

HTH

[JoeWinograd]

Hi Xtra,

i ran your code 3 times

Thanks for testing my code. Your results surprise me, especially since my Internet speed is pretty good...just tested it...257.9 Mbps down, 23.9 up. I can't understand why it loads for you before the MsgBox appears and doesn't for me.

check if one of the stat elements exists or has content

I don't know what you mean by "stat elements"...please explain. Thanks, Joe

[TheDewd]

I think he means "Static". Anyway, the other content may be loading dynamically through JavaScript. So, the page itself might actually be 100% complete with main HTML and scripts, then the scripts begin loading the other content afterwards? Just something to consider.

[JoeWinograd]

the page itself might actually be 100% complete with main HTML and scripts, then the scripts begin loading the other content afterwards

That's an interesting theory! Sounds very plausible to me. Assuming that's what's happening, is there any way to know when the other content (all content!) is done loading? Of course, there are some pages where it's never "done loading"...fresh stuff is always coming in, like ads and new headlines/stories.

[Xtra]

Example to try:

Code: Select all

ReadyState:=0
Busy:=True
ReadyState_Complete:=4
oIE:=ComObjCreate("InternetExplorer.Application")
oIE.Visible:=True
oIE.Navigate("https://www.mlb.com/")

Loop
{
    try
    {
        element := oIE.document.querySelector("#g5-component--mlb-scores--minisb--531203 > a:nth-child(2) > div").innertext
        if (element)
            break
    }
    catch
        Sleep 250
}

;~ While ((ReadyState<>ReadyState_Complete) or (Busy))
;~ {
  ;~ ReadyState:=oIE.ReadyState
  ;~ Busy:=oIE.Busy
  ;~ Sleep,50
;~ }

MsgBox,4096,Page loaded, % element
oIE.Quit ; comment out if you don't want to close it
ExitApp

HTH

[JoeWinograd]

Hi Xtra,
That's a fascinating example...works nicely...but I don't see how it can be extended into a general purpose script that will work at all websites. Good stuff, though. Thanks, Joe