YouTube Demonstration videos:
1) Intro- Pointer, Get values and Page Navigation
1.5) Intro- Troubleshooting & Getting correct content from page
2) Intro- Set values & clicks / Buttons
3) Itermediate- Isolating area and leveraging DOM/HTML
4) Advanced- Dealing with Frames
5) Intro- Troubleshooting tips
6) Intermediate- Loop over pages & extract data
7) Intermediate- Web scraping using ClassName
8) Intermediate- Web scraping using QuerySelector and QuerySelectorAll
9) Intro- Webinar on Intro to Web Scraping
10) Intro- Update to Web Scraping syntax writer
11) Intermediate-EventListners & Triggering Events
12) Intermediate-Saving files / Pictures from a URL / Hyperlink
13) Intro-Review of Web scraping tools
14) Intermediate- Passing Method or Property to COM in a function
15) Intermediate- Intermediate Extracting data from a table by walking the DOM
Also check out my other tutorials on using Selenium with AutoHotkey (this allows for scraping with Chrome, FireFox, IE, etc.) and using Chrome.ahk from GeekDude to Get and Set values.
Manipulating the Document Object Model in Javascript is a good video talking through the DOM from O'Reilly
I highly recommend using Fiddler to help monitor network traffic. Check out this page where I have some videos showing how to use Fiddler ot monitor network traffic.
Here is where you can get the source code as well as compiled version of my AutoHotkey Web Scraping Syntax Writer
Videos and scripts to Login to Websites:
- Login to Facebook This first video is much longer & in-depth! I cover many of the reasons why I pick one method over another. I also have HellBent sit-in and ask questions so it should be a great starting point for noobs to Web Scraping.
- Login to Amazon
- Login to LinkedIn
- Login to Gmail / Google / YouTube
- Login to Pinterest
- Login to Twitter
- Login to Reddit
Examples of work automated via Web Scraping with AutoHotkey
- Submit StumbleUpon submissions
- Transfer data from one website/system to another
- How I exported over 4 million contacts from Lexis Nexis
- Extract status from SharePoint and email colleagues
- Select “x” number of items on website form
- Obtain Behavioral Targeting Data from your own Web Site
- Determine House status on Real Estate site
- Extract meta data about videos from website
- Automating saving invoices on Amazon for taxes
- Waiting for an element to be visible before clicking (this is using FindText instead of COM)
If you're new to web scraping, API calls, and http protocol, this is a great discussion you need to see!
Web scraping, APIS and HTTP Traffic
If you're trying to use URLdownload to Var, WinHTTPRequests, or automate Chrome, this is a great overview of the high-level principles of what you're doing and different approaches.