Wednesday 7 September 2011

Getting the AFL Videos from 2008 and 2009

This post continues a series starting at http://sandbelt-sandpit.blogspot.com/2011/09/how-to-download-afl-videos.html. The first post made the following remark:

"[AFL games] from 2008 and 2009 are available only as Windows Media rtsp streams. The quality is more-or-less the same: 672x544 resolution at a video rate of 1.99 mbps, though it turns out to be harder to determine the link address and harder again to download the streams to disk files."


So there are two problems: first we need the urls of the media streams we want, and then we need some means of recording them. But first some background knowledge.


rtsp?
This is Real Time Streaming Protocol, and all you need to know is that it is is a network control protocol designed for use in entertainment and communications systems, that some media players can handle it directly and some can't, and if they can't they may negotiate an alternative distribution over the very common http protocol. 


record media streams?
There are many providers that supply video on a watch-now basis, and they do it by packaging in stream form. These streams are not intended to be recorded, and this means that there are several commercial packages that do just that, in exchange for money. I have tried a few without much liking any of them, and nowadays I try to use VLC Media Player which is very powerful (if sometimes hard to drive) and also free. And also works on ten versions of Linux as well as OSX, iOS, Android and of course Windows. Everybody ought to have it.
VLC is supposed to handle rtsp streams but it doesn't do it very well, at least in version 1.1 11, and is much happier being fed over http. Fortunately this is possible.


How to discover the urls
and who doesn't need to know.
Second part first: you only need to read the following if (a) you want to, or (b) you want a game that Essendon wasn't in. Bombers fans can afford drop right down to the How to record a stream section because all the links they will need can be found at the end of this post.


But if you are still here, to continue, the DownloadHelper/FireFox solution used in my Post number 2  will not work with stream videos and you will have to resort to eavesdropping on your browser's communications with the outside world. The application I use for this is URL Snooper, a program written to help users locate the urls of audio and video files so that they can be recorded. Get this program from http://www.donationcoder.com/Software/Mouser/urlsnooper/index.htmlIt is donationware, which means that it is available for free but you can pay if your own sense of justice tells you to. It runs only on Windows, and (sorry) I don't know about anything else.


So, assuming you have a Windows machine, install URL Snooper, turn it on and click the Sniff Network button. The Keyword Filter box is to reduce clutter and it would be good at this point to type a team name in there.


 As previously, go to BigPond AFL Videos and use the fancy navigator to select ON DEMAND, Essendon TV (or some other club if that is what you really want) and Matches. Set the quality as high as possible in the web player. Pick a match and play it.



URL Snooper will have picked up all the media links that the browser made requests for:


If you can read this image you will observe a whole list of rstp stream requests, including the one we are playing (rtsp://bptvvod.ngcdn.telstra.com/wh_ivideo/AFL/ONDEMAND/2009/ON/iVideo/Premiership/RD13/NV_Rd13_EssendonVCarlton.wmv?WMBitrate=2621440). Further down you see the same game appearing as a WindowsMedia http file, and its URL is otherwise identical except for a changed server name (now fli-cdn220-is-1.se.bptvvod.ngcdn.telstra.com). 


At this point it helps to know that BigPond has a lot of servers and uses a sort of alias system to direct requests to them. The bptvvod.ngcdn.telstra.com server name seems to be an umbrella that resolves to all the other alternatives, or at least it has so far. We might then guess that we could ignore the server name and just change the rtsp:// part of the stream URL to http://, and sure enough the following procedure has proven to be reliable:
  • Play the game, snoop its rstp URL
  • Edit this url so it starts with http:// instead of rstp://.

How to record the stream.

Here is where we use VLC. Get it from http://www.videolan.org/vlc/ (if you don't have it already) and fire it up.

Click the Media menu and select Open Network Stream...
Paste in your edited (http://) game URL and click the little down arrow to the right of the Play button:



Write in a destination file name ending in .mp4. Optionally check the Display the output box.


Click Start. You are up and running.

The recording runs in real time, so a 3-hour video will take 3 hours to record. On the other hand if you have a good internet connection you can start several instances of VLC and record several games at once.


Update: A problem with VLC 2.0?

There have been changes to VLC since all I first wrote all of the above and it seems to have developed a bug that causes it to crash. But you can always just use an older version, such as 1.1.11 which you can download from HERE. The goodish news is that VLC is a portable app that does not need to be actually installed, so you can download the old version as a zip file, unpack it somewhere (even to a USB stick) and then just run its main program (vlc.exe) from your file manager.


For Bombers Fans

Friendly sandbelt has constructed lists of URLs of essendon games for the two years that this video format was current for. Some browsers (for me, only Internet Explorer 9) allow you to check them out directly by clicking the links. But you can always right-click the link, choose Copy, and then paste into VLC to make a recording.


2009


R01 Port Adelaide 15.17 (107) Essendon 9.12 (66) video stream
R02 Essendon 16.13 (109) Fremantle 10.11 (71) video stream
R03 Carlton 16.16 (112) Essendon 17.14 (116) video stream
R04 North Melbourne 10.9 (69) Essendon 7.15 (57) video stream
R05 Essendon 13.15 (93) Collingwood 12.16 (88) video stream
R06 Brisbane Lions 17.9 (111) Essendon 9.14 (68) video stream
R07 Essendon 17.14 (116) Hawthorn 10.12 (72) video stream
R08 St Kilda 13.12 (90) Essendon 10.11 (71) video stream
R09 Richmond (*) 12.13 (85) Essendon 19.11 (125) video stream
R10 Essendon 11.4 (70) Geelong 20.14 (134) video stream
R11 Essendon 18.6 (114) Adelaide 21.4 (130) video stream
R12 Essendon 19.17 (131) Melbourne 13.5 (83) video stream
R13 Essendon 21.10 (136) Carlton 9.13 (67) video stream
R14 Collingwood 15.12 (102) Essendon 9.13 (67) video stream
R15 Sydney 10.12 (72) Essendon 15.17 (107) video stream
R16 Essendon 11.4 (70) Western Bulldogs 15.13 (103) video stream
R17 Essendon 14.12 (96) Richmond 15.11 (101) video stream
R18 West Coast 14.11 (95) Essendon 10.8 (68) unavailable
R19 Essendon 13.9 (87) Brisbane Lions 12.15 (87) unavailable
R20 Essendon 16.14 (110) St Kilda 16.12 (108) video stream
R21 Fremantle 21.15 (141) Essendon 13.9 (87) video stream
R22 Hawthorn 14.15 (99) Essendon 16.20 (116) video stream
EF1 Adelaide 26.10 (166) Essendon 10.10 (70) video stream
(*) Low quality


2008


R01 North Melbourne 9.13 (67) Essendon 19.8 (122) video stream
R02 Geelong 22.18 (150) Essendon 6.15 (51) video stream
R03 Essendon 23.12 (150) Carlton 21.8 (134) video stream
R04 Essendon 14.14 (98) Western Bulldogs 19.14 (128) video stream
R05 St Kilda 18.15 (123) Essendon 14.3 (87) video stream
R06 Collingwood 23.16 (154) Essendon 12.9 (81) video stream
R07 Essendon 15.4 (94) Port Adelaide 24.14 (158) video stream
R08 Sydney 21.17 (143) Essendon 7.10 (52) video stream
R09 Essendon 10.12 (72) Richmond 16.14 (110) video stream
R10 Adelaide 9.20 (74) Essendon 10.9 (69) video stream
R11 Essendon 12.7 (79) Hawthorn 19.16 (130) video stream
R12 Essendon 16.17 (113) West Coast 13.13 (91) video stream
R13 Carlton 15.11 (101) Essendon 20.16 (136) video stream
R14 Fremantle 13.13 (91) Essendon 14.11 (95) video stream
R15 Essendon 24.11 (155) Brisbane Lions 18.10 (118) video stream
R16 Richmond 16.12 (108) Essendon 15.14 (104) video stream
R17 Essendon 19.14 (128) Collingwood 11.14 (80) video stream
R18 Essendon 19.10 (124) Melbourne 17.6 (108) video stream
R19 West Coast 17.11 (113) Essendon 16.7 (103) video stream
R20 Essendon 10.13 (73) Adelaide 19.15 (129) video stream
R21 Western Bulldogs 23.13 (151) Essendon 15.15 (105) video stream
R22 Essendon 5.9 (39) St Kilda 21.21 (147) video stream


The final post in this series, when I write it,  will be about how to record the videos from 2007. This will be getting very much into the land of diminishing returns since their quality is so low, but never mind, completeness is a virtue all in itself.









No comments:

Post a Comment