ThingSpeak


Having problem in extracting data from this website https://aemo.com.au/. I tried to extract the current demand value from the website but it did'nt work.

CALVIN HANS ANAK LANG on 1 Apr 2024
Latest activity Reply by Christopher Stapels on 3 Apr 2024

%%
clear
clc
close all
% TODO - Replace the [] with channel ID to write data to:
writeChannelID = 'your channel ID'; %channel ID
% TODO - Enter the Write API Key between the '' below:
writeAPIKey = 'your write API Key'; %write API Key
% url for POST request
url = 'https://aemo.com.au/';
webText = webread(url);
filteredData(4) = urlfilter(url,'<div class="summary-row-value">');
display(filteredData(4), 'AEMO');
thingSpeakWrite(writeChannelID, filteredData(4), 'WriteKey', writeAPIKey);

1 Comment

Christopher Stapels
Christopher Stapels on 3 Apr 2024
Those elements are populated by javascript and arent available at page load. You need a browser to render that content, then you could scrape it.
I did find an underlying component that geenrtes that visualization, but it sill doesnt have the numbers populated until the javascript runs. It feels like an operation that should be very possible but it isnt unfortunately. Ill keep looking for a solution.
https://visualisations.aemo.com.au/aemo/apps/visualisation/index.html#/electricity/dashboard?Elec_enabled=Yes&amp;Gas_enabled=No&amp;Elec_location=NSW,QLD,SA&amp

Tags