Check out R-bloggers for more excellent content!

Comrades Marathon Pacing Chart: Up Run

2015-04-01     Excel Running

I’ve updated my Comrades Marathon pacing chart to include both the Up and Down runs. You can grab it here. The data for this year’s race are not yet finalised (I think we will be running 87 km), but you can make changes when it’s all confirmed. Read more »

The Price of Fuel: How Bad Could It Get?

2015-04-01     R

The cost of fuel in South Africa (and I imagine pretty much everywhere else) is a contentious topic. It varies from month to month and, although it is clearly related to the price of crude oil and the exchange rate, various other forces play an influential role. Read more »

Creating Charts with Easel.ly

2015-03-31

Encyclopaedia: Geospace

2015-03-30

A contribution which I wrote for Antarctica and the Arctic Circle: A Geographic Encyclopedia of the Earth’s Polar Regions. As a side note, I am normally quite pedantic about “Earth” and “Sun” being capitalised but the editor of the Encyclopaedia evidently had different views on this point. Read more »

Encyclopaedia: Scottish National Antarctic Expedition

2015-03-23

A contribution which Claire and I wrote for Antarctica and the Arctic Circle: A Geographic Encyclopedia of the Earth’s Polar Regions Read more »

Font Awesome in Presentations: Notes

2015-03-22     Speaking

I’ve used various icons from Font Awesome in my last few presentations and I’ve been very pleased with the results. Using them is pretty straight forward, but here are a couple of things that I picked up: Read more »

Encyclopaedia: SANAE IV

2015-03-16

A contribution which I wrote for Antarctica and the Arctic Circle: A Geographic Encyclopedia of the Earth’s Polar Regions. South Africa is one of the founding signatories of the Antarctic Treaty of 1959. In 1960, the first South African National Antarctic Expedition (SANAE) team overwintered at the Norwegian base on the Fimbul Ice Shelf. A new base, SANAE I, was constructed nearby (70° 18′S 2° 22′W) and opened in 1962. Later bases, SANAE II and SANAE III, were built on the same location (72° 40′ 22″S 2° 50′ 26″W) and commissioned in 1971 and 1979 respectively. Read more »

First Steps with Tableau: Decimal Separator

2015-03-13     Tableau

I downloaded a trial version of Tableau today and tried it out on one of the data sets I am currently working with. The data are stored in XLSX. Both the spreadsheet and my locale have a period set as the decimal separator, yet when I imported the data into Tableau it used a comma as the decimal separator. Read more »

Dealing with a Byte Order Mark (BOM)

2015-03-11     R

I have just been trying to import some data into R. The data were exported from a SQL Server client in tab-separated value (TSV) format. However, reading the data into R the “usual” way produced unexpected results: Read more »

Visualising Nobel Prizes and Laureates

2015-03-09     Visualisation

A very cool visualisation. Find out more at brainpickings.org. Read more »

Book Review: Graph Databases

2015-02-09     Neo4j Book Review

The book Graph Databases by Ian Robinson, Jim Webber and Emil Eifrem gives an engaging overview of Graph Databases, describing typical use cases and illustrating the syntax used to construct and query them. Graph Databases are a form of NoSQL database and, as such, differ significantly from the ubiquitous Relational Databases. The authors discuss a variety of scenarios where a Graph Database would be a better fit than a Relational Database, showing how they are particularly well suited to data which describe relationships between entities. Read more »

Book Review: R for Business Analytics

2015-01-28     R Book Review

The book R for Business Analytics by Ajay Ohri sets out to look at “some of the most common tasks performed by business analysts and helps the user navigate the wealth of information in R and its 4000 packages.” In my opinion it succeeds in covering an extensive range of topics but fails to provide anything of substantial use to its intended audience. At least, not anything that could not be uncovered by a brief internet search. Read more »

Downloading Options Data in R: An Update

2015-01-14     R

I recently read an article which showed how to download Option Chain data from Google Finance using R. Read more »

Random Number Generators

2014-12-19     talk: standard

Simulating Intricate Branching Patterns with DLA

2014-12-16     R

Manfred Schroeder’s book Fractals, Chaos, Power Laws: Minutes from an Infinite Paradise is a fruitful source of interesting topics and projects. He gives a thorough description of Diffusion-Limited Aggregation (DLA) as a technique for simulating physical processes which produce intricate branching structures. Examples, as illustrated below, include Lichtenberg Figures, dielectric breakdown, electrodeposition and Hele-Shaw flow. Read more »

Lessons I've Learned from Physics

2014-12-13     talk: standard

Rosetta's Rendezvous with Comet 67P

2014-11-13

On 12 November 2014 the Philae lander from the Rosetta robotic space probe successfully landed on comet 67P/Churyumov–Gerasimenko. A couple of great comics to commemorate this momentous achievement. Read more »

Zacks Data on Quandl

2014-11-08     R

Data from Zacks Research have just been made available on Quandl. Registered Quandl users have free preview access to these data, which cover the following: Earnings Estimates: forward-looking consensus forecasts; Earnings Surprises: estimated future and actual historical earnings; Earnings Announcements: predictions for earnings announcement dates, parameters, and supplementary data; Sales Estimates: analogous to earnings estimates, but for sales; Dividend Data: dividend history and future announcement dates. These data describe over 5000 publicly traded US and Canadian companies and are updated daily. Read more »

Creating More Effective Graphs

2014-11-04     R

A few years ago I ordered a copy of the 2005 edition of Creating More Effective Graphs by Naomi Robbins. Somewhat shamefully I admit that the book got buried beneath a deluge of papers and other books and never received the attention it was due. Having recently discovered the R Graph Catalog, which implements many of the plots from the book using ggplot2, I had to dig it out and give it some serious attention. Read more »

Standard Bank: Striving for Mediocrity

2014-10-07

Recently I was in my local Standard Bank branch. After finally reaching the front of the queue and being helped by a reasonably courteous young man, I was asked if I would mind filling out a survey. Sure. No problem. I had been in the bank for 30 minutes, I could probably afford another 30 seconds. Read more »

Plotting Flows with riverplot

2014-08-14     R

I have been looking for an intuitive way to plot flows or connections between states in a process. An obvious choice is a Sankey Plot, but I could not find a satisfactory implementation in R… until I read the riverplot post by January Weiner. His riverplot package does precisely what I am need. Read more »

Commitments of Traders: Moves in the Last Week

2014-08-09     R

In my previous post I gave some background information on the Commitments of Traders report along with a selection of summary plots. Read more »

Charting culture

2014-08-06

This is well worth watching. Good idea. Great presentation. Effective use of the media to publicise a scientific paper. Read more »

Whistlers and Volcanic Lightning

2014-07-30

A paper authored with my very talented student, Claire Antel, entitled “Investigating Dunedin whistlers using volcanic lightning” has just been published in Geophysical Research Letters. The paper looks at electromagnetic signals (“whistlers”) received at Dunedin, New Zealand, caused by lightning over volcanoes thousands of km away near the Aleutian Chain. Read more »

Comrades Marathon: A Race for Geriatrics?

2014-07-22     R Running

It has been suggested that the average Comrades Marathon runner is gradually getting older. As an “average runner” myself, I will not deny that I am personally getting older. But, what I really mean is that the average age of all runners taking part in this great event is gradually increasing. This is not just an idle hypothesis: it is supported by the data. If you’re interested in the technical details of the analysis, these are included at the end, otherwise read on for the results. Read more »

Where to Put EAs and Indicators in New MT4 Builds

2014-07-20

If you are creating an EA or indicator from scratch, then the MetaTrader editor places the files in the correct location and the terminal is automatically able to find them. However, if the files originate from a third party then you will need to know where to insert them so that they show up in the terminal. For older builds of MetaTrader 4 the directory structure was fairly simple. Everything was to be found in a folder under Program Files. Its contents looked like this: Read more »

Comrades Marathon Negative Splits: Cheat Strikes Again

2014-07-16     Running

Twins, Tripods and Phantoms at the Comrades Marathon

2014-06-12     R running

Having picked up a viral infection days before this year’s Comrades Marathon, on 1 June I was left with time on my hands and somewhat desperate for any distraction. So I spent some time looking at my archive of Comrades data and considering some new questions. For example, what are the chances of two runners passing through halfway and the finish line at exactly the same time? How likely is it that three runners achieve the same feat? Read more »

Concatenating a list of data frames

2014-06-06     R

It’s something that I do surprisingly often: concatenating a list of data frames into a single (possibly quite enormous) data frame. Until now my naive solution worked pretty well. However, today I needed to deal with a list of over 6 million elements. The result was hours of page thrashing before my R session finally surrendered. I suppose I should be happy that my hard disk survived. Read more »

Comrades Marathon Pacing Chart: Down Run

2014-05-28     Excel running

Although I have been thinking vaguely about my Plan A goal of a Bill Rowan medal at the Comrades Marathon this year, I have not really put a rigorous pacing plan in place. I know from previous experience that I am likely to be quite a bit slower towards the end of the race. I also know that I am going to lose a few minutes at the start. So how fast does this mean I need to run in order to get from Pietermaritzburg to Durban in under 9 hours? Read more »