{"id":189,"date":"2020-04-27T11:46:16","date_gmt":"2020-04-27T18:46:16","guid":{"rendered":"http:\/\/hardythoughts.com\/?p=189"},"modified":"2020-04-27T11:46:16","modified_gmt":"2020-04-27T18:46:16","slug":"accuracy-and-switching-trackers","status":"publish","type":"post","link":"http:\/\/hardythoughts.com\/index.php\/2020\/04\/27\/accuracy-and-switching-trackers\/","title":{"rendered":"Accuracy and Switching Trackers"},"content":{"rendered":"\n<h2>Some Background on Accuracy<\/h2>\n\n\n\n<p>As I\u2019ve watched the tracker at <a href=\"https:\/\/coronavirus.1point3acres.com\/en\">1point3acres<\/a> approach one million cumulative cases, a milestone it will reach sometime later today, I\u2019ve become increasingly aware of the disparity in numbers between the trackers.\u00a0 For example, here are the most recent numbers from several trackers:<\/p>\n\n\n\n<figure class=\"wp-block-table\"><table><tbody><tr><td>1point3acres<\/td><td>994,704<\/td><\/tr><tr><td>Johns Hopkins<\/td><td>968,203<\/td><\/tr><tr><td>New York Times<\/td><td>965,214<\/td><\/tr><tr><td>CDC<\/td><td>928,619<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<p>Some of these differences are easy to explain.\u00a0 For example, the CDC number is so much lower because it only really updates on weekdays at 4pm.\u00a0 Since I\u2019m writing this on a Monday morning, that means it\u2019s numbers are more than two and a half days old.\u00a0 However, the other trackers had all updated within an hour of my noting their numbers and there is nearly 30,000 cases difference in their reports.\u00a0 That comes to about a 3% difference, which sounds less startling, but it still amounts to about a day\u2019s difference on when they will reach one million cases.<\/p>\n\n\n\n<p>There\u2019s an easy answer to the question of which tracker we should believe: None of them.&nbsp; All of these numbers are just approximations based on interpreting inadequate data.&nbsp; Each tracker has to make decisions about when to include or exclude a data point in its count.&nbsp; 1point3acres is the most aggressive of these in including cases, CDC is the most conservative in doing so. &nbsp; At best, these trackers give us an estimate of known cases, but it is increasingly apparent that a large majority of cases are unknown.&nbsp; This isn\u2019t a surprise, even early reports&nbsp; indicated a high proportion of asymptomatic and mild cases.&nbsp; For example, nearly half of those who tested positive on the Diamond Princess were asymptomatic.&nbsp; Because the passengers on the Diamond Princess were generally older, and older people are more likely to be symptomatic, we should expect the majority of cases to be asymptomatic.&nbsp; In mid-March&nbsp; the WHO said that about 80% of cases seemed to be either asymptomatic or mild.&nbsp;&nbsp;<\/p>\n\n\n\n<p>Given the lack of testing in the US, those with mild or no symptoms are unlikely to be confirmed to a degree needed to show up on these trackers.&nbsp; The trackers will also miss those who have symptoms but who, for a variety of reasons, are never diagnosed.&nbsp; Again, lack of testing has a role here.&nbsp; Many locales recommend that even those with symptoms try to stay at home as long as possible so as not to overwhelm hospitals.&nbsp; Further, we know that some deaths have been missed, though not exactly how many.<\/p>\n\n\n\n<p>My working guess, and it\u2019s only a guess, is that the trackers probably only catch about half of symptomatic cases and about one tenth of all cases. I guess they also only catch about half of all COVID related deaths.&nbsp; These aren\u2019t blind guesses, but it would be a stretch to call them educated.&nbsp; They happen to match with a few data points, but they\u2019re driven as much by a desire for nice round numbers as they are by looking at the relevant research.&nbsp; But given those guesses, a difference of 3% between trackers seems almost trivial.<\/p>\n\n\n\n<h2>Changing Primary Tracker<\/h2>\n\n\n\n<p>Starting today, I\u2019m shifting my primary tracker, the one I\u2019ll base my projections on, from 1point3acres to Johns Hopkins.&nbsp; There are a couple of reasons for this.<\/p>\n\n\n\n<p>My goal in these posts has been to help people manage expectations by making the numbers more understandable.&nbsp; Whatever the real numbers, it can be confusing to see one source say we have a million cases and another source say we\u2019re still 30,000 shy of that.&nbsp; Johns Hopkins is more often referenced in media reports, so it will track better with what you\u2019re likely to see there.&nbsp; This should keep the projections more closely aligned with common sources, which should make it more helpful.&nbsp;<\/p>\n\n\n\n<p>John Hopkins shares its data set publicly, 1point3acres doesn\u2019t.&nbsp; By using Johns Hopkins\u2019 data I can run different comparisons, an ability that will be increasingly important as we shift from trying to get a lid on explosive growth to just trying to keep the lid on it.&nbsp; For example, I can use their data on hospitalizations and testing to get a better idea of the scope of the epidemic.&nbsp; This gives me the opportunity to burnish some old skills and learn some new ones, something I enjoy doing.&nbsp; I\u2019ll try to have some new things to show soon, but for today, it\u2019s just numbers.<\/p>\n\n\n\n<h2>Projection<\/h2>\n\n\n\n<p>It will take me some time to fully switch to the new dataset, so today\u2019s projection is something of a hybrid.&nbsp; I\u2019ll be starting with Johns Hopkins\u2019 numbers from last night, but I\u2019ll be projecting based on the growth rates from 1point3acres.&nbsp; This isn\u2019t ideal, but it should be fairly close.&nbsp; If it turns out to be an issue, I\u2019ll post an update once I start to get the new system running.<\/p>\n\n\n\n<p>Here\u2019s the 10 day projection<\/p>\n\n\n\n<figure class=\"wp-block-table\"><table><tbody><tr><td>Yesterday<\/td><td>965,783<\/td><td>54,881<\/td><\/tr><tr><td>4\/27<\/td><td>997,094<\/td><td>57,038<\/td><\/tr><tr><td>4\/28<\/td><td>1,028,405<\/td><td>59,279<\/td><\/tr><tr><td>4\/29<\/td><td>1,059,716<\/td><td>61,609<\/td><\/tr><tr><td>4\/30<\/td><td>1,091,027<\/td><td>64,030<\/td><\/tr><tr><td>5\/1<\/td><td>1,122,338<\/td><td>66,547<\/td><\/tr><tr><td>5\/2<\/td><td>1,153,649<\/td><td>69,162<\/td><\/tr><tr><td>5\/3<\/td><td>1,184,960<\/td><td>71,880<\/td><\/tr><tr><td>5\/4<\/td><td>1,216,271<\/td><td>74,705<\/td><\/tr><tr><td>5\/5<\/td><td>1,247,582<\/td><td>77,641<\/td><\/tr><tr><td>5\/6<\/td><td>1,278,893<\/td><td>80,692<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<p>By the way, in the time it has taken me to write this, the 1point3acres tracker has risen to over a million, the Johns Hopkins tracker is still just under 980,000.<\/p>\n\n\n\n<p>Thanks for reading.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Some Background on Accuracy As I\u2019ve watched the tracker at 1point3acres approach one million cumulative cases, a milestone it will reach sometime later today, I\u2019ve become increasingly aware of the disparity in numbers between the trackers.\u00a0 For example, here are the most recent numbers from several trackers: 1point3acres 994,704 Johns Hopkins 968,203 New York Times [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[5],"tags":[10,8,7,9],"_links":{"self":[{"href":"http:\/\/hardythoughts.com\/index.php\/wp-json\/wp\/v2\/posts\/189"}],"collection":[{"href":"http:\/\/hardythoughts.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/hardythoughts.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/hardythoughts.com\/index.php\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"http:\/\/hardythoughts.com\/index.php\/wp-json\/wp\/v2\/comments?post=189"}],"version-history":[{"count":1,"href":"http:\/\/hardythoughts.com\/index.php\/wp-json\/wp\/v2\/posts\/189\/revisions"}],"predecessor-version":[{"id":191,"href":"http:\/\/hardythoughts.com\/index.php\/wp-json\/wp\/v2\/posts\/189\/revisions\/191"}],"wp:attachment":[{"href":"http:\/\/hardythoughts.com\/index.php\/wp-json\/wp\/v2\/media?parent=189"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/hardythoughts.com\/index.php\/wp-json\/wp\/v2\/categories?post=189"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/hardythoughts.com\/index.php\/wp-json\/wp\/v2\/tags?post=189"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}