Support the Arctic Sea Ice Forum and Blog

Author Topic: September predictions challenge 2019  (Read 1231 times)

Paddy

  • ASIF Middle Class
  • Posts: 512
    • View Profile
  • Liked: 15
  • Likes Given: 23
September predictions challenge 2019
« on: June 09, 2019, 10:06:22 AM »
And it's back! Many thanks to Richard Rathbone for setting this up last year. Rules copied over from last year's thread:

Quote
This is a challenge which accumulates scores across all the monthly polls on September sea ice to come up with an overall rating of how good the predictions made are. In addition to making a prediction, entrants are required to rate their confidence in that prediction. The higher the confidence, the narrower the margin of error you are allowed, but the higher score you get if the September ice ends up where you predicted it (and the bigger penalty you take if you miss).

Currently included polls are: JAXA daily minimum area, NSIDC September average.
Other polls may be added during the course of the season if their structure fits this challenge.

Points are scored as follows:
Very High Confidence: 10 points if you pick the correct bin, -10 points for all other bins.
High Confidence: 6 points for the correct bin, 2 points if one bin out, -2 points if two bins out, -6 points for all other bins
Medium Confidence: 4 points for the correct bin, 2 points if one bin out, 1 point if two bins out, -1 if three bins out, -2 if four bins out, -4 points for all other bins
Low Confidence: 2 points for the correct bin, 1 point if within 3 bins, -1 point if 4-6 bins out, -2 points for all other bins
Very Low Confidence: 1 point if in the correct bin, no score (or penalty) for any other bin.

Note on portmanteau and end of range bins: these are excluded from the challenge, you may either select a bin within the portmanteau range, or extend the range beyond the poll endpoint for your challenge entry. If the September values fall out of the normal range, scores will be assessed by extending the bin structure. e.g. an end result of 5.9 counts as two bins out for a 5-5.5 entry.

To enter, post guess and confidence in this thread before the closing date of the poll. Editing a post to change the prediction before the closing date is allowed, editing for any reason after the closing date for a poll will result in disqualification from the challenge.

oren

  • ASIF Governor
  • Posts: 3746
    • View Profile
  • Liked: 520
  • Likes Given: 1042
Re: September predictions challenge 2019
« Reply #1 on: June 09, 2019, 11:05:56 AM »
Two questions:
A. I take it the bin size is 0.25 million km2?
B. Must the guess here be the same as on the poll thread? I assume not.

Paddy

  • ASIF Middle Class
  • Posts: 512
    • View Profile
  • Liked: 15
  • Likes Given: 23
Re: September predictions challenge 2019
« Reply #2 on: June 09, 2019, 06:09:21 PM »
Two questions:
A. I take it the bin size is 0.25 million km2?
B. Must the guess here be the same as on the poll thread? I assume not.

A. The bin you're guessing at is 0.5m km2 wide, but each step out is measured in 0.25m km2 increments.

So if you guess at 4 to 4.5, and the final extent is 4.9, you count as being 2 bins out. EDIT: If you had gone for Very High Confidence, you would get -10 points. If High, -2 points. If Medium or Low, 1 point. If Very Low, 0 points.

B. No, it does not have to be the same.

EDIT: My June predictions are as follows:
JAXA: 3.75 to 4.25, medium
NSIDC: 4.25 to 4.75, medium

oren

  • ASIF Governor
  • Posts: 3746
    • View Profile
  • Liked: 520
  • Likes Given: 1042
Re: September predictions challenge 2019
« Reply #3 on: June 09, 2019, 07:00:27 PM »
My June prediction: JAXA 3.5-4, medium confidence.

b_lumenkraft

  • ASIF Upper Class
  • Posts: 1654
    • View Profile
  • Liked: 359
  • Likes Given: 1597
Re: September predictions challenge 2019
« Reply #4 on: June 09, 2019, 07:23:19 PM »
My June prediction:

JAXA  : 3.50 - 4.00, high confidence
NSIDC : 3.75 - 4.25, high confidence
« Last Edit: June 09, 2019, 08:21:15 PM by b_lumenkraft »

Stephan

  • ASIF Citizen
  • Posts: 481
    • View Profile
  • Liked: 144
  • Likes Given: 75
Re: September predictions challenge 2019
« Reply #5 on: June 09, 2019, 07:32:02 PM »
My prediction (JAXA Sep minimum): 3.75-4,25 M km², high confidence
My prediction (NSIDC Sep Average): 4.00-4.50 M km², high confidence

jdallen

  • ASIF Governor
  • Posts: 2904
    • View Profile
  • Liked: 120
  • Likes Given: 148
Re: September predictions challenge 2019
« Reply #6 on: June 10, 2019, 10:42:22 AM »
My prediction (JAXA Sep minimum): 3.75-4,25 M km², high confidence
My prediction (NSIDC Sep Average): 4.00-4.50 M km², high confidence
Ditto.
This space for Rent.

Neven

  • Administrator
  • ASIF Royalty
  • *****
  • Posts: 6780
    • View Profile
    • Arctic Sea Ice Blog
  • Liked: 442
  • Likes Given: 296
Re: September predictions challenge 2019
« Reply #7 on: June 10, 2019, 02:43:46 PM »
My June predictions are as follows:
JAXA: 3.5 to 4.0, medium
NSIDC: 4.0 to 4.5, medium
Il faut comparer, comparer, comparer, et cultiver notre jardin

oren

  • ASIF Governor
  • Posts: 3746
    • View Profile
  • Liked: 520
  • Likes Given: 1042
Re: September predictions challenge 2019
« Reply #8 on: June 10, 2019, 03:20:33 PM »
I will copy Neven's take on NSIDC, 4-4.5 medium.

Juan C. García

  • ASIF Upper Class
  • Posts: 1222
    • View Profile
  • Liked: 317
  • Likes Given: 416
Re: September predictions challenge 2019
« Reply #9 on: June 10, 2019, 03:32:47 PM »
My June predictions:

JAXA: 3.5 to 4.0, médium confidence
NSIDC: 3.75 to 4.25, médium confidence
Which is the best answer to Sep-2012 ASI lost (compared to 1979-2000)?
50% [NSIDC Extent] or
73% [PIOMAS Volume]

Volume is harder to measure than extent, but 3-dimensional space is real, 2D's hide ~50% thickness gone.
-> IPCC/NSIDC trends [based on extent] underestimate the real speed of ASI lost.

Richard Rathbone

  • ASIF Citizen
  • Posts: 473
    • View Profile
  • Liked: 12
  • Likes Given: 6
Re: September predictions challenge 2019
« Reply #10 on: June 10, 2019, 06:54:38 PM »
Jaxa: 3.75-4.25, Medium
NSIDC 4.0 - 4.5, Medium

I was intending to run this again, but got distracted by a friend's death just before the polls went up (I have reached the age where such things can be expected to happen). Thanks for setting it rolling Paddy.

The one change I was intending to make was to ask for entries in subsequent months to quote entries from the previous month(s) but that's not relevant this month anyway.

b_lumenkraft

  • ASIF Upper Class
  • Posts: 1654
    • View Profile
  • Liked: 359
  • Likes Given: 1597
Re: September predictions challenge 2019
« Reply #11 on: June 10, 2019, 06:57:02 PM »
Sorry for your loss Richard.

Sterks

  • ASIF Citizen
  • Posts: 392
  • Member # 1000
    • View Profile
  • Liked: 45
  • Likes Given: 30
Re: September predictions challenge 2019
« Reply #12 on: June 10, 2019, 07:03:39 PM »
Jaxa: 3.75-4.25, Medium
NSIDC 4.0 - 4.5, Medium
Same, but thinking will be probably around the lower end. Feels like this year can beat 2016 (2nd or 3rd) easily if picks some more melting momentum before solstice

Steven

  • ASIF Citizen
  • Posts: 498
    • View Profile
  • Liked: 91
  • Likes Given: 15
Re: September predictions challenge 2019
« Reply #13 on: June 10, 2019, 08:17:35 PM »
To enter, post guess and confidence in this thread before the closing date of the poll.

When is the deadline for June predictions in this thread?  Last year the deadline was 16 June, 23:59 UTC, is it the same this year?

Paddy

  • ASIF Middle Class
  • Posts: 512
    • View Profile
  • Liked: 15
  • Likes Given: 23
Re: September predictions challenge 2019
« Reply #14 on: June 10, 2019, 10:24:03 PM »
Sure, why not.

Aluminium

  • ASIF Citizen
  • Posts: 295
    • View Profile
  • Liked: 245
  • Likes Given: 168
Re: September predictions challenge 2019
« Reply #15 on: June 11, 2019, 01:45:32 PM »
JAXA: 3.5-4.0 high.
NSIDC: 4.0-4.5 medium.

Brigantine

  • ASIF Citizen
  • Posts: 124
    • View Profile
  • Liked: 27
  • Likes Given: 123
Re: September predictions challenge 2019
« Reply #16 on: June 12, 2019, 12:19:13 AM »
June 2019

JAXA: 4.00 - 4.50 medium confidence
NSIDC: 4.25 - 4.75 medium confidence

Brigantine

  • ASIF Citizen
  • Posts: 124
    • View Profile
  • Liked: 27
  • Likes Given: 123
Re: September predictions challenge 2019
« Reply #17 on: June 12, 2019, 12:30:08 AM »
To enter, post guess and confidence in this thread before the closing date of the poll.

When is the deadline for June predictions in this thread?  Last year the deadline was 16 June, 23:59 UTC, is it the same this year?
For context, the polls last year closed:
JAXA: 2018-06-15 23h52m49s UTC
NSIDC: 2018-06-12 22h10m19s UTC

So basically the deadline for predictions was 24 hours after the later of the polls closed.

This year:
JAXA: 2019-06-11 18h24m20s UTC
NSIDC: 2019-06-11 19h45m19s UTC

I only posted in this thread some hours after the polls closed, but linked to predictions (including confidence level) I posted in the poll threads. Those posts were last edited on June 8. Please let my prediction qualify!  :)
« Last Edit: June 12, 2019, 12:35:42 AM by Brigantine »

slow wing

  • ASIF Middle Class
  • Posts: 728
    • View Profile
  • Liked: 113
  • Likes Given: 263
Re: September predictions challenge 2019
« Reply #18 on: June 12, 2019, 05:23:46 AM »
June

JAXA: 3.75 to 4.25, medium
NSIDC: 4.00 to 4.50, medium

Paddy

  • ASIF Middle Class
  • Posts: 512
    • View Profile
  • Liked: 15
  • Likes Given: 23
Re: September predictions challenge 2019
« Reply #19 on: June 15, 2019, 10:05:45 AM »
Closing tomorrow, last chance time to submit or change your prediction

jplotinus

  • ASIF Citizen
  • Posts: 116
    • View Profile
  • Liked: 3
  • Likes Given: 10
Re: September predictions challenge 2019
« Reply #20 on: June 15, 2019, 12:00:47 PM »
I had guessed there might be a June stall in extent decline, something that is now occurring. Therefore a  “high” bin was selected, which is only “high” in context of the new normal, relative to earlier decades of the satellite measurement era:

4.25-4.75 jaxa
4.50-5.00
Oh, sorry about confidence level omission. I say “low” confidence because the current stall may not last much longer and because July and August weather metrics are not foreseeable, other than temps should be above 0°.
« Last Edit: June 16, 2019, 12:08:03 AM by jplotinus »

Brigantine

  • ASIF Citizen
  • Posts: 124
    • View Profile
  • Liked: 27
  • Likes Given: 123
Re: September predictions challenge 2019
« Reply #21 on: June 15, 2019, 12:53:14 PM »
4.25-4.75 jaxa
4.50-5.00 nsidc
OK. But what confidence level?

Since there's still time, I'm revising my JAXA prediction:

June:
JAXA 3.75 - 4.25 medium confidence (down from 4.00 - 4.50 medium confidence last week)
NSIDC 4.25 - 4.75 medium confidence (no change)

Things progressed more than expected in the last week! (though not extent data)
« Last Edit: June 15, 2019, 01:05:30 PM by Brigantine »

Paddy

  • ASIF Middle Class
  • Posts: 512
    • View Profile
  • Liked: 15
  • Likes Given: 23
Re: September predictions challenge 2019
« Reply #22 on: June 15, 2019, 02:46:23 PM »
Casual ruling: if you don't submit a confidence level, I will assume medium.

gerontocrat

  • ASIF Royalty
  • Posts: 5102
    • View Profile
  • Liked: 779
  • Likes Given: 16
Re: September predictions challenge 2019
« Reply #23 on: June 15, 2019, 03:28:26 PM »
Another hostage to fortune..

JAXA Daily minimum 3.75 to 4.25 million km2 - High Confidence
NSIDC September average 4.00 to 4.50 million km2 - High Confidence

I am going for a relatively small difference between the daily and monthly figures. This is because
- it looks like the slope to minimum is usually shallower than the increase afterwards,
- and I read somewhere (I think) that a study said their model trended to later minimum dates in the future.
This would tend to bring a September average closer to the daily minimum (I think).

What if the weather was so weird it pushed the minimum date to the 1st October?
Earliest minimum 7 Sept 2016,
Latest minimum 21 Sep 2018.
Average 13 Sep. 
"Para a Causa do Povo a Luta Continua!"
"And that's all I'm going to say about that". Forrest Gump
"Damn, I wanted to see what happened next" (Epitaph)

Steven

  • ASIF Citizen
  • Posts: 498
    • View Profile
  • Liked: 91
  • Likes Given: 15
Re: September predictions challenge 2019
« Reply #24 on: June 16, 2019, 02:55:30 PM »
JAXA minimum extent:       3.5 to 4.0,  medium confidence
NSIDC September extent: 4.0 to 4.5,  medium confidence

This is based on linear regression, using the NSIDC sea ice area in mid-June as a predictor for the minimum/September extent.

Paddy

  • ASIF Middle Class
  • Posts: 512
    • View Profile
  • Liked: 15
  • Likes Given: 23
Re: September predictions challenge 2019
« Reply #25 on: June 16, 2019, 04:52:40 PM »
To enter, post guess and confidence in this thread before the closing date of the poll.

When is the deadline for June predictions in this thread?  Last year the deadline was 16 June, 23:59 UTC, is it the same this year?
For context, the polls last year closed:
JAXA: 2018-06-15 23h52m49s UTC
NSIDC: 2018-06-12 22h10m19s UTC

So basically the deadline for predictions was 24 hours after the later of the polls closed.

This year:
JAXA: 2019-06-11 18h24m20s UTC
NSIDC: 2019-06-11 19h45m19s UTC

I only posted in this thread some hours after the polls closed, but linked to predictions (including confidence level) I posted in the poll threads. Those posts were last edited on June 8. Please let my prediction qualify!  :)

Based on what's been said before, I'll be closing this poll tonight, at 23:59 UTC. It's a bit later than precedent from last year, but I'm not too fussed.

b_lumenkraft

  • ASIF Upper Class
  • Posts: 1654
    • View Profile
  • Liked: 359
  • Likes Given: 1597
Re: September predictions challenge 2019
« Reply #26 on: June 16, 2019, 05:05:09 PM »
Last chance!!

Thanks, Paddy for the poll.