Hi Admins,

Will there be a separate set of flights to optimize for the milestone prize or is it just who is highest on the LB on 25th of sept wins?

(I don't see any mention of such a new set on the data page (get the data), on the other hand there is talk about a private LB for the milestone prize on the prizes page)

Thanks

I'm not an admin (who are few and far between on this forum :( ), and I could be wrong, but I'm not expecting any further set of flights for the milestone prize. As far as I know, what we've got is all we're getting. The reference to a 'private' leaderboard is probably a reference to the 70% of the flights that don't contribute to the public leaderboard score, but which are actually used for the eventual awarding of the milestone prize.

I have the simulator working for the single day provided (4th July). However can someone please confirm that the data required to run the simulator for the milestone test flights (5th July onwards) has not been provided to us? It is still necessary to do a submission to the website to get a score for the milestone test, right??  (or am I missing something?)

We were promised a set of routines and logic to create those required input files for the simulator (for the milestone data set). When are they due??

Thanks!

Dave is correct; this current set of flights will be used for the milestone. 

Dave, we've just released some weather day for each day.  We're still working on getting the creation logic in a releasable form. 

The current leaderboard is built off of 7 out of the 14 days of flights for which you are submitting route recommendations. The milestone prize will be awarded based on the 7 days of flights that are not being used to construct the current leaderboard.

Are we going to get these 7 days of flights that are not being used to construct the current leaderboard before the milestone or someone from Kaggle are going to run our algorithm against these hidden data? 

Also what if my system is built very complex, and it is not an easy work to configure only from the source code?

The file testFlightsRev3.csv has all the flights that you will need to provide routes for, all flights for the 14 days. So you already have the 7 days you refer to. What you do not know is which 7 days are for the public leaderboard and which are for the private leaderboard.

Not sure exactly what you mean here, but it's possible that your system may be complex. Might be useful to you to make sure you have comments and documentation to keep track of things as you continue to work on the competition.

...which would be trivial to figure out if someone wanted to.

The leaderboard page says:

This leaderboard is calculated on approximately 29% of the test data.
The final results will be based on the other 71%, so the final standings may be different.

7 days out of 14 doesn't look like 29% to me

50% is the correct separation.  I've updated the text on the leaderboard.