Download
1 / 2
20 likes | 155 Vues
On July 10, 2013, the ILG made a crucial decision regarding model changes, stating that no model changes will be permitted by any proponent from that point forward, including already submitted requests. The decision was influenced by the desire to retain an ethical stance consistent with the original test plan, though it was not unanimous. The ILG acknowledged challenges in limiting model changes fairly and emphasized the importance of conducting statistical analyses within their framework. Proponents can withdraw their model from re-buffering. ACREO's test will also involve re-buffering.
E N D
ILGDecision July 10, 2013 Margaret Pinson & Philip Corriveau
Decision on Model Changes • No Model Changes are allowed by any proponent from this point forward, including already submitted requests. • Decisions were made primarily on retaining an ethical position to uphold the intentions of the test plan • Was not a unanimous decision • ILG will be sensitive to models that crash within the framework of how the ILG conducts the statistical analysis • There was no identified fair and unbiased way to ensure that model changes were limited to the parser only • Proponents have the option to withdrawn their model from re-buffering only. • The ILG would like ACREO’s test to include re-buffering in the test There was no easy way to approach this decision that would satisfy everyone
