In our E&E article, we referred to the fact that the American Economic Review (AER) has adopted a policy for requiring authors to archive source code and data at the time of submission. These policies are online and worth looking at in detail. My attention to this online URL is due to Joseph Potts, who has made frequent comments on posts here and who has written a comment about our work and data/code policy which explicitly links to the AER policies.
The AER policy states:
It is the policy of the American Economic Review to publish papers only if the data used in the analysis are clearly and precisely documented and are readily available to any researcher for purposes of replication. Authors of accepted papers that contain empirical work, simulations, or experimental work must provide to the Review, prior to publication, the data, programs, and other details of the computations sufficient to permit replication. These will be posted on the AER Web site.
The detailed policy goes on to say:
For econometric and simulation papers, the minimum requirement should include the data set(s) and programs used to run the final models, plus a description of how previous intermediate data sets and programs were employed to create the final data set(s). Authors are invited to submit these intermediate data files and programs as an option; if they are not provided, authors must fully cooperate with investigators seeking to conduct a replication who request them. The data files and programs can be provided in any format using any statistical package or software, but a Readme PDF file documenting the purpose and format of each file provided, and instructing a user on how replication can be conducted, should also be provided.
Compare that with Mann’s comments to the Wall Street Journal:
Dr. Mann refuses to release [the source code]. "Giving them the algorithm would be giving in to the intimidation tactics that these people are engaged in," he says.
I see no reason why journals publishing paleoclimate articles should not adopt a policy identical to AER. We voluntarily complied with an AER-type policy by submitting source code and data together with submission, which are archived here.