August 2024 (scheduled): cascad to be featured during the 2024 Econometric Society European Meetings (Erasmus University, Rotterdam, Netherlands) during the Lunch Session on “Replication Challenges in Economics and Econometrics” Chair: Olivier Scaillet (UNIGE and SFI), with Joan Llull (IAE-CSIC and BSE), Maia Guell (CUNEF and Edinburgh), Victor Gay (TSE), and Christophe Pérignon (HEC Paris and cascad).

 

April 2024: The paper The Role of Third-Party Verification in Research Reproducibility (Pérignon, 2024) presenting cascad’s activities and discussing its business model is now forthcoming in the Harvard Data Science Review.

 

February 2024: The paper “Computational Reproducibility in Finance: Evidence from 1,000 Tests in Finance” (Pérignon et al., 2024) is now forthcoming in the Review of Financial Studies. It is a large-scale empirical analysis of the level of computational reproducibility in finance.

 

December 2023 : cascad certified the results of the paper « Reproducibility in Management Science ».

 

November 2023 : cascad featured in the CNRS Letter (see page 35).

 

September 2023 : cascad showcased in Paris during a conference organized by the CNRS on Research Replication and Reproducibility.

 

July 2023: Updated guidelines used by cascad in Exhibit 1 (see page 36).

 

July 2023: Public release of The Role of Third-Party Verification in Research Reproducibility on SSRN. It discusses the functioning, utility, comparative advantages, and challenges of third-party verification services like cascad.

 

June 2023: cascad featured on the website of the Data Editor of The Econometrics Society:
FAQ “What can I do if I am not allowed to provide temporary access to the confidential data, but a certification agency (e.g. cascad) can run the code on the original data source?”

 

May 2023: cascad co-founder Christophe Pérignon organized a Ph.D. Workshop on Research Reproducibility and Replication (RRR) at HEC Paris.

 

May 2023: cascad featured on the 2023 Report of the AEA Data Editor
”We in particular want to again thank Olivier Akmansoy, Christophe Hurlin (Université d’Orléans), and Christophe Pérignon (HEC Paris), all of cascad, a certification agency for scientific code and data, who have been generous with their time and resources, and have provided us with multiple reports during this time.”

 

April 2023: cascad co-founder Christophe Pérignon organized a Ph.D. Workshop on Research Reproducibility and Replication (RRR) at HEC Liège (Belgium).

 

February 2023: Acceptance by the Journal of Finance of Non-Standard Errors. Cascad designed and implemented the reproducibility policy of this crowd-sourcing project (#Fincap).

 

January 2023: Presentation of cascad by Christophe Pérignon to the 2023 BITTS annual meeting (Berkeley).

 

October 2022: Cascad featured on the website of the Data Editor of The Economic Journal:
FAQ: What can I do if I am not allowed to provide temporary access to the confidential data, but a certification agency (e.g. cascad) can run the code in the original data source?
This option is still generally preferred to the simulated/synthetic dataset alternative. However, you should seek approval by the Data Editor before making any commitments with the certification agency.

 

September 2022: Since November 2019, cascad has acted as a trusted third party 43 times to verify the results of papers conditionally accepted by (in decreasing order of number of verifications) the American Economic Review, American Economic Journals (AEJ): Economic Policy, Economic Journal, AEJ: Macroeconomics, American Economic Review: Insights, AEJ: Microeconomics, AEJ: Applied Economics, and the Journal of the Economic Literature.

 

June 2022: cascad co-founder Christophe Pérignon will give a keynote speech on “Research Reproducibility in Finance” at the 6th edition of the HFE conference, Ecole Hotelière de Lausanne, Suisse.

 

May 2022: cascad mentioned in the Report of the American Economic Association (AEA) Data Editor as a third-party contributor.

 

May 2022: cascad co-founder Christophe Pérignon will give a speech on “Research Reproducibility in Finance” at the PhD workshop of the 2022 annual conference of the French Finance Association in Saint-Malo, France.

 

May 2022: cascad successfully reproduced the results of a forthcoming paper based on restricted-access data from the National Longitudinal Study of Adolescent to Adult Health (Add Health, University of North Carolina). 

 

April 2022: Public release of the “Reproducibility of Empirical Results: Evidence from 1,000 Tests in Finance” working paper on SSRN. The paper analyses the data generated by cascad in the context of the #Fincap crowd-sourcing project.

 

November 2021: Public release of the “Non-Standard Errors” working paper on SSRN. Cascad co-designed and implemented the reproducibility policy of this crowd-sourcing project (#Fincap).  The #Fincap coordinators are: Albert J. Menkveld, Anna Dreber, Felix Holzmeister, Juergen Huber, Magnus Johannesson, Michael Kirchler, Michael Razen, and Utz Weitzel.

 

November 2021: cascad featured in the Knowledge Exchange report on research reproducibility: “The Art of Publishing Reproducible Research Outputs”. Link
The Knowledge Exchange partners are six key national organizations tasked with developing infrastructure and services to enable the use of digital technologies to improve higher education and research: CSC in Finland, CNRS in France, DeiC in Denmark, DFG in Germany, Jisc in the UK and SURF in the Netherlands.

 

November 2021: cascad co-founder Christophe Pérignon will give a three-hour lecture on research reproducibility in the Degree in Scientific Data Management (University of Montpellier, France). Link 

 

October 2021: cascad featured in the AEA Data Editor blog. Link

 

October 2021: cascad is pleased to announce that it conducted its 200th reproducibility verification.

 

October 2021: cascad co-founder Christophe Pérignon gave a keynote speech (Video) at the October DataFest “Love your data, share your data”, Erasmus Research Institute of Management, Rotterdam.

 

October 2021: cascad co-founder Christophe Pérignon gave a keynote speech at the 18th Corporate Finance Day on Open Science and Research Reproducibility.

 

September 2021: cascad successfully reproduced the results of a forthcoming paper based on restricted-access data from the German Socio-Economic Panel (SOEP).

 

July 2021: cascad being mentioned in a new study entitled “The Economics of Research Reproducibility” by Jean-Edouard Colliard, Christophe Hurlin and Christophe Pérignon. The latter two being cascad founders.

 

June 2021: cascad co-founder Christophe Pérignon participated in a focus group on “Publishing Reproducible Research Output” organized by Knowledge Exchange (KE), a consortium of six national organisations within Europe tasked with developing infrastructure and services to enable the use of digital technologies to improve higher education and research.

 

May 2021: cascad mentioned in the Report of the American Economic Association (AEA) Data Editor. Out of the 36 reports provided to AEA by external replicators or replication services, 21 were provided by cascad.

 

May 2021: cascad co-founder Christophe Pérignon gave the keynote speech at the 2021 HEC Liège Research Day on the following topic: “Reproducible Research in Economics and Management: Why and How”.

 

April 2021: cascad becomes a partner institution within the international #fincap project which aims to produce the first crowd-sourced empirical paper in Economics/Finance. 168 participating teams, 6 research questions, 1 single database. [watch video]

 

December 2020: cascad successfully reproduced the results of a paper based on restricted-access data from the Swedish Institute for Evaluation of Labour Market and Education Policy (IFAU).

 

December 2020: On December 8th, 2020, Christophe Pérignon (HEC Paris and cascad) discussed Research Reproducibility at the conference “Recherche scientifique et action publique” organized by CNRS and Cour des Comptes. Program

 

December 2020: Cascad is mentioned in the latest EU report on research reproducibility as an innovative tool to promote reproducible research: “In European countries, efforts have ranged from innovative efforts, such as cascad, the first public laboratory for the certification of the reproducibility of scientific research, funded by the CNRS, HEC Paris, and the University of Orléans”. Link to full report

 

November 2020: Christophe Pérignon (HEC Paris and cascad) gave a three-hour lecture on research reproducibility in the Degree in Scientific Data Management (University of Montpellier, France). Link: sdm.edu.umontpellier.fr

 

March 2020: Because of the lockdown in France, cascad operations moved entirely online. Remote access to French administrative data used by researchers was made possible by the CASD. Access to virtual machines was provided by the HEC Paris IT team. The service has remained 100% online until the end of June 2021 when part of the team was back on the HEC Paris campus.

 

February 2020: Christophe Pérignon (HEC Paris and cascad cofounder) presents cascad at the UK Data Service and Office for National Statistics (ONS) “Love your Code” conference in London.

 

December 2019: Christophe Pérignon (HEC Paris and cascad cofounder) participates in a roundtable on Research Reproducibility with Confidential Data at the INEXDA workshop on Reproducible Research and Modern Data Analysis in Porto, Portugal.

 

July 2019: Publication in Science on the importance to verify scientific results based on confidential data. Also includes a discussion of the partnership between cascad and CASD, the French restricted data access center.  Link to the paper

 

July 2019: cascad partners with CASD (Centre d'Accès Sécurisé aux Données) to allow researchers and academic journals to verify results based on French confidential, administrative data accessed through CASD. The cascad reproducibility reviewer uses the exact same raw data and same code as the researchers.

 

July 2019: Official launch of cascad.tech.

 

June 2019: Christophe Pérignon (HEC Paris and cascad cofounder) participates in a roundtable on “New Perspective for reproducible research in economics” at the Annual Meeting of the French Economics Association in Orléans, France.