References

“26.4. Unittest — Unit Testing Framework — Python 3.5.2 Documentation.” Accessed November 23, 2016. https://docs.python.org/3.5/library/unittest.html.

“Accessibility - W3C.” Accessed June 15, 2016. https://www.w3.org/standards/webdesign/accessibility#wai.

“Agile Project Management.” Accessed October 20, 2016. https://www.pivotaltracker.com/.

“A JavaScript Library for Building User Interfaces - React.” Accessed October 26, 2016. https://facebook.github.io/react/.

Alter, George, George C Banks, Denny Borsboom, Sara D Bowman, Steven J Breckler, Stuart Buck, Chris Chambers, et al. Transparency and Openness Promotion (TOP) Guidelines. Open Science Framework, 2016. osf.io/9f6gx.

“Apache Subversion.” Accessed October 19, 2016. https://subversion.apache.org/.

“API Blueprint | API Blueprint.” Accessed October 20, 2016. https://apiblueprint.org/.

Atlassian. “Bitbucket | The Git Solution for Professional Teams.” Bitbucket. Accessed October 20, 2016. https://bitbucket.org/.

“Backbone.js.” Accessed October 26, 2016. http://backbonejs.org/.

“Best Practice Library | Section508.gov.” Accessed May 24, 2016. http://section508.gov/content/learn/best-practice-library.

“Bootstrap · The World’s Most Popular Mobile-First and Responsive Front-End Framework.” Accessed October 20, 2016. http://getbootstrap.com/.

Brutlag, Jake. “Speed Matters.” Google Research Blog, June 23, 2009. https://research.googleblog.com/2009/06/speed-matters.html.

Burger, Matthias, Klaus Juenemann, and Thomas Koenig. RUnit: R Unit Test Framework (version 0.4.31), 2015. https://cran.r-project.org/web/packages/RUnit/index.html.

Burgess, Annie. “2015 AIST Evaluations Overview.” Federation of Earth Science Information Partners, 2016. http://testbed.esipfed.org/sites/default/files/2015_AIST_Evaluations_Overview.pdf.

Car, Nicholas. “Data Reuse Fitness Assessment Using Provenance.” Denver, CO, 2016. http://www.scidatacon.org/2016/sessions/53/paper/47/.

“Center for Trustworthy Scientific Cyberinfrastructure.” Center for Trustworthy Scientific Cyberinfrastructure. Accessed May 24, 2016. http://trustedci.org/.

“Chef – Embrace DevOps.” Chef. Accessed October 20, 2016. https://www.chef.io/.

“Choose an Open Source License.” Choose a License. Accessed June 13, 2016. http://choosealicense.com/.

“CLAHub.” Contributor License Agreements on Github. Accessed May 24, 2016. https://www.clahub.com/.

“Code Conventions for the Java Programming Language: Contents,” 1999. http://www.oracle.com/technetwork/java/codeconvtoc-136057.html.

“Code, Test, and Deploy Together with GitLab Open Source Git Repo Management Software.” GitLab. Accessed October 20, 2016. https://about.gitlab.com/.

“Continuous Integration and Delivery.” CircleCI. Accessed June 15, 2016. https://circleci.com/.

“Coverity - Static Code Analysis (SAST).” Accessed October 20, 2016. http://www.synopsys.com/software-integrity/products/static-code-analysis.html.

“Creative Commons.” Creative Commons. Accessed June 16, 2016. https://creativecommons.org/.

“CRediT.” CASRAI, April 18, 2016. http://casrai.org/credit.

Crockford, Douglas. “JSLint.” GitHub, October 20, 2015. https://github.com/douglascrockford/JSLint.

“CWICSmart A Programmatic OpenSearch Client.” Accessed June 15, 2016. http://testbed.echo.nasa.gov/cwic-smart/validations.

“Daring Fireball: Markdown.” Accessed October 20, 2016. https://daringfireball.net/projects/markdown/.

“DASPOS.” Accessed May 24, 2016. https://daspos.crc.nd.edu/.

“Docker.” Docker. Accessed June 14, 2016. http://www.docker.com/.

“Draft U.S. Web Design Standards Documentation | UI Components.” Accessed October 20, 2016. https://standards.usa.gov/.

“ECO-OP.” ECO-OP Repository, 2015. https://github.com/tetherless-world/ecoop.

Eghbal, Nadia. “Contributing Guides: A Template,” n.d. https://github.com/nayafia/contributing-template.

Ehmke, Coraline Ada. “Contributor Covenant: A Code of Conduct for Open Source Projects.,” 2014. http://contributor-covenant.org/.

“Ember.js: A Framework for Creating Ambitious Web Applications.” Accessed October 26, 2016. http://emberjs.com/.

“End-to-End-provenance/RDataTracker.” GitHub. Accessed October 20, 2016. https://github.com/End-to-end-provenance/RDataTracker.

Fielding, Roy T. “Architectural Styles and the Design of Network-Based Software Architectures.” University of California, Irvine, 2000. https://www.ics.uci.edu/~fielding/pubs/dissertation/top.htm.

“Foundation | The Most Advanced Responsive Front-End Framework in the World.” Accessed October 20, 2016. http://foundation.zurb.com/.

Fowler, Martin. “Continuous Integration.” Martinfowler.com. Accessed June 15, 2016. http://martinfowler.com/articles/continuousIntegration.html.

———. “Mocks Aren’t Stubs.” Martinfowler.com, January 2, 2007. http://martinfowler.com/articles/mocksArentStubs.html.

Gil, Yolanda, Cédric H. David, Ibrahim Demir, Bakinam T. Essawy, Robinson W. Fulweiler, Jonathan L. Goodall, Leif Karlstrom, et al. “Towards the Geoscience Paper of the Future: Best Practices for Documenting and Sharing Research from Data to Software to Provenance.” Earth and Space Science, July 1, 2016, 2015EA000136. doi:10.1002/2015EA000136.

“Git.” Accessed October 19, 2016. https://git-scm.com/.

“GNU Coding Standards: Releases.” Accessed June 14, 2016. https://www.gnu.org/prep/standards/html_node/Releases.html#index-version-numbers_002c-for-releases.

“Google Analytics Solutions - Web Analytics & Marketing Measurement – Google.” Accessed October 20, 2016. https://www.google.com/analytics/#?modal_active=none.

“Google VSAQ: Vendor Security Assessment Questionnaire.” Google VSAQ. Accessed May 24, 2016. https://github.com/google/vsaq.

“Graceful Degradation versus Progressive Enhancement - W3C Wiki.” Accessed June 16, 2016. https://www.w3.org/wiki/Graceful_degradation_versus_progressive_enhancement.

Graybeal, John. “ESIP Technology Evaluation Framework Final Recommendations,” January 2016. http://wiki.esipfed.org/images/7/73/ESIP_Technology_Evaluation_Framework_Recommendations.pdf.

Hettrick, Simon. “Research Software Sustainability: Report on a Knowledge Exchange Workshop.” The Software Sustainability Institute, February 2016. http://repository.jisc.ac.uk/6332/1/Research_Software_Sustainability_Report_on_KE_Workshop_Feb_2016_FINAL.pdf.

Holdren, John P. “Increasing Access to the Results of Federally Funded Scientific Research,” February 22, 2013. https://www.whitehouse.gov/sites/default/files/microsites/ostp/ostp_public_access_memo_2013.pdf.

“Home | Open API Initiative.” Accessed October 20, 2016. https://openapis.org/.

“InCommon Certificate Service.” Accessed June 14, 2016. https://www.incommon.org/certificates/.

Jackson, Mike, Steve Crouch, and Rob Baxter. “Software Evaluation: Criteria-Based Assessment.” Software Sustainability Institure, November 2011. http://software.ac.uk/sites/default/files/SSI-SoftwareEvaluationCriteria.pdf.

“Jenkins.” Accessed June 15, 2016. https://jenkins.io/index.html.

@jlevy. “Jlevy/ghizmo.” GitHub. Accessed October 25, 2016. https://github.com/jlevy/ghizmo.

“Journal of Open Research Software.” Accessed October 17, 2016. http://openresearchsoftware.metajnl.com/.

jquery.org, jquery Foundation-. “jQuery.” Accessed October 26, 2016. https://jquery.com/.

“Jupyter Notebook Viewer.” Accessed October 27, 2016. https://nbviewer.jupyter.org/.

Kudrjavets, Gunnar, Nachi Nagappan, and Tom Ball. “Assessing the Relationship between Software Assertions and Code Quality: An Empirical Investigation.” Microsoft Research, May 1, 2006. https://www.microsoft.com/en-us/research/publication/assessing-the-relationship-between-software-assertions-and-code-qualityan-empirical-investigation/.

“Let’s Encrypt - Free SSL/TLS Certificates.” Accessed June 14, 2016. https://letsencrypt.org/.

“Licenses & Standards | Open Source Initiative.” Accessed October 20, 2016. https://opensource.org/licenses.

“Linux Containers.” Accessed October 20, 2016. https://linuxcontainers.org/.

Marcotte, Ethan. “Responsive Web Design.” Accessed June 16, 2016. http://alistapart.com/article/responsive-web-design.

Ma, Xiaogang, Stace E. Beaulieu, Linyun Fu, Peter Fox, Massimo Di Stefano, and Patrick West. “Documenting Provenance for Reproducible Marine Ecosystem Assessment in Open Science.” In Oceanographic and Marine Cross-Domain Data Management for Sustainable Development, edited by Paolo Diviacco, Adam Leadbetter, and Helen Glaves, 100–126. Hershey, PA, 2017. http://www.igi-global.com/chapter/documenting-provenance-for-reproducible-marine-ecosystem-assessment-in-open-science/166838.

“Mercurial SCM.” Accessed October 19, 2016. https://www.mercurial-scm.org/.

“Nagios - The Industry Standard In IT Infrastructure Monitoring.” Nagios. Accessed October 20, 2016. https://www.nagios.org/.

Narla, Chaitali, and Diego Salas. “Hermetic Servers.” Google Testing Blog, October 3, 2012. https://testing.googleblog.com/2012/10/hermetic-servers.html.

“NASA Technology Readiness Levels,” October 28, 2012. https://www.nasa.gov/directorates/heo/scan/engineering/technology/txt_accordion1.html.

Oosterhof, Nikolaas N. “MOxUnit/MOxUnit.” GitHub. Accessed November 23, 2016. https://github.com/MOxUnit/MOxUnit.

“OS X Human Interface Guidelines: Designing for Yosemite.” Accessed June 14, 2016. https://developer.apple.com/library/mac/documentation/UserExperience/Conceptual/OSXHIGuidelines/.

“OWASP.” The Open Web Application Security Project. Accessed May 24, 2016. https://www.owasp.org/index.php/Main_Page.

@potch. “No Maintenance Intended,” 2016. http://unmaintained.tech/.

Priem, J., D. Taraborelli, P. Groth, and C. Neylon. “Altmetrics: A Manifesto.” Altmetrics: A Manifesto, October 26, 2010. http://altmetrics.org/manifesto/.

“Project Jupyter.” Accessed October 27, 2016. http://www.jupyter.org.

“PROV-Overview.” Accessed September 27, 2016. https://www.w3.org/TR/prov-overview/.

“ProvStore - a Free Provenance Repository.” Accessed September 27, 2016. https://provenance.ecs.soton.ac.uk/store/.

“Puppet - The Shortest Path to Better Software.” Puppet. Accessed October 20, 2016. https://puppet.com/.

“Pylint,” 2016. https://www.pylint.org/.

“QGIS: Developing Python Plugins.” Accessed June 15, 2016. http://docs.qgis.org/testing/en/docs/pyqgis_developer_cookbook/plugins.html.

“QuickCheck: Automatic Testing of Haskell Programs.” Accessed October 20, 2016. https://hackage.haskell.org/package/QuickCheck.

“RAML.” RAML. Accessed June 15, 2016. http://raml.org/.

Ratnakar, Varun, and Yolanda Gil. “Ontosoft.” Ontosoft. Accessed May 24, 2016. http://ontosoft.org/ontology/software/.

“Read the Docs.” Accessed June 15, 2016. https://readthedocs.org/.

“Recipy/recipy.” GitHub. Accessed October 20, 2016. https://github.com/recipy/recipy.

Regehr, John. “Use of Assertions – Embedded in Academia,” February 2, 2014. http://blog.regehr.org/archives/1091.

“reStructuredText.” Accessed June 15, 2016. http://docutils.sourceforge.net/rst.html.

“R Notebooks.” Accessed October 27, 2016. http://rmarkdown.rstudio.com/r_notebooks.html.

“Roads and Bridges: The Unseen Labor Behind Our Digital Infrastructure.” Ford Foundation. Accessed July 15, 2016. http://www.fordfoundation.org/library/reports-and-studies/roads-and-bridges-the-unseen-labor-behind-our-digital-infrastructure/.

“R: The R Project for Statistical Computing.” Accessed October 19, 2016. https://www.r-project.org/.

“Selenium - Web Browser Automation.” Accessed June 15, 2016. http://www.seleniumhq.org/.

“Semantic Versioning 2.0.0.” Accessed May 24, 2016. http://semver.org/.

Smith, Arfon M., Daniel S. Katz, Kyle E. Niemeyer, and FORCE11 Software Citation Working Group. “Software Citation Principles.” PeerJ Computer Science 2 (September 19, 2016): e86. doi:10.7717/peerj-cs.86.

SoftwareX. Accessed June 16, 2016. http://www.journals.elsevier.com/softwarex/.

“SourceClear: Security for Open-Source Code.” SourceClear. Accessed October 20, 2016. https://www.sourceclear.com/.

“Sphinx 1.4.4 Documentation.” Accessed June 15, 2016. http://www.sphinx-doc.org/en/stable/index.html.

Stodden, Victoria, and Sheila Miguez. “Best Practices for Computational Science: Software Infrastructure and Environments for Reproducible and Extensible Research.” Journal of Open Research Software 2, no. 1 (July 9, 2014). doi:10.5334/jors.ay.

“Substack/tape.” GitHub. Accessed November 23, 2016. https://github.com/substack/tape.

“Swagger – The World’s Most Popular Framework for APIs.” Accessed June 15, 2016. http://swagger.io/.

“Taverna - Open Source and Domain Independent Workflow Management System.” Accessed September 27, 2016. http://www.taverna.org.uk/.

“TEAM Engine: OGC Validator.” Accessed June 15, 2016. http://cite.opengeospatial.org/teamengine/.

“Testing - The Go Programming Language.” Accessed November 23, 2016. https://golang.org/pkg/testing/.

“The Elastic Stack.” Products. Accessed October 20, 2016. https://www.elastic.co/products.

“The Journal of Open Source Software,” n.d. http://joss.theoj.org/.

“The Julia Language.” Accessed October 17, 2016. http://julialang.org/.

“The Kepler Project — Kepler.” Accessed September 27, 2016. https://kepler-project.org/.

“The Software Credit Ontology.” Accessed August 15, 2016. https://dagstuhleas.github.io/SoftwareCreditRoles/doc/index-en.html.

“Travis CI - Test and Deploy Your Code with Confidence.” Accessed June 15, 2016. https://travis-ci.org/.

“Trello.” Accessed October 20, 2016. https://trello.com.

Uhlir, P. (ed.), G. (ed.) Clement, and RDA-CODATA Legal Interoperability Interest Group. “Legal Interoperability Principles and Implementation Guidelines_Final.pdf.” Research Data Alliance & CODATA, September 8, 2016. https://rd-alliance.org/sites/default/files/attachment/Legal%20Interoperability%20Principles%20and%20Implementation%20Guidelines_Final.pdf.

“Understanding the GitHub Flow · GitHub Guides.” Accessed June 15, 2016. https://guides.github.com/introduction/flow/.

“Using OAuth 2.0 to Access Google APIs | Google Identity Platform.” Google Developers. Accessed October 20, 2016. https://developers.google.com/identity/protocols/OAuth2.

“Vagrant by HashiCorp.” Accessed October 20, 2016. https://www.vagrantup.com/.

“VisTrails.” Accessed September 27, 2016. https://www.vistrails.org/index.php/Main_Page.

“WAI-ARIA Overview.” Accessed June 16, 2016. https://www.w3.org/WAI/intro/aria.php.

“Watir.com.” Watir.com. Accessed November 27, 2016. https://watir.com/.

“WCAG Overview.” Accessed May 24, 2016. https://www.w3.org/WAI/intro/wcag.

@weavejester. “Codox.” Codox: Clojure Documentation Tool. Accessed June 15, 2016. https://github.com/weavejester/codox.

“Web Accessibility Initiative.” Accessed May 24, 2016. https://www.w3.org/standards/webdesign/accessibility.

“Web Analytics Basics,” October 8, 2013. https://www.usability.gov/what-and-why/web-analytics.html.

Sustainable Code

“26.4. Unittest — Unit Testing Framework — Python 3.5.2 Documentation.” Accessed November 23, 2016. https://docs.python.org/3.5/library/unittest.html.

Ambler, Scott. “Introduction to Test Driven Development (TDD),” April 19, 2013. http://agiledata.org/essays/tdd.html.

Beck, K. Test-Driven Development by Example. Addison Wesley, 2003.

“Best Practices Criteria for Free/Libre and Open Source Software (FLOSS) (version 0.8.0).” Linux Foundation, n.d. https://github.com/linuxfoundation/cii-best-practices-badge/blob/master/doc/criteria.md.

Burger, Matthias, Klaus Juenemann, and Thomas Koenig. RUnit: R Unit Test Framework (version 0.4.31), 2015. https://cran.r-project.org/web/packages/RUnit/index.html.

“Code Conventions for the Java Programming Language: Contents,” 1999. http://www.oracle.com/technetwork/java/codeconvtoc-136057.html.

“Computational Infrastructure for Geodynamics :: Best Practices.” Accessed June 12, 2016. https://geodynamics.org/cig/dev/best-practices.

“Conda Kapsel Tutorial — Conda Documentation.” Accessed July 13, 2016. http://conda.pydata.org/docs/kapsel/.

“Continuous Integration and Delivery.” CircleCI. Accessed June 15, 2016. https://circleci.com/.

“Cookiecutter Data Science.” Accessed October 31, 2016. https://drivendata.github.io/cookiecutter-data-science/.

Crockford, Douglas. “JSLint.” GitHub, October 20, 2015. https://github.com/douglascrockford/JSLint.

“Docker.” Docker. Accessed June 14, 2016. http://www.docker.com/.

“Falsehoods Programmers Believe About Names.” Kalzumeus Software, June 17, 2010. https://www.kalzumeus.com/2010/06/17/falsehoods-programmers-believe-about-names/.

Forsgren, Nicole, and Jez Humble. “The Role of Continuous Delivery in IT and Organizational Performance.” SSRN Scholarly Paper. Rochester, NY: Social Science Research Network, October 27, 2015. http://papers.ssrn.com/abstract=2681909.

Fowler, Martin. “Continuous Integration.” Martinfowler.com. Accessed June 15, 2016. http://martinfowler.com/articles/continuousIntegration.html.

———. “Mocks Aren’t Stubs.” Martinfowler.com, January 2, 2007. http://martinfowler.com/articles/mocksArentStubs.html.

Fucci, Davide, Giuseppe Scanniello, Simone Romano, Martin Shepperd, Boyce Sigweni, Fernando Uyaguari, Burak Turhan, Natalia Juristo, and Markku Oivo. “An External Replication on the Effects of Test-Driven Development Using a Multi-Site Blind Analysis Approach.” In Proceedings of the 10th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement, 3:1–3:10. ESEM ’16. New York, NY, USA: ACM, 2016. doi:10.1145/2961111.2962592.

“GNU Coding Standards: Releases.” Accessed June 14, 2016. https://www.gnu.org/prep/standards/html_node/Releases.html#index-version-numbers_002c-for-releases.

Groen, Derek, Xiaohu Guo, James A. Grogan, Ulf D. Schiller, and James M. Osborne. “Software Development Practices in Academia: A Case Study Comparison.” arXiv:1506.05272 [physics], June 17, 2015. http://arxiv.org/abs/1506.05272.

Guo, Philip. “The Benefits of Programming with Assertions (a.k.a. Assert Statements),” June 2008. http://pgbovine.net/programming-with-asserts.htm.

“HumanOps/HumanOps.” GitHub. Accessed July 15, 2016. https://github.com/HumanOps/HumanOps.

invadmin. “The beginner’s guide to BDD.” Text. Inviqa, October 7, 2015. https://inviqa.com/blog/bdd-guide.

“Jenkins.” Accessed June 15, 2016. https://jenkins.io/index.html.

“Jupyter Notebook Best Practices for Data Science.” Accessed October 27, 2016. http://www.kdnuggets.com/2016/10/jupyter-notebook-best-practices-data-science.html?utm_content=buffer6e24a&utm_medium=social&utm_source=twitter.com&utm_campaign=buffer.

“Jupyter Notebook Viewer.” Accessed October 27, 2016. https://nbviewer.jupyter.org/.

“Just Say No to More End-to-End Tests.” Google Testing Blog. Accessed October 18, 2016. https://testing.googleblog.com/2015/04/just-say-no-to-more-end-to-end-tests.html.

Kanewala, Upulee, and James M. Bieman. “Testing Scientific Software: A Systematic Literature Review.” Information and Software Technology 56, no. 10 (October 2014): 1219–32. doi:10.1016/j.infsof.2014.05.006.

Kelly, Diane. “Scientific Software Development Viewed as Knowledge Acquisition: Towards Understanding the Development of Risk-Averse Scientific Software.” Journal of Systems and Software 109 (November 2015): 50–61. doi:10.1016/j.jss.2015.07.027.

“Mozilla Developer Guide > Coding Style.” Mozilla Developer Network, 2016. https://developer.mozilla.org/en-US/docs/Mozilla/Developer_guide/Coding_Style.

Munir, Hussan, Krzysztof Wnuk, Kai Petersen, and Misagh Moayyed. “An Experimental Evaluation of Test Driven Development vs. Test-Last Development with Industry Professionals,” 1–10. ACM Press, 2014. doi:10.1145/2601248.2601267.

Narla, Chaitali, and Diego Salas. “Hermetic Servers.” Google Testing Blog, October 3, 2012. https://testing.googleblog.com/2012/10/hermetic-servers.html.

Oosterhof, Nikolaas N. “MOxUnit/MOxUnit.” GitHub. Accessed November 23, 2016. https://github.com/MOxUnit/MOxUnit.

“Project Jupyter.” Accessed October 27, 2016. http://www.jupyter.org.

“Pylint,” 2016. https://www.pylint.org/.

Regehr, John. “Use of Assertions – Embedded in Academia,” February 2, 2014. http://blog.regehr.org/archives/1091.

“R Notebooks.” Accessed October 27, 2016. http://rmarkdown.rstudio.com/r_notebooks.html.

“Selenium - Web Browser Automation.” Accessed June 15, 2016. http://www.seleniumhq.org/.

“Semantic Versioning 2.0.0.” Accessed May 24, 2016. http://semver.org/.

Smith, NJ. “Sempervirens.” GitHub. Accessed June 16, 2016. https://github.com/njsmith/sempervirens.

“Software Testing and Static Analysis Tools | Coverity.” Synopsys. Accessed June 15, 2016. http://www.coverity.com/.

“Stealing Google’s Coding Practices for Academia.” Stealing Google’s Coding Practices for Academia. Accessed May 24, 2016. https://da-data.blogspot.com/2016/04/stealing-googles-coding-practices-for.html.

“Substack/tape.” GitHub. Accessed November 23, 2016. https://github.com/substack/tape.

“Testing - The Go Programming Language.” Accessed November 23, 2016. https://golang.org/pkg/testing/.

“The Travis CI Blog: What We Learned about Continuous Integration from Analyzing 2+ Million Travis Builds.” Accessed August 6, 2016. https://blog.travis-ci.com/2016-07-28-what-we-learned-from-analyzing-2-million-travis-builds/.

“Travis CI - Test and Deploy Your Code with Confidence.” Accessed June 15, 2016. https://travis-ci.org/.

“Unit Tests, How to Write Testable Code and Why It Matters.” Toptal Engineering Blog. Accessed October 18, 2016. https://www.toptal.com/qa/how-to-write-testable-code-and-why-it-matters.

Whitmore, Jonathan. “Jupyter Notebook Best Practices for Data Science.” Silicon Valley Data Science, September 10, 2015. http://svds.com/jupyter-notebook-best-practices-for-data-science/.

Wiggins, Adam. “The Twelve-Factor App,” 2012. http://12factor.net/.

Wilson, Greg, D. A. Aruliah, C. Titus Brown, Neil P. Chue Hong, Matt Davis, Richard T. Guy, Steven H. D. Haddock, et al. “Best Practices for Scientific Computing.” PLOS Biol 12, no. 1 (January 7, 2014): e1001745. doi:10.1371/journal.pbio.1001745.

Yuan, Ding, Yu Luo, Xin Zhuang, Guilherme Renna Rodrigues, Xu Zhao, Yongle Zhang, Pranay U. Jain, and Michael Stumm. “Simple Testing Can Prevent Most Critical Failures: An Analysis of Production Failures in Distributed Data-Intensive Systems.” In Proceedings of the 11th USENIX Conference on Operating Systems Design and Implementation, 249–65. OSDI’14. Berkeley, CA, USA: USENIX Association, 2014. http://dl.acm.org/citation.cfm?id=2685048.2685068.

“Watir.com.” Watir.com. Accessed November 27, 2016. https://watir.com/.

“Zeppelin.” Accessed October 25, 2016. http://zeppelin.apache.org/.

Interoperable

“CWICSmart A Programmatic OpenSearch Client.” Accessed June 15, 2016. http://testbed.echo.nasa.gov/cwic-smart/validations.

“EarthCube Cross-Domain Interoperability Roadmap | EarthCube.” Accessed June 4, 2016. http://earthcube.org/document/2012/earthcube-cross-domain-interoperability-roadmap.

Fang, Jun, Songlin Hu, and Yanbo Han. “A Service Interoperability Assessment Model for Service Composition.” In 2004 IEEE International Conference on Services Computing, 2004. (SCC 2004). Proceedings, 153–58, 2004. doi:10.1109/SCC.2004.1358002.

Mader, Christian, Bernhard Haslhofer, and Antoine Isaac. “Finding Quality Issues in SKOS Vocabularies.” In Theory and Practice of Digital Libraries, edited by Panayiotis Zaphiris, George Buchanan, Edie Rasmussen, and Fernando Loizides, 7489:222–33. Berlin, Heidelberg: Springer Berlin Heidelberg, 2012. http://link.springer.com/10.1007/978-3-642-33290-6_25.

“Open Services for Lifecycle Collaboration.” Accessed May 24, 2016. http://open-services.net/.

Rezaei, Reza, Thiam-kian Chiew, and Sai-peck Lee. “A Review of Interoperability Assessment Models.” Journal of Zhejiang University SCIENCE C 14, no. 9 (September 6, 2013): 663–81. doi:10.1631/jzus.C1300013.

“TEAM Engine: OGC Validator.” Accessed June 15, 2016. http://cite.opengeospatial.org/teamengine/.

Wang, Wenguang, Andreas Tolk, and Weiping Wang. “The Levels of Conceptual Interoperability Model: Applying Systems Engineering Principles to M&S.” In SpringSim’09 Proceedings. San Diego, CA, 2009. https://arxiv.org/pdf/0908.0191.pdf.

Zaveri, Amrapali, Anisa Rula, Andrea Maurino, Ricardo Pietrobon, Jens Lehmann, and Sören Auer. “Quality Assessment for Linked Data: A Survey: A Systematic Literature Review and Conceptual Framework.” Edited by Pascal Hitzler. Semantic Web 7, no. 1 (March 17, 2015): 63–93. doi:10.3233/SW-150175.

Usable

“Accessibility - W3C.” Accessed June 15, 2016. https://www.w3.org/standards/webdesign/accessibility#wai.

“A JavaScript Library for Building User Interfaces - React.” Accessed October 26, 2016. https://facebook.github.io/react/.

“Backbone.js.” Accessed October 26, 2016. http://backbonejs.org/.

“Best Practice Library | Section508.gov.” Accessed May 24, 2016. http://section508.gov/content/learn/best-practice-library.

“Bootstrap · The World’s Most Popular Mobile-First and Responsive Front-End Framework.” Accessed October 20, 2016. http://getbootstrap.com/.

Brutlag, Jake. “Speed Matters.” Google Research Blog, June 23, 2009. https://research.googleblog.com/2009/06/speed-matters.html.

“Dequelabs/axe-Core.” GitHub. Accessed August 7, 2016. https://github.com/dequelabs/axe-core.

“Draft U.S. Web Design Standards Documentation | UI Components.” Accessed October 20, 2016. https://standards.usa.gov/.

“Ember.js: A Framework for Creating Ambitious Web Applications.” Accessed October 26, 2016. http://emberjs.com/.

“Foundation | The Most Advanced Responsive Front-End Framework in the World.” Accessed October 20, 2016. http://foundation.zurb.com/.

“Graceful Degradation versus Progressive Enhancement - W3C Wiki.” Accessed June 16, 2016. https://www.w3.org/wiki/Graceful_degradation_versus_progressive_enhancement.

“Guide to WS-Agreement Model & Protocol.” Accessed June 14, 2016. http://wsag4j.sourceforge.net/site/wsag/overview.html.

Hogan, Lara Callender. “Designing for Performance by Lara Callender Hogan.” Accessed October 7, 2016. http://designingforperformance.com/.

jenniferc. “Service Level Agreement Examples: A Total Must for Your Business and Mine!” Udemy Blog. Accessed June 14, 2016. https://blog.udemy.com/service-level-agreement-examples/.

jquery.org, jquery Foundation-. “jQuery.” Accessed October 26, 2016. https://jquery.com/.

Marcotte, Ethan. “Responsive Web Design.” Accessed June 16, 2016. http://alistapart.com/article/responsive-web-design.

“OS X Human Interface Guidelines: Designing for Yosemite.” Accessed June 14, 2016. https://developer.apple.com/library/mac/documentation/UserExperience/Conceptual/OSXHIGuidelines/.

Pernice, Kara, and Jakob Nielsen. “Usability Guidelines for Accessible Web Design: Based on Usability Studies with People Using Assistive Technology.” Nielsen Norman Group, 2001. http://www.nngroup.com/reports/usability-guidelines-accessible-web-design.

“SLA@SOI.” Accessed June 14, 2016. http://sla-at-soi.eu/.

“Twitter API Rate Limits.” Twitter Developers, 2016. https://dev.twitter.com/rest/public/rate-limiting.

“WAI-ARIA Overview.” Accessed June 16, 2016. https://www.w3.org/WAI/intro/aria.php.

“WCAG Overview.” Accessed May 24, 2016. https://www.w3.org/WAI/intro/wcag.

“Web Accessibility Initiative.” Accessed May 24, 2016. https://www.w3.org/standards/webdesign/accessibility.

“WPO Stats.” Accessed September 3, 2016. https://wpostats.com/.

Documented

“18F Handbook - Table of Contents.” Accessed September 12, 2016. https://handbook.18f.gov/.

“BackHub - Backup and Archive Your GitHub Repositories.” Accessed September 5, 2016. https://backhub.co/.

Baumann, Ryan. “Thinking about Archival and Migration for GitHub.” Ryan Baumann - /etc, August 31, 2016. https://ryanfb.github.io/etc/2016/08/31/thinking_about_archival_and_migration_for_github.html.

@benbalter. “Benbalter/github-Records-Archiver.” GitHub. Accessed September 5, 2016. https://github.com/benbalter/github-records-archiver.

“Conda Kapsel Tutorial — Conda Documentation.” Accessed July 13, 2016. http://conda.pydata.org/docs/kapsel/.

“Draft U.S. Web Design Standards | Draft U.S. Web Design Standards.” Accessed June 16, 2016. https://standards.usa.gov/.

“Introduction - 18F Open Source Style Guide.” Accessed June 16, 2016. https://pages.18f.gov/open-source-guide/.

“Keep a Changelog.” Accessed October 6, 2016. http://keepachangelog.com/en/0.3.0/.

@noffle. “Noffle/art-of-Readme.” GitHub. Accessed October 7, 2016. https://github.com/noffle/art-of-readme.

“RAML.” RAML. Accessed June 15, 2016. http://raml.org/.

“Read the Docs.” Accessed June 15, 2016. https://readthedocs.org/.

“reStructuredText.” Accessed June 15, 2016. http://docutils.sourceforge.net/rst.html.

“Sphinx 1.4.4 Documentation.” Accessed June 15, 2016. http://www.sphinx-doc.org/en/stable/index.html.

“Swagger – The World’s Most Popular Framework for APIs.” Accessed June 15, 2016. http://swagger.io/.

@weavejester. “Codox.” Codox: Clojure Documentation Tool. Accessed June 15, 2016. https://github.com/weavejester/codox.

Secure

“API Resource Guide, API Security.” API Management Blog - Akana, February 20, 2014. https://blog.akana.com/api-security-resource-guide/.

“Google VSAQ: Vendor Security Assessment Questionnaire.” Google VSAQ. Accessed May 24, 2016. https://github.com/google/vsaq.

“InCommon Certificate Service.” Accessed June 14, 2016. https://www.incommon.org/certificates/.

“Indexing HTTPS Pages by Default.” Google Online Security Blog, December 17, 2015. https://security.googleblog.com/2015/12/indexing-https-pages-by-default.html.

“Introduction to Container Security.” Docker, March 18, 2015. https://d3oypxn00j2a10.cloudfront.net/assets/img/Docker%20Security/WP_Intro_to_container_security_03.20.2015.pdf.

“Let’s Encrypt - Free SSL/TLS Certificates.” Accessed June 14, 2016. https://letsencrypt.org/.

“Mozilla/http-Observatory.” GitHub. Accessed September 5, 2016. https://github.com/mozilla/http-observatory.

“OWASP.” The Open Web Application Security Project. Accessed May 24, 2016. https://www.owasp.org/index.php/Main_Page.

“OWASP/DevGuide.” GitHub. Accessed June 13, 2016. https://github.com/OWASP/DevGuide.

“Public Licenses and Data: So What to Do Instead? – Luis Villa: Open Law and Strategy.” Accessed October 7, 2016. http://lu.is/blog/2016/09/26/public-licenses-and-data-so-what-to-do-instead/.

“QCon NewYork 2016: The Verification of a Distributed System.” Speaker Deck. Accessed June 15, 2016. https://speakerdeck.com/caitiem20/qcon-newyork-2016-the-verification-of-a-distributed-system.

“StartSSLTM Certificates & Public Key Infrastructure.” Accessed June 14, 2016. https://www.startssl.com/StartEncrypt.

Sharable

Calamito, Anthony. “Understanding The Flexibility of Open Source Licensing.” Boundless, June 21, 2016. http://boundlessgeo.com/2016/06/understanding-the-flexibility-of-open-source-licensing/.

“Choose an Open Source License.” Choose a License. Accessed June 13, 2016. http://choosealicense.com/.

“CLAHub.” Contributor License Agreements on Github. Accessed May 24, 2016. https://www.clahub.com/.

“Creative Commons.” Creative Commons. Accessed June 16, 2016. https://creativecommons.org/.

Eghbal, Nadia. “Contributing Guides: A Template,” n.d. https://github.com/nayafia/contributing-template.

Ehmke, Coraline Ada. “Contributor Covenant: A Code of Conduct for Open Source Projects.,” 2014. http://contributor-covenant.org/.

“Federal Source Code Policy | Introduction.” Accessed September 14, 2016. https://sourcecode.cio.gov/.

“OSTP Initiatives.” The White House. Accessed September 26, 2016. https://www.whitehouse.gov/node/232081.

@potch. “No Maintenance Intended,” 2016. http://unmaintained.tech/.

Governed

Barcellini, Flore, Françoise Détienne, and Jean-Marie Burkhardt. “A Situated Approach of Roles and Participation in Open Source Software Communities.” Human–Computer Interaction 29, no. 3 (May 4, 2014): 205–55. doi:10.1080/07370024.2013.812409.

Baysal, Olga, Oleksii Kononenko, Reid Holmes, and Michael W. Godfrey. “The Secret Life of Patches: A Firefox Case Study.” In Proceedings of the 2012 19th Working Conference on Reverse Engineering, 447–55. WCRE ’12. Washington, DC, USA: IEEE Computer Society, 2012. doi:10.1109/WCRE.2012.54.

Chełkowski, Tadeusz, Peter Gloor, and Dariusz Jemielniak. “Inequalities in Open Source Software Development: Analysis of Contributor’s Commits in Apache Software Foundation Projects.” PLoS ONE 11, no. 4 (April 20, 2016). doi:10.1371/journal.pone.0152976.

“Ecological Studies of Open Source Software Ecosystems.” Accessed May 24, 2016. http://informatique.umons.ac.be/genlog/projects/ecos/.

Eghbal, Nadia. “Contributing Guides: A Template,” n.d. https://github.com/nayafia/contributing-template.

———. “Posted Slides from My @codeconf Talk on Liberal Contribution Models: http://www.slideshare.net/NadiaEghbal/emerging-Models-for-Open-Source-Contributions … The History Was Fun to Research!” Microblog. @nayafia, July 14, 2016. https://twitter.com/nayafia/status/753599900454121472.

Ehmke, Coraline Ada. “Contributor Covenant: A Code of Conduct for Open Source Projects.,” 2014. http://contributor-covenant.org/.

“Emerging Models for Open Source Contributions.” 14:35:29 UTC. http://www.slideshare.net/NadiaEghbal/emerging-models-for-open-source-contributions.

Fitzgerald, Brian, and Klaas-Jan Stol. “Continuous Software Engineering and Beyond: Trends and Challenges.” In Proceedings of the 1st International Workshop on Rapid Continuous Software Engineering, 1–9. RCoSE 2014. New York, NY, USA: ACM, 2014. doi:10.1145/2593812.2593813.

Fogel, Karl. “Producing Open Source Software.” Accessed May 24, 2016. http://producingoss.com/en/producingoss.html.

Gharehyazie, Mohammad, Daryl Posnett, Bogdan Vasilescu, and Vladimir Filkov. “Developer Initiation and Social Interactions in OSS: A Case Study of the Apache Software Foundation.” Empirical Software Engineering 20, no. 5 (August 22, 2014): 1318–53. doi:10.1007/s10664-014-9332-x.

“GitHub Community Guidelines - User Documentation.” Accessed October 24, 2016. https://help.github.com/articles/github-community-guidelines/.

Marlow, Jennifer, Laura Dabbish, and Jim Herbsleb. “Impression Formation in Online Peer Production: Activity Traces and Personal Profiles in Github.” In Proceedings of the 2013 Conference on Computer Supported Cooperative Work, 117–28. CSCW ’13. New York, NY, USA: ACM, 2013. doi:10.1145/2441776.2441792.

Moe, Nils Brede, Aybüke Aurum, and Tore Dybå. “Challenges of Shared Decision-Making: A Multiple Case Study of Agile Software Development.” Information and Software Technology, Special Issue: Voice of the Editorial BoardSpecial Issue: Voice of the Editorial Board, 54, no. 8 (August 2012): 853–65. doi:10.1016/j.infsof.2011.11.006.

“Onboarding at rOpenSci: A Year in Reviews.” Website. Accessed July 2, 2016. /blog/2016/03/28/software-review.

“Practices Perfected In OSS Can Reshape Enterprise Development.” The Npm Blog. Accessed May 24, 2016. http://blog.npmjs.org/post/139373244435/practices-perfected-in-oss-can-reshape-enterprise.

Scott, Adam. “Ethical Web Development,” 2016. https://ethicalweb.org/.

Silva, F. Q. B. d, S. S. J. O. Cruz, T. B. Gouveia, and L. F. Capretz. “Using Meta-Ethnography to Synthesize Research: A Worked Example of the Relations between Personality and Software Team Processes.” In 2013 ACM / IEEE International Symposium on Empirical Software Engineering and Measurement, 153–62, 2013. doi:10.1109/ESEM.2013.11.

Smith, Arfon. “The Shape of Open Source.” GitHub, June 23, 2016. https://github.com/blog/2195-the-shape-of-open-source.

Steinmacher, Igor, Marco Aurelio Graciotto Silva, Marco Aurelio Gerosa, and David F. Redmiles. “A Systematic Literature Review on the Barriers Faced by Newcomers to Open Source Software Projects.” Information and Software Technology 59 (March 2015): 67–85. doi:10.1016/j.infsof.2014.11.001.

“Test Double | Our Thinking | The Social Coding Contract.” Accessed July 13, 2016. http://blog.testdouble.com/posts/2014-12-02-the-social-coding-contract.html.

“The Agile Design Team Maturity Scale | UX Magazine.” Accessed July 16, 2016. http://uxmag.com/articles/the-agile-design-team-maturity-scale.

“Top 5 Open Source Community Metrics to Track.” Opensource.com. Accessed September 5, 2016. https://opensource.com/business/15/12/top-5-open-source-community-metrics-track.

“Understanding the GitHub Flow · GitHub Guides.” Accessed June 15, 2016. https://guides.github.com/introduction/flow/.

West, Joel, and Siobhan O’Mahony. “Contrasting Community Building in Sponsored and Community Founded Open Source Projects.” In Proceedings of the Proceedings of the 38th Annual Hawaii International Conference on System Sciences - Volume 07, 196.3 – . HICSS ’05. Washington, DC, USA: IEEE Computer Society, 2005. doi:10.1109/HICSS.2005.166.

Williams, Laurie. “What Agile Teams Think of Agile Principles.” Commun. ACM 55, no. 4 (April 2012): 71–76. doi:10.1145/2133806.2133823.

Code as Research Products

“BackHub - Backup and Archive Your GitHub Repositories.” Accessed September 5, 2016. https://backhub.co/.

@benbalter. “Benbalter/github-Records-Archiver.” GitHub. Accessed September 5, 2016. https://github.com/benbalter/github-records-archiver.

Car, Nicholas. “Data Reuse Fitness Assessment Using Provenance.” Denver, CO, 2016. http://www.scidatacon.org/2016/sessions/53/paper/47/.

“Center for Trustworthy Scientific Cyberinfrastructure.” Center for Trustworthy Scientific Cyberinfrastructure. Accessed May 24, 2016. http://trustedci.org/.

“Codemeta/codemeta.” GitHub. Accessed June 1, 2016. https://github.com/codemeta/codemeta.

“Cookiecutter Data Science.” Accessed October 31, 2016. https://drivendata.github.io/cookiecutter-data-science/.

“CRediT.” CASRAI, April 18, 2016. http://casrai.org/credit.

“Dagstuhl Seminar on Reproducibility.” RDA, September 17, 2016. https://rd-alliance.org/dagstuhl-seminar-reproducibility.

“DASPOS.” Accessed May 24, 2016. https://daspos.crc.nd.edu/.

“Data and Code Sharing Roundtable.” Accessed September 14, 2016. http://web.stanford.edu/~vcs/Conferences/RoundtableNov212009/.

“Depsy.” Accessed May 26, 2016. http://depsy.org/.

“Duecredit/duecredit.” Duecredit. Accessed May 24, 2016. https://github.com/duecredit/duecredit.

“ECO-OP.” ECO-OP Repository, 2015. https://github.com/tetherless-world/ecoop.

“ECOOP Prov Capture Ontology.” Accessed October 28, 2016. http://cmapspublic3.ihmc.us/rid=1M8GX7GPX-1B78PMS-15CC/ECOOP%20pro.

Freire, Juliana, Norbert Fuhr, and Andreas Rauber. “Reproducibility of Data-Oriented Experiments in E-Science (Dagstuhl Seminar 16041).” Edited by Juliana Freire, Norbert Fuhr, and Andreas Rauber. Dagstuhl Reports 6, no. 1 (2016): 108–59. doi:http://dx.doi.org/10.4230/DagRep.6.1.108.

Gent, Ian, Catherine Jones, and Brian Matthews. “GUIDELINES FOR PERSISTENTLY IDENTIFYING SOFTWARE USING DATACITE: A JISC RESEARCH DATA SPRING PROJECT,” September 2015. http://rrr.cs.st-andrews.ac.uk/wp-content/uploads/2015/10/guidelines-software-identification.pdf.

Gutzman, Karen, Stacy Konkiel, Marijane White, Matthew Brush, Violeta Ilik, Michael Conlon, Melissa Haendel, and Kristi Holmes. “Attribution of Work in the Scholarly Ecosystem,” April 13, 2016. https://figshare.com/articles/Attribution_of_Work_in_the_Scholarly_Ecosystem/3175198.

“ICSU Statute 5 — ICSU.” Page. Accessed September 14, 2016. http://www.icsu.org/freedom-responsibility/cfrs/statute-5.

“Image Processing On Line: Software Guidelines.” Accessed October 7, 2016. https://tools.ipol.im/wiki/ref/software_guidelines/#implementation.

@jlevy. “Jlevy/ghizmo.” GitHub. Accessed October 25, 2016. https://github.com/jlevy/ghizmo.

“Journal of Open Research Software.” Accessed October 17, 2016. http://openresearchsoftware.metajnl.com/.

“Making Your Code Citable · GitHub Guides.” Accessed September 28, 2016. https://guides.github.com/activities/citable-code/.

Nosek, B. A., G. Alter, G. C. Banks, D. Borsboom, S. D. Bowman, S. J. Breckler, S. Buck, et al. “Promoting an Open Research Culture.” Science 348, no. 6242 (June 26, 2015): 1422–25. doi:10.1126/science.aab2374.

“Openrif/contribution-Ontology.” GitHub. Accessed June 23, 2016. https://github.com/openrif/contribution-ontology.

“OSTP Initiatives.” The White House. Accessed September 26, 2016. https://www.whitehouse.gov/node/232081.

Piccolo, Stephen R., and Michael B. Frampton. “Tools and Techniques for Computational Reproducibility.” GigaScience 5 (2016): 30. doi:10.1186/s13742-016-0135-4.

Priem, J., D. Taraborelli, P. Groth, and C. Neylon. “Altmetrics: A Manifesto.” Altmetrics: A Manifesto, October 26, 2010. http://altmetrics.org/manifesto/.

“ProjectTIER/ProjectTIER_R.” GitHub. Accessed August 3, 2016. https://github.com/ProjectTIER/ProjectTIER_R.

“ProjectTIER/ProjectTIER_STATA.” GitHub. Accessed August 3, 2016. https://github.com/ProjectTIER/ProjectTIER_STATA.

“Project TIER Protocol v2.0.” Accessed August 3, 2016. https://www.haverford.edu/project-tier/protocol-v2.

Ratnakar, Varun, and Yolanda Gil. “Ontosoft.” Ontosoft. Accessed May 24, 2016. http://ontosoft.org/ontology/software/.

“Reproducible-Builds.org.” Reproducible Builds. Accessed May 24, 2016. https://reproducible-builds.org/.

“Result and Artifact Review and Badging — Association for Computing Machinery.” Accessed June 27, 2016. http://www.acm.org/publications/policies/artifact-review-badging.

“RRR « Reuse, Repurposing, Reproducibility.” Accessed September 23, 2016. http://rrr.cs.st-andrews.ac.uk/.

“Software Heritage.” Accessed December 6, 2016. https://www.softwareheritage.org/.

“Software Preservation Network.” Accessed June 16, 2016. http://www.softwarepreservationnetwork.org/.

SoftwareX. Accessed June 16, 2016. http://www.journals.elsevier.com/softwarex/.

“The Journal of Open Source Software Reviewer Guidelines.” The Journal of Open Source Software. Accessed July 2, 2016. http://joss.theoj.org/about#reviewer_guidelines.

“The Open Definition - Open Definition - Defining Open in Open Data, Open Content and Open Knowledge.” Accessed May 24, 2016. http://opendefinition.org/.

“The PRIMAD Model of Reproducibility.” Accessed October 7, 2016. http://www.is.informatik.uni-duisburg.de/bib/docs/Fuhr_16z.html.en.

“The ReScience Journal.” Accessed September 26, 2016. http://rescience.github.io/.

“The Software Credit Ontology.” Accessed August 15, 2016. https://dagstuhleas.github.io/SoftwareCreditRoles/doc/index-en.html.

Sustainability & Reusability/Adoption

“6 Things to Know About Successful (and Failed) Open-Source Software.” Accessed June 1, 2016. http://mediashift.org/2013/08/6-things-to-know-about-successful-open-source-software/.

“2016 Software Infrastructure for Sustained Innovation (SI2) PI Workshop Report.” Arlington, VA: Software Infrastructure for Sustained Innovation (SI2) Principal Investigators (PI), February 16, 2016. http://cococubed.asu.edu/si2_pi_workshop_2016/ewExternalFiles/SI2_PI_2016_report_final-1.pdf.

“All the Apache Streaming Projects: An Exploratory Guide.” The New Stack, July 8, 2016. http://thenewstack.io/apache-streaming-projects-exploratory-guide/.

“Billions at Stake in University Patent Fights.” Bloomberg.com. Accessed July 9, 2016. http://www.bloomberg.com/graphics/2016-university-patents/.

Buckley, Jim, Tom Mens, Matthias Zenger, Awais Rashid, and Günter Kniesel. “Towards a Taxonomy of Software Change: Research Articles.” J. Softw. Maint. Evol. 17, no. 5 (September 2005): 309–32. doi:10.1002/smr.v17:5.

Donker, Frederika Welle, and Bastiaan van Loenen. “How to Assess the Success of the Open Data Ecosystem?” International Journal of Digital Earth 0, no. 0 (September 9, 2016): 1–23. doi:10.1080/17538947.2016.1224938.

“Funding - Django REST Framework.” Accessed June 17, 2016. https://fund.django-rest-framework.org/topics/funding/.

“Funding Open Source with Marketing Money — Surfing in Kansas.” Accessed September 3, 2016. http://ericholscher.com/blog/2016/aug/31/funding-oss-marketing-money/.

Gousios, Georgios, Martin Pinzger, and Arie van Deursen. “An Exploratory Study of the Pull-Based Software Development Model.” In Proceedings of the 36th International Conference on Software Engineering, 345–55. ICSE 2014. New York, NY, USA: ACM, 2014. doi:10.1145/2568225.2568260.

Gousios, Georgios, Andy Zaidman, Margaret-Anne Storey, and Arie van Deursen. “Work Practices and Challenges in Pull-Based Development: The Integrator’s Perspective.” In Proceedings of the 37th International Conference on Software Engineering - Volume 1, 358–68. ICSE ’15. Piscataway, NJ, USA: IEEE Press, 2015. http://dl.acm.org/citation.cfm?id=2818754.2818800.

Gumm, Dorina C. “Distribution Dimensions in Software Development Projects: A Taxonomy.” IEEE Softw. 23, no. 5 (September 2006): 45–51. doi:10.1109/MS.2006.122.

Guzmán, Liliana, Constanza Lampasona, Carolyn Seaman, and Dieter Rombach. “Survey on Research Synthesis in Software Engineering.” In Proceedings of the 18th International Conference on Evaluation and Assessment in Software Engineering, 2:1–2:10. EASE ’14. New York, NY, USA: ACM, 2014. doi:10.1145/2601248.2601273.

Hettrick, Simon, Neil Chue Hong, Les Carr, David De Roure, Giacomo Peru, Stephen Crouch, Aleksandra Nenadic, et al. “UK Research Software Survey 2014.” Zenodo, December 4, 2014. doi:10.5281/zenodo.14809.

Hong, Neil Chue. “Open Software for Open Science,” May 23, 2015. https://figshare.com/articles/Open_Software_for_Open_Science/1424440.

Huang, Xing, Xianghua Ding, Charlotte P. Lee, Tun Lu, and Ning Gu. “Meanings and Boundaries of Scientific Software Sharing.” In Proceedings of the 2013 Conference on Computer Supported Cooperative Work, 423–34. CSCW ’13. New York, NY, USA: ACM, 2013. doi:10.1145/2441776.2441825.

Huang, X., T. Lu, X. Ding, T. Liu, and N. Gu. “A Provenance-Based Solution for Software Selection in Scientific Software Sharing.” In 2013 IEEE 17th International Conference on Computer Supported Cooperative Work in Design (CSCWD), 172–77, 2013. doi:10.1109/CSCWD.2013.6580958.

“Icecrime/vossibility-Stack.” GitHub. Accessed October 29, 2016. https://github.com/icecrime/vossibility-stack.

“istlab/Alitheia-Core.” GitHub. Accessed June 1, 2016. https://github.com/istlab/Alitheia-Core.

Joppa, Lucas N., Greg McInerny, Richard Harper, Lara Salido, Kenji Takeda, Kenton O’Hara, David Gavaghan, and Stephen Emmott. “Troubling Trends in Scientific Software Use.” Science 340, no. 6134 (May 17, 2013): 814–15. doi:10.1126/science.1231535.

Kalliamvakou, Eirini, Georgios Gousios, Kelly Blincoe, Leif Singer, Daniel M. German, and Daniela Damian. “The Promises and Perils of Mining GitHub.” In Proceedings of the 11th Working Conference on Mining Software Repositories, 92–101. MSR 2014. New York, NY, USA: ACM, 2014. doi:10.1145/2597073.2597074.

Katz, Daniel S. “Danielskatz/sustaining-Research-Projects.” GitHub, 2016. https://github.com/danielskatz/sustaining-research-projects.

Keyes, David, and Valerie Taylor. “National Science Foundation Advisory Committee for CyberInfrastructure Task Force on Software for Science and Engineering.” National Science Foundation, March 2011. https://www.nsf.gov/cise/aci/taskforces/TaskForceReport_Software.pdf.

Liu, Manlu, Clyde Eiríkur Hull, and Yu-Ting Caisy Hung. “Starting Open Source Collaborative Innovation: The Antecedents of Network Formation in Community Source.” Information Systems Journal, January 1, 2016, n/a – n/a. doi:10.1111/isj.12113.

“LuaJIT Sponsorship Program.” Accessed September 12, 2016. http://luajit.org/sponsors.html.

“NumFOCUS Receives Grant for Project Sustainability.” NumFOCUS | Open Code = Better Science. Accessed July 2, 2016. http://www.numfocus.org/1/post/2016/06/numfocus-receives-grant-for-project-sustainability.html.

“Open Hub, the Open Source Network.” Accessed September 5, 2016. https://www.openhub.net/.

“Open Source Collective Is on Open Collective.” Accessed August 19, 2016. https://opencollective.com/opensource.

Passani, Antonella, Fabiana Monacciani, Shenja Van Der Graaf, Francesca Spagnoli, Francesco Bellini, Marie Debicki, and Paolo Dini. “SEQUOIA: A Methodology for the Socio-Economic Impact Assessment of Software-as-a-Service and Internet of Services Research Projects.” Research Evaluation 23, no. 2 (April 1, 2014): 133–49. doi:10.1093/reseval/rvu004.

Passos, Carol, Daniela S. Cruzes, Tore Dyb\a a, and Manoel Mendonça. “Challenges of Applying Ethnography to Study Software Practices.” In Proceedings of the ACM-IEEE International Symposium on Empirical Software Engineering and Measurement, 9–18. ESEM ’12. New York, NY, USA: ACM, 2012. doi:10.1145/2372251.2372255.

Petersen, Kai, Sairam Vakkalanka, and Ludwik Kuzniarz. “Guidelines for Conducting Systematic Mapping Studies in Software Engineering: An Update.” Information and Software Technology 64 (August 2015): 1–18. doi:10.1016/j.infsof.2015.03.007.

Petre, Marian, and Greg Wilson. “PLOS/Mozilla Scientific Code Review Pilot: Summary of Findings.” CoRR abs/1311.2412 (2013). http://arxiv.org/abs/1311.2412.

“RepoGrams/RepoGrams.” RepoGrams. Accessed May 24, 2016. https://github.com/RepoGrams/RepoGrams.

“Report - S&E Indicators 2016 | NSF - National Science Foundation.” Accessed September 13, 2016. https://nsf.gov/statistics/2016/nsb20161/#/report.

Rigby, Peter C., and Margaret-Anne Storey. “Understanding Broadcast Based Peer Review on Open Source Software Projects.” In Proceedings of the 33rd International Conference on Software Engineering, 541–50. ICSE ’11. New York, NY, USA: ACM, 2011. doi:10.1145/1985793.1985867.

Sarma, Meera, and Thomas Matheus. “‘Hybrid’ Open Source Software Virtual Communities of Practice – a Conceptual Framework.” Technology Analysis & Strategic Management 27, no. 5 (May 28, 2015): 569–85. doi:10.1080/09537325.2015.1019452.

Smith, Arfon. “The Shape of Open Source.” GitHub, June 23, 2016. https://github.com/blog/2195-the-shape-of-open-source.

Teixeira, Jose, Gregorio Robles, and Jesús M. González-Barahona. “Lessons Learned from Applying Social Network Analysis on an Industrial Free/Libre/Open Source Software Ecosystem.” Journal of Internet Services and Applications 6, no. 1 (August 2015). doi:10.1186/s13174-015-0028-2.

“The Gordon and Betty Moore Foundation Grant for Numba and Dask.” Continuum, July 13, 2016. https://www.continuum.io/blog/developer-blog/gordon-and-betty-moore-foundation-grant-numba-and-dask.

“Top 5 Open Source Community Metrics to Track.” Opensource.com. Accessed September 5, 2016. https://opensource.com/business/15/12/top-5-open-source-community-metrics-track.

“Update on InfluxDB Clustering, High-Availability and Monetization | InfluxData.” Accessed July 2, 2016. https://influxdata.com/blog/update-on-influxdb-clustering-high-availability-and-monetization/.

Velden, Theresa, Matthew J. Bietz, E. Ilana Diamant, James D. Herbsleb, James Howison, David Ribes, and Stephanie B. Steinhardt. “Sharing, Re-Use and Circulation of Resources in Cooperative Scientific Work.” In Proceedings of the Companion Publication of the 17th ACM Conference on Computer Supported Cooperative Work & Social Computing, 347–50. CSCW Companion ’14. New York, NY, USA: ACM, 2014. doi:10.1145/2556420.2558853.

“Who Sponsors Drupal Development? | Dries Buytaert.” Accessed September 6, 2016. http://buytaert.net/who-sponsors-drupal-development.

Zilia Iskoujina, and Joanne Roberts. “Knowledge Sharing in Open Source Software Communities: Motivations and Management.” Journal of Knowledge Management 19, no. 4 (June 12, 2015): 791–813. doi:10.1108/JKM-10-2014-0446.

Software Quality Research

Alspaugh, Thomas A. “Kinds of Software Quality (Ilities).” Accessed May 28, 2016. http://www.thomasalspaugh.org/pub/fnd/ility.html.

“[ARCHIVED] Open Source Maturity Model.” Accessed May 24, 2016. http://oss-watch.ac.uk/resources/archived/osmm#how-the-osmm-compares-against-the-brr.

Azizian, Nazanin, Shahram Sarkani, and Thomas Mazzuchi. “A Comprehensive Review and Analysis of Maturity Assessment Approaches for Improved Decision Support to Achieve Efficient Defense Acquisition.” In Proceedings of the World Congress on Engineering and Computer Science 2009. San Francisco, 2009. http://www.iaeng.org/publication/WCECS2009/WCECS2009_pp1150-1157.pdf.

Berander, Patrik, Lars-Ola Damm, Jeanette Eriksson, Tony Gorschek, Kennet Henningsson, Per Jönsson, Simon Kågström, et al. Software Quality Attributes and Trade-Offs, 2005. http://www.bth.se/com/besq.nsf/(WebFiles)/5A52350A52726F51C12570A8004CB613/$FILE/Software_quality_attributes.pdf.

Burgess, Annie. “2015 AIST Evaluations Overview.” Federation of Earth Science Information Partners, 2016. http://testbed.esipfed.org/sites/default/files/2015_AIST_Evaluations_Overview.pdf.

Crouch, Steve, Mike Jackson, and Rob Baxter. “Software Evaluation Guide.” Software Sustainability Institute, November 11, 2014. http://www.software.ac.uk/software-evaluation-guide.

Debattista, Jeremy, Makx Dekkers, Christophe Guéret, Deirdre Lee, Nandana Mihindukulasooriya, and Amrapali Zaveri. “Data on the Web Best Practices: Data Quality Vocabulary,” 2016. https://www.w3.org/TR/vocab-dqv/.

Downs, Robert R., and James J. Marshall. “A Proposal on Using Reuse Readiness Levels to Measure Software Reusability.” Data Science Journal 9 (2010). doi:10.7916/D8ZS2V7W.

Duijnhouwer, Frans-Wilhelm, and Chris Widdows. “Open Source Maturity Model.” Capgemini, August 2003. http://jose-manuel.me/thesis/references/GB_Expert_Letter_Open_Source_Maturity_Model_1.5.3.pdf.

“EarthCube Integration and Testing Environment (ECITE) | EarthCube.” Accessed June 1, 2016. http://earthcube.org/group/earthcube-integration-testing-environment-ecite.

“ESSI-SCOPE Quality Characteristics and Their Application.” Accessed May 24, 2016. http://www.cse.dcu.ie/essiscope/sm2/9126ref.html.

Graybeal, John. “ESIP Technology Evaluation Framework.” GitHub, February 10, 2016. https://github.com/ESIPFed/technology-evaluation-framework.

———. “ESIP Technology Evaluation Framework Final Recommendations,” January 2016. http://wiki.esipfed.org/images/7/73/ESIP_Technology_Evaluation_Framework_Recommendations.pdf.

“ISO 25010.” Accessed May 25, 2016. http://iso25000.com/index.php/en/iso-25000-standards/iso-25010?limit=3&limitstart=0.

“ISO/EIC 9126-1,” 2000. http://www.cse.unsw.edu.au/~cs3710/PMmaterials/Resources/9126-1%20Standard.pdf.

“ISO/IEC 25010:2011 - Systems and Software Engineering -- Systems and Software Quality Requirements and Evaluation (SQuaRE) -- System and Software Quality Models.” ISO. Accessed May 24, 2016. http://www.iso.org/iso/home/store/catalogue_ics/catalogue_detail_ics.htm?csnumber=35733.

Mattmann, Chris A., Robert R. Downs, James J. Marshall, Neal F. Most, and Shahin Samadi. “TOOLS TO SUPPORT THE REUSE OF SOFTWARE ASSETS FOR THE NASA EARTH SCIENCE DECADAL SURVEY MISSIONS.” IEEE Geoscience and Remote Sensing Society Newsletter, March 2011. http://ntrs.nasa.gov/archive/nasa/casi.ntrs.nasa.gov/20120010312.pdf.

Miguel, Jóse P., David Mauricio, and Glen Rodríguez. “A Review of Software Quality Models for the Evaluation of Software Products.” International Journal of Software Engineering & Applications (IJSEA), 5, no. 6 (November 2014). doi:DOI : 10.5121/ijsea.2014.5603.

“NASA Technology Readiness Levels,” October 28, 2012. https://www.nasa.gov/directorates/heo/scan/engineering/technology/txt_accordion1.html.

“Reuse Readiness Levels (RRLs).” NASA Earth Science Data Systems - Software Reuse Working Group, April 30, 2010. https://earthdata.nasa.gov/files/RRLs_v1.0.pdf.

“SQA Software Quality Assurance: FURPS.” Accessed May 24, 2016. http://www.sqa.net/index.htm#furps.

“SQA Software Quality Assurance in Practice.” Accessed May 24, 2016. http://www.sqa.net/sqa-practice.html.

“SQC Software Quality Control.” Accessed May 24, 2016. http://www.sqa.net/softwarequalityattributes.html.

Stig, Daniel Corin, Ulf Högman, and Dag Bergsjö. “Assessment for the Readiness for Internal Technology Transfer - A Case Study,” 2011. http://www.ics.kth.se/INCOSE/Assesment%20of%20Readiness%20for%20Internal%20Technology%20Transfer.pdf.

Urban-Mathieux, Brigitta. “NGDA Lifecycle Maturity Assessment.” GEOPLATFORM.gov, n.d. https://cms.geoplatform.gov/A-16-NGDA-Theme-Community/LMA.

“Welcome to the Standard Technical Evaluation Process Toolkit.” MITRE STEP Toolkit. Accessed May 24, 2016. http://www2.mitre.org/work/sepo/toolkits/STEP/.

Welker, Kurt D. “The Software Maintainability Index Revisited.” The Journal of Defense Software Engineering, August 2001. http://static1.1.sqspcdn.com/static/f/702523/9457031/1290003349713/200108-Welker.pdf?token=0hc4bxA%2BnY3KAhFrq0AESeTW0M4%3D.