{"id":1308,"date":"2021-05-13T18:57:36","date_gmt":"2021-05-13T18:57:36","guid":{"rendered":"\/?p=1308"},"modified":"2021-05-13T18:58:54","modified_gmt":"2021-05-13T18:58:54","slug":"people-trying-to-get-data-into-usable-forms-sharing-equations-algorithms-and-data-in-immediately-usable-form","status":"publish","type":"post","link":"\/?p=1308","title":{"rendered":"Sharing equations, algorithms and data in immediately usable form on the Internet"},"content":{"rendered":"<div class=\"default-style\">Anatoliy,<\/div>\n<div class=\"default-style\"><\/div>\n<div class=\"default-style\" style=\"padding-left: 40px;\">I was looking at &#8220;nuclear data&#8221; on the Internet and at &#8220;ENDF&#8221;.\u00a0 I came across your 17 Oct 2018 posting at <a href=\"https:\/\/zenodo.org\/record\/2535170#.YJ0iytVKhEY\">https:\/\/zenodo.org\/record\/2535170#.YJ0iytVKhEY<\/a> entitled &#8220;Converting ENDF libraries into relational format&#8221;<\/div>\n<div class=\"default-style\" style=\"padding-left: 40px;\"><\/div>\n<div class=\"default-style\" style=\"padding-left: 40px;\">Searching to see if you had written anything else on the topic, I also found you listed in Universiti Tenologi Malaysia Library at <a href=\"http:\/\/libmast.utm.my\/Record\/doaj-art-e5b13f1a4f66447f9397a68f70627ece\">http:\/\/libmast.utm.my\/Record\/doaj-art-e5b13f1a4f66447f9397a68f70627ece<\/a> with two other papers,<br \/>\n&#8220;Infological models of the ENDF-format nuclear data&#8221; and &#8220;Circuit design solutions for the reactimeters&#8221;<\/div>\n<div class=\"default-style\" style=\"padding-left: 40px;\"><\/div>\n<div class=\"default-style\" style=\"padding-left: 40px;\">I like your &#8220;The transfer to a relational format will make it possible to use standard readily available tools for nuclear data processing which simplify the conversion and operation of this data array.&#8221;<\/div>\n<div class=\"default-style\" style=\"padding-left: 40px;\"><\/div>\n<div class=\"default-style\" style=\"padding-left: 40px;\">Have you continued to pursue this idea of putting all the nuclear data into relational database form?\u00a0 The closest I can come to your &#8220;infological formulas&#8221; is the concept of having all equations on the Internet in symbolic form with careful data on units and dimensions and ways of solving and use in simulations.<\/div>\n<div class=\"default-style\" style=\"padding-left: 40px;\"><\/div>\n<div class=\"default-style\" style=\"padding-left: 40px;\">The major problem on the Internet for all scientific, engineering and quantitative collaboration is PDF and HTML formats that flatten the data so that only human eyes can take it in, without considerable investment of time and effort.\u00a0 I call it the equivalent of paper.\u00a0 It forces humans into the loop for ever step of global diffusion and sharing of knowledge.<\/div>\n<div class=\"default-style\" style=\"padding-left: 40px;\"><\/div>\n<div class=\"default-style\" style=\"padding-left: 40px;\">For the Internet Foundation I track all global communities, particularly those where sharing of data, models, equations would have a transformational impact on global economy and systemic issues.\u00a0 &#8220;Covid&#8221;, &#8220;global climate change&#8221; and thousands of other topics that I have investigated all give the same result &#8211; after massive duplicates and variations, and untraceable materials on the Internet, the almost universal use of paper methods (PDF and html and equations in images) are the most prevalent reasons why research takes years and not days.<\/div>\n<div class=\"default-style\" style=\"padding-left: 40px;\"><\/div>\n<div class=\"default-style\" style=\"padding-left: 40px;\">I took over TheInternetFoundation.Org domain and purpose back in July 1998 from Network Solutions when the original Internet Foundation was cancelled for US political reasons.<\/div>\n<div class=\"default-style\" style=\"padding-left: 40px;\"><\/div>\n<div class=\"default-style\" style=\"padding-left: 40px;\">I hope you will not give up on trying to make all atomic and nuclear engineering data useful for engineering, education and research.\u00a0 Letting people immediately simulate and calculate is far superior to making them memorize formulas they cannot use, or memorize works they cannot find the meanings of, or try to solve problems without all the pieces.<\/div>\n<div class=\"default-style\" style=\"padding-left: 40px;\"><\/div>\n<div class=\"default-style\" style=\"padding-left: 40px;\">Data in relational databases, sharing in json for small datasets, and tab separated line feed terminated tables with standardized headers for large tables is the most efficient for immediate use by the largest number of people. There are about 4.8 Billion people with some level of access to the internet.\u00a0 Their common denominator is javascript and text.\u00a0 Applications are fairly easy to convert to javascript. There are automated ways for most languages and wrappers.\u00a0 I have looked at pretty much all of them for all topics and subjects on the Internet.<\/div>\n<div class=\"default-style\" style=\"padding-left: 40px;\"><\/div>\n<div class=\"default-style\" style=\"padding-left: 40px;\">I am trying to get collections like Wikipedia so that all the equations are accessible in symbolic form, so they can be merged, compared and tested.\u00a0 All the numbers having units and dimensions.\u00a0 All the tables as relational tables, all the references to data sources live and integrated.\u00a0 All the references to mathematical libraries and external mathematics and programs &#8211; traceable and living equations and representations of logic.\u00a0 I have spent decades looking at all the computer languages and representations.\u00a0 In the last several years I study GitHub and similar sites to see if all those scattered and incompatible efforts can be combined.\u00a0 Just site:github.com &#8220;ENDF&#8221; has 1430 entry points,\u00a0 site:github.com &#8220;nuclear data&#8221; has 793 entry points, and site:github.com &#8220;atomic data&#8221; has 1010. There are many more.<\/div>\n<div class=\"default-style\" style=\"padding-left: 40px;\"><\/div>\n<div class=\"default-style\" style=\"padding-left: 40px;\">&#8220;nuclear data&#8221; &#8211; 1.06 Million entry points<\/div>\n<div class=\"default-style\" style=\"padding-left: 40px;\">&#8220;atomic data&#8221; &#8211; 454,000 entry points<\/div>\n<div class=\"default-style\" style=\"padding-left: 40px;\">&#8220;nuclear engineering&#8221; &#8211; 6.24 Million entry points<\/div>\n<div class=\"default-style\" style=\"padding-left: 40px;\"><\/div>\n<div class=\"default-style\" style=\"padding-left: 40px;\">The massive duplication, incomplete and broken pages, use of forms that only humans can access, different styles and navigation and generally poor quality. That affects &#8220;nuclear data&#8221; communities and future generations.\u00a0 It is part of why the cost of simulations and finding alternatives is so high.<\/div>\n<div class=\"default-style\" style=\"padding-left: 40px;\"><\/div>\n<div class=\"default-style\" style=\"padding-left: 40px;\">(&#8220;covid&#8221; OR &#8220;coronavirus&#8221; OR &#8220;corona virus&#8221;) has about 7.5 Billion entry points on the Internet.\u00a0 Most all the research is only shared in paper formats (html and images and pdf).\u00a0 There is massive duplication.<\/div>\n<div class=\"default-style\" style=\"padding-left: 40px;\"><\/div>\n<div class=\"default-style\" style=\"padding-left: 40px;\">&#8220;global climate change&#8221; has 13.3 Million entry points<\/div>\n<div class=\"default-style\" style=\"padding-left: 40px;\"><\/div>\n<div class=\"default-style\" style=\"padding-left: 40px;\">There are many more.\u00a0 All these are potential communities that could be sharing tools and data, not words on paper and undocumented text statements, and untraceable and unusable &#8220;equations&#8221; or untraceable and unreproducible computer programs that are missing key elements and mostly worthless.<\/div>\n<div class=\"default-style\" style=\"padding-left: 40px;\"><\/div>\n<div class=\"default-style\" style=\"padding-left: 40px;\">There are about 2 Billion first time learners in the world now from 5 to 21. They are being forced to memorize in a few year the things they are supposed to know and apply the rest of their life. But many things change so fast, they are going to be seeing everything change constantly. So better to teach them how to work in global communities, global groups working and exploring together.<\/div>\n<div class=\"default-style\" style=\"padding-left: 40px;\"><\/div>\n<div class=\"default-style\" style=\"padding-left: 40px;\">site:Wikipedia.org &#8220;Fourier transform&#8221; has 7380 entry points.\u00a0 Yet nowhere is there a place to choose sample datasets, or FFTs from real datastreams and look at them as living things.\u00a0 Nowhere to have the FFT applied to a persons microphone stream or video stream and see the result.<\/div>\n<div class=\"default-style\" style=\"padding-left: 40px;\"><\/div>\n<div class=\"default-style\" style=\"padding-left: 40px;\">&#8220;Fourier transform&#8221; OR &#8220;Fourier transforms&#8221;\u00a0 has 19.8 Million entry points, and almost all just talk about it, show text version of a few unconnected equations, and much is inside PDF where all the useful parts are lost and inaccessible for the kind of rapid prototyping, modeling, simulation, testing, calibration, experimentation and design of new things that will be needed in the near future.<\/div>\n<div class=\"default-style\" style=\"padding-left: 40px;\"><\/div>\n<div class=\"default-style\">Sincere regards,<\/div>\n<div class=\"default-style\">Richard K Collins, Director, The Internet Foundation<\/div>\n","protected":false},"excerpt":{"rendered":"<p>Anatoliy, I was looking at &#8220;nuclear data&#8221; on the Internet and at &#8220;ENDF&#8221;.\u00a0 I came across your 17 Oct 2018 posting at https:\/\/zenodo.org\/record\/2535170#.YJ0iytVKhEY entitled &#8220;Converting ENDF libraries into relational format&#8221; Searching to see if you had written anything else on the topic, I also found you listed in Universiti Tenologi Malaysia Library at http:\/\/libmast.utm.my\/Record\/doaj-art-e5b13f1a4f66447f9397a68f70627ece with <br \/><a class=\"read-more-button\" href=\"\/?p=1308\">Read More &raquo;<\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20,12,16,28,21],"tags":[],"class_list":["post-1308","post","type-post","status-publish","format-standard","hentry","category-collaborative-model-and-data","category-intelligent-algorithms","category-internet-best-practices","category-internet-efficiency","category-schools-universities-learning-and-working"],"_links":{"self":[{"href":"\/index.php?rest_route=\/wp\/v2\/posts\/1308","targetHints":{"allow":["GET"]}}],"collection":[{"href":"\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=1308"}],"version-history":[{"count":2,"href":"\/index.php?rest_route=\/wp\/v2\/posts\/1308\/revisions"}],"predecessor-version":[{"id":1310,"href":"\/index.php?rest_route=\/wp\/v2\/posts\/1308\/revisions\/1310"}],"wp:attachment":[{"href":"\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=1308"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=1308"},{"taxonomy":"post_tag","embeddable":true,"href":"\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=1308"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}