this post was submitted on 23 Nov 2023
15 points (100.0% liked)

Science

13024 readers
129 users here now

Studies, research findings, and interesting tidbits from the ever-expanding scientific world.

Subcommunities on Beehaw:


Be sure to also check out these other Fediverse science communities:


This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.

founded 2 years ago
MODERATORS
 

So I've been working on an implementation of GPT-4-Turbo that's designed to ingress entire papers into its context window and process them into summaries that would be understandable by someone with a highschool education (originally went for 8th grade max, but that led to rather patronizing results lol). The machine tells me what the content should be for a given paper and I make it using a few tools like Premier Pro and Photoshop. I've never made videos like this before though, so it's a bit rough.

I was hoping to use this tool to expand access to scientific papers by the general public. Those papers are hella dense and def need some translation.

I've attached my first full attempt at using my tool. It's kinda rough, but I'd love to get some feedback on how to make it better (especially as it pertains to the script).

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 9 points 1 year ago (2 children)

Isn't that the whole purpose of an Abstract?

[–] [email protected] 4 points 1 year ago (1 children)

It's actually not. Abstracts are targeted at academics or researchers, and oftentime preserve the complexity. Take for example the abstract of the paper this video's about:

Reported here are experiments that show that ribonucleoside triphosphates are converted to polyribonucleic acid when incubated with rock glasses similar to those likely present 4.3–4.4 billion years ago on the Hadean Earth surface, where they were formed by impacts and volcanism. This polyribonucleic acid averages 100–300 nucleotides in length, with a substantial fraction of 3′,-5′-dinucleotide linkages. Chemical analyses, including classical methods that were used to prove the structure of natural RNA, establish a polyribonucleic acid structure for these products. The polyribonucleic acid accumulated and was stable for months, with a synthesis rate of 2 × 10−3 pmoles of triphosphate polymerized each hour per gram of glass (25°C, pH 7.5). These results suggest that polyribonucleotides were available to Hadean environments if triphosphates were. As many proposals are emerging describing how triphosphates might have been made on the Hadean Earth, the process observed here offers an important missing step in models for the prebiotic synthesis of RNA.

While it is less complex than the paper, it is nevertheless dense and jargon endowed. Your average person with a highschool education will either not understand it well or be absolutely turned off by its density. They're also just very unlikely to stumble across it.

I could have the machine reword it, but the information is not comprehensive, which reduces quality. By having the entire paper in its context window, the LLM is less likely to hallucinatinate. Plus the added information helps it make better summaries based on all the paper's sections, importantly the limitation section.

[–] [email protected] 6 points 1 year ago

Fun Fact: There's a whole scientific discipline solely focused at making science available to average joe, it's called science communication.

Not sure what you'd expect a LLM model to do, but reading deeper into science communication will certainly help you understand and achieve what you are looking for.