So I’ve been working on an implementation of GPT-4-Turbo that’s designed to ingress entire papers into its context window and process them into summaries that would be understandable by someone with a highschool education (originally went for 8th grade max, but that led to rather patronizing results lol). The machine tells me what the content should be for a given paper and I make it using a few tools like Premier Pro and Photoshop. I’ve never made videos like this before though, so it’s a bit rough.

I was hoping to use this tool to expand access to scientific papers by the general public. Those papers are hella dense and def need some translation.

I’ve attached my first full attempt at using my tool. It’s kinda rough, but I’d love to get some feedback on how to make it better (especially as it pertains to the script).

  • thejevans@lemmy.ml
    link
    fedilink
    arrow-up
    11
    ·
    7 months ago

    Do you have a transcript, so I don’t have to watch a video to look for errors?

    As an author on a few papers, I think this is not a place where LLMs will really shine. They may be fine to use by a subject matter expert for a first pass, but would likely produce inaccurate statements. Scientific papers have very specific and niche language, with lots of numbers attached. LLMs are not trained to handle this kind of a situation well.

    • WackyTabbacy42069OP
      link
      fedilink
      arrow-up
      1
      ·
      7 months ago

      I’ve engaged with the machine since GPT-3 Davinchi. The accuracy of the models have improved tremendously, and they can now even perform complex maths such as those pertaining to relativity (they use Python to calculate). I’m using the latest and greatest model that was just released a little over a week ago; in my experience it’s more than capable. Main limitation I have is maths, as I’m not using the Assistants API which gives access to code interpreter, so I’ll just avoid most pure mathematics papers and stick to the sciences.

      Yeah, np. This is the paper it’s based off of: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9233534/ . Please keep in mind that it’s target audience is not academic in nature, so the language use has been altered to reflect that (e.g. using “theory” not as we’d use it like in theory of gravity, but how most people would use it to reference speculation or hypothesis)

      Introduction: Hey everyone! Today, let’s embark on a fascinating journey back in time to the Hadean Earth, over 4 billion years ago. This was a time when our planet was quite different, covered in a sea of molten rock and constantly bombarded by meteorites. Yet, it was during this hostile period that the very pillars of life as we know might have been set. We’ll dive into a scientific study that suggests how some of Earth’s oldest rocks might have been more than just barren stones; they may have been catalysts that set the stage for the development of RNA, which is crucial for life as we know it.

      The RNA World: RNA stands for ribonucleic acid. It’s a molecule that plays a key role in genetics and the synthesis of proteins in all living organisms today. There’s a hypothesis, known as the “RNA World” theory, which suggests that before DNA and proteins became fundamental to life, RNA might have done all the work. RNA could have been both the genetic material and the molecular machine in the earliest forms of life.

      The Big Question: But how did RNA come about in the first place? This has puzzled scientists for years because RNA is a complex molecule – not something easily formed in nature without a helping hand. To support the idea of the RNA World, we’d need evidence that RNA could form in conditions that existed on the early Earth.

      The Research Study: In comes this groundbreaking study! Scientists have discovered that when you mix certain chemicals called ribonucleoside triphosphates (the building blocks of RNA) with specific types of ancient volcanic rocks, known as mafic rock glasses, something amazing happens. These rocks act as a catalyst, turning the building blocks into RNA, without any need for biological processes.

      Why Rock Glasses?: These ancient rock glasses were formed during volcanic eruptions and meteorite impacts on the early Earth. They had the right chemical properties to help stitch together RNA building blocks. It’s kind of like having a robotic assembly line, where rocks are doing the intricate work of piecing together RNA, piece by piece.

      The Experiments: Here’s what the researchers did. They took these rock glasses, underwater, mixed them with RNA building blocks, and let chemistry do its magic. Over time, they noted the formation of RNA chains which could have been the precursors to early life.

      The Results: The RNA that formed was not perfect. It had a good amount of links known as 3’-5’ linkages, which we see in modern RNA, but the researchers couldn’t rule out other types or even a bit of branching. Despite this, the RNA chains were long enough to hold genetic information and potentially perform some simple reactions.

      Limitations: No scientific study is perfect, and it’s important to talk about what this experiment doesn’t tell us. For one, the RNA made during the study isn’t exactly like the RNA in our cells today; some parts are put together differently. Also, the study was done in ideal lab conditions – and we can only guess if conditions on early Earth were the same. Another thing is, even if volcanic glass can help make RNA, we still need to understand where the RNA building blocks came from.

      Conclusion: The findings give us a valuable peek into how the seeds of life may have been sown on our ancient planet. These rock glasses might have been nature’s first-time life-supporting lab bench, making RNA without any living assistance.

      So, there you have it – a discussion on a paper that bridges the gap between geology and biology and offers a tantalizing glimpse at how life might have begun in the primordial soup of early Earth. This evidence sheds light on our most distant origins and reminds us that life, even in its simplest form, always finds a way.

      • B1naryShad0w@beehaw.org
        link
        fedilink
        arrow-up
        2
        ·
        7 months ago

        I think this is fantastic, just based on this summary and skimming through the video. I however can imagine a high school student having a bit of trouble maintaining engagement through the 5 minute video considering it’s not very dynamic and the text to speech is rather monotonous. However, I really think this is a great start, and the content is explained appropriately and elaborately enough to get the big idea.

        I’m hoping to see this go further and improve! Great initiative.

    • WackyTabbacy42069OP
      link
      fedilink
      arrow-up
      4
      ·
      7 months ago

      It’s actually not. Abstracts are targeted at academics or researchers, and oftentime preserve the complexity. Take for example the abstract of the paper this video’s about:

      Reported here are experiments that show that ribonucleoside triphosphates are converted to polyribonucleic acid when incubated with rock glasses similar to those likely present 4.3–4.4 billion years ago on the Hadean Earth surface, where they were formed by impacts and volcanism. This polyribonucleic acid averages 100–300 nucleotides in length, with a substantial fraction of 3′,-5′-dinucleotide linkages. Chemical analyses, including classical methods that were used to prove the structure of natural RNA, establish a polyribonucleic acid structure for these products. The polyribonucleic acid accumulated and was stable for months, with a synthesis rate of 2 × 10−3 pmoles of triphosphate polymerized each hour per gram of glass (25°C, pH 7.5). These results suggest that polyribonucleotides were available to Hadean environments if triphosphates were. As many proposals are emerging describing how triphosphates might have been made on the Hadean Earth, the process observed here offers an important missing step in models for the prebiotic synthesis of RNA.

      While it is less complex than the paper, it is nevertheless dense and jargon endowed. Your average person with a highschool education will either not understand it well or be absolutely turned off by its density. They’re also just very unlikely to stumble across it.

      I could have the machine reword it, but the information is not comprehensive, which reduces quality. By having the entire paper in its context window, the LLM is less likely to hallucinatinate. Plus the added information helps it make better summaries based on all the paper’s sections, importantly the limitation section.

      • Bloody Harry@feddit.de
        link
        fedilink
        arrow-up
        6
        ·
        7 months ago

        Fun Fact: There’s a whole scientific discipline solely focused at making science available to average joe, it’s called science communication.

        Not sure what you’d expect a LLM model to do, but reading deeper into science communication will certainly help you understand and achieve what you are looking for.

  • Paragone@beehaw.org
    link
    fedilink
    arrow-up
    2
    ·
    7 months ago

    My comment isn’t on your script, it is on paper-selection…

    Please have several, orthogonal, selection-systems:

    • most-cited,

    • most trustworthy researchers

    • most unique area of research, or most unique question, or something

    • most central to new tech

    • most central to old tech

    • most undernoticed, big potential… ( things that should be big news, but the global novelty-addiction ignores it )

    • best fundamental science ( definitely include this category! )

    • best citizen-science

    etc…

    iow, the algorithm that most use, which is “paying attention to what others are paying attention to” is an algorithm we shouldn’t be assigning our viability to, you know?

    Also, you may need to make a flexible-limit for dumbing-down, as some papers may have a higher limit and others a lower limit, so some could be easy for most to get the sense of, but some might be tricky … and it might well do more good to let them have their different thresholds, see?