Menu

Blog

Page 2746

Jan 23, 2023

Large Language Model: world models or surface statistics?

Posted by in categories: computing, information science

Large Language Models (LLM) are on fire, capturing public attention by their ability to provide seemingly impressive completions to user prompts (NYT coverage). They are a delicate combination of a radically simplistic algorithm with massive amounts of data and computing power. They are trained by playing a guess-the-next-word game with itself over and over again. Each time, the model looks at a partial sentence and guesses the following word. If it makes it correctly, it will update its parameters to reinforce its confidence; otherwise, it will learn from the error and give a better guess next time.

While the underpinning training algorithm remains roughly the same, the recent increase in model and data size has brought about qualitatively new behaviors such as writing basic code or solving logic puzzles.

How do these models achieve this kind of performance? Do they merely memorize training data and reread it out loud, or are they picking up the rules of English grammar and the syntax of C language? Are they building something like an internal world model—an understandable model of the process producing the sequences?

Jan 23, 2023

The Next Generation of Humans: Nanobots

Posted by in categories: biotech/medical, education, genetics, nanotechnology, neuroscience, robotics/AI

Part 1: the future of medicine: nanobots part 2: a new era in mental health: nanobots part 3: the healing power of nanobots part 4: the genetic and data-connected revolution: nanobots part 5: the end of plastic surgery: nanobots part 6: the fertility revolution: nanobots part 7: the job-specific human: nanobots part 8: the end of education as we know it: nanobots part 9: the rise of programmable matter: nanobots part 10: the next generation of humans: nanobots.

Nanotechnology is a rapidly evolving field with the potential to revolutionize medicine in the future. One of the most promising applications of nanotechnology is the use of nanobots in medicine. Nanobots are microscopic robots that can be programmed to perform specialized activities such as disease diagnosis and treatment. They can be used to diagnose and treat a wide range of conditions, including mental illnesses such as depression and anxiety, as well as physical injuries and illnesses.

One of the most interesting potential applications of nanobots in medicine is the treatment of mental illnesses. Mental illnesses are among the most common and devastating diseases of our time. They can be programmed to constantly map the brain and correct faults as they develop. Alzheimer’s disease may theoretically be treated if a person was implanted with nanobots at birth.

Jan 23, 2023

New Research Could Link Evolution of Complex Life to Genetic “Dark Matter”

Posted by in categories: biological, chemistry, cosmology, evolution, genetics, neuroscience, physics

Octopuses have fascinated scientists and the public with their remarkable intelligence, from using tools to engaging in creative play, problem-solving, and even escaping from aquariums. Now, their cognitive abilities may provide significant insight into understanding the evolution of complex life and cognition, including the human brain.

An international team of researchers from Dartmouth College and the Max Delbrück Center (MDC) in Germany has published a study in the journal Science Advances.

<em>Science Advances</em> is a peer-reviewed, open-access scientific journal that is published by the American Association for the Advancement of Science (AAAS). It was launched in 2015 and covers a wide range of topics in the natural sciences, including biology, chemistry, earth and environmental sciences, materials science, and physics.

Jan 23, 2023

How to unlock your “peak mind”

Posted by in category: neuroscience

AMISHI JHA: Where is your attention right now? The human brain’s attention system is actually the success story of what makes us unique as human beings. Because attention fuels our ability to think, to feel, and connect, what we pay attention to is our life. For a long time, through our evolutionary history, the brain started to suffer from a very big problem which is that there’s far more information out in the environment than could be fully processed.

Attention ended up becoming a very useful solution because it allows us to prioritize information, but there are qualities of the human experience that disable attention. Given how powerful attention is, we need to really respect where we place this precious brain resource. The mind is no different than the body. The mind needs to be exercised daily to optimize our psychological well-being. Knowing this, I became very interested in understanding if we might be able to train attention.

Jan 23, 2023

Close Relationships With Parents Promote Healthier Brain Development in High-Risk Teens, Buffering Against Alcohol Use Disorder

Posted by in categories: genetics, neuroscience

Summary: Close and supportive parental relationships can help mitigate the genetic and environmental risk of developing alcohol use disorder for at-risk teens.

Source: state university of new york.

For teens at elevated risk of developing alcohol use disorder (AUD), close relationships with parents can help mitigate their genetic and environmental vulnerability, a new study suggests.

Jan 23, 2023

The Schwarzschild defence

Posted by in category: futurism

A boost to the ratings.

Jan 23, 2023

Prokaryotic Pangenomes Act as Evolving Ecosystems

Posted by in categories: biotech/medical, genetics

Abstract. Understanding adaptation to the local environment is a central tenet and a major focus of evolutionary biology. But this is only part of the adaptionist story. In addition to the external environment, one of the main drivers of genome composition is genetic background. In this perspective, I argue that there is a growing body of evidence that intra-genomic selective pressures play a significant part in the composition of prokaryotic genomes and play a significant role in the origin, maintenance and structuring of prokaryotic pangenomes.

Jan 23, 2023

AI21 Labs Proposes A New Method Called ‘In-Context RALM’ That Can Add Ready-Made External Knowledge Sources To The Existing Language Model

Posted by in category: robotics/AI

With recent developments in language modeling (LM) research, machine-generated text applications have spread to a number of previously untapped domains. However, a significant issue remains that LM-generated text frequently contains factual errors or inconsistencies. This problem usually arises in any LM generation scenario, but it is particularly problematic when generation is performed in uncommon domains or when it requires up-to-date information that the LM was not trained on.

Retrieval-Augmented Language Modeling (RALM) methods, which display the LM pertinent documents from a grounded corpus during generation, offer a possible solution to this problem. Current RALM strategies concentrate on changing the LM architecture to include external data. However, this approach often makes deployment significantly complex. Working on this problem statement, AI21 Labs, an organization that develops artificial intelligence systems, introduced an alternative strategy called In-Context Retrieval-Augmented Language Modeling (In-Context RALM), which can supplement an existing language model with ready-made external information sources. The necessary files are added as input into the language model, which keeps the underlying LM architecture unaffected. The team published their findings in a research paper titled “In-Context Retrieval-Augmented Language Models.”

In the same publication, AI21 Labs also unveiled Wordtune Spices, an addition to their Wordtune text editor. Wordtune Spices is an artificial intelligence robot that helps authors swiftly generate text and create content, thereby accelerating the pace of the composition of academic papers, theses, and creative documents. Spices’ main principle is based on the In-context RALM technique. Users of Spices have access to 12 prompt alternatives, including explications, definitions, and even jokes. Users can select the prompt that best supports their use case and receive a string of supplemental sentences to bolster their case and provide further details.

Jan 23, 2023

How Artificial Intelligence will impact the future of work

Posted by in categories: employment, robotics/AI

Could the rise of advanced AI tools mean the end of some creative and knowledge jobs? Here’s what the experts had to say.

Jan 23, 2023

Gene for a Full Coat of Fur in Humans Still Present But Under a Deep Sleep, Study Found

Posted by in category: neuroscience

Fur is a distinguishing trait of mammals although baldness is an attractive variety of mammalian oddities. Check out how humans lost their fur despite still having the gene responsible for it.