AI training data, model success likelihood, and informational entropy-based value

Abstract

Since the release of OpenAI's ChatGPT, the world has entered a race to develop more capable and powerful AI, including artificial general intelligence (AGI). The development is constrained by the dependency of AI on the model, quality, and quantity of training data, making the AI training process highly costly in terms of resources and environmental consequences. Thus, improving the effectiveness and efficiency of the AI training process is essential, especially when the Earth is approaching the climate tipping points and planetary boundaries. It is evident that AI can function better when trained to mimic certain human mental processes. Based on insights from quantum mechanics and the informational entropy-based notion of value, we suggest AI developers can enhance the AI training processes' effectiveness and efficiency by creating and implementing parameter systems that are capable of effectively assigning probabilities to informational quanta. Such systems can help reduce entropy within the system, which lowers the energy required for data storage and processing while decreasing the likelihood of information loss during training. Successfully applying the concept of information entropy-based value in AI development will be crucial for advancing generative AI and achieving AGI in a sustainable manner.

Other Versions

No versions found

Links

PhilArchive

External links

  • This entry has no external links. Add one.
Setup an account with your affiliations in order to access resources via your University's proxy server

Through your library

  • Only published works are available at libraries.

Analytics

Added to PP
2024-07-25

Downloads
192 (#131,357)

6 months
120 (#48,438)

Historical graph of downloads
How can I increase my downloads?

Author Profiles

Minh-Hoang Nguyen
Phenikaa University
Quan-Hoang Vuong
Phenikaa University

Citations of this work

No citations found.

Add more citations

References found in this work

No references found.

Add more references