What’s more? They have come up with an alternative for publishers too. Google plans to create a robot.txt-kind-of-system that will enable publishers to opt out of the parts of sites being crawled by them. OpenAI announced in a blog post that if you don't want GPTBot to visit your website, you can prevent it by adding GPTBot to your site's robot.txt file.
Ostensibly, this looks like a very shrewd move by the Big Techs, but they are in dire need of data to make this whole generative AI technology work and grow in the future. They desperately need human-generated content to build a successful model.
What about training models on synthetic data, like training GPT-4 on datasets created by ChatGPT? It does look like an option, but won’t work after a certain point as it would eventually lead to a model collapse. This degenerative process takes place when models learn from data produced by other models. As a result, there is a gradual loss in the accurate representation of the true data distribution.
Human-generated content plays a crucial role in upholding and enhancing the quality of LLMs. And that’s the dilemma at hand for companies — to invest in it or freely extract it from the web. Judging from the way things are going, it wouldn't be astonishing if human-crafted content gains substantial value and becomes a premium commodity in the times ahead.
Read the full story here.
All-in-one Developer Solution
Creating apps that work seamlessly across mobile, web, and desktop platforms often feels as complex as a Rube Goldberg machine. Now, Google has introduced Project IDX, aiming to streamline multi-platform app development through a browser-based experience. Leveraging Google Cloud and powered by AI model Codey, the project facilitates building, managing, and deploying full-stack web and multiplatform apps with renowned frameworks and languages.
Project IDX offers Linux-based VMs accessible from any device, enables importing existing projects from GitHub, and supports diverse templates, including Angular, Flutter, React, and more. It provides web previews and forthcoming Android and iOS emulators for cross-platform optimisation. Google encourages developer input and invites early participation to shape Project IDX's evolution.
Read the full story here.
ChatGPT: Charged by Wolfram
Wolfram Research collaborated with OpenAI to address the math deficiency of ChatGPT through a plugin, achieving impressive results. Conrad Wolfram, CEO of Wolfram Group, highlighted the synergy, with the combined technology scoring 96% in a British ‘A’ level math test. While enthusiastic about AI's potential, Conrad cautioned against exaggerated claims and emphasized the need for diverse technological solutions.
Conrad stressed the significance of abstract language, favoring Wolfram language's precision, which complements LLM's capabilities. He proposed an educational shift, leveraging real-world problems to enhance pedagogy and focusing on pertinent subjects. Mathematics, for Conrad, offers vital insights into problem-solving, underlining its practical applications for informed decisions.
Read the full story here.
Open Source is the Threat
Комментариев нет:
Отправить комментарий
Примечание. Отправлять комментарии могут только участники этого блога.