Sam Altman, for instance, voiced his concerns about the lack of GPUs, the mitochondria of LLMs that also power OpenAI’s models. He was worried that the shortage might obstruct the company’s short-term plans and cause problems for developers using its services.
Much before Altman raised an alarm on the GPU shortage, a lesser-known institute in the UAE, called Technology Innovative Institute (TII), foresaw it. Last month, it released Falcon-7B, an LLM whose efficiency can be gauged from the fact that it works even if you have only 32 GB RAM in your computer.
LLMs have also caused environmental problems with the use of compute-heavy chips since they consume a lot of energy. Microsoft has taken an unconventional approach to reduce the power consumption of LLMs — it’s using software. Its software rewrites the programme that makes the programming more efficient. Now, this is the kind of tech innovations software developers need to be looking at.
The next-big technology is waiting at the doorstep of the semiconductor industry. The rise of open-source semiconductor technology like RISC-V for designing chips has driven more startups into the chip design industry. A lot of RISC-V startups are increasingly getting funded in India.
Earlier, no-code platforms and now LLMs have already solved the problem of website creation. However, when it comes to building complex systems with intricate business logic, integrations, and scalability requirements, hardcore developers are still essential. It’s time for the software development community to solve the bigger complex problems of the tech world.
Read the full story here.
Microsoft Powers SMBs
With the rise of technology, small and medium businesses (SMBs) are equipping themselves with new innovations like generative AI. Microsoft conducted research on more than 3,000 SMBs and found that almost 35% of SMBs surveyed were spending over 10% of their revenue on technology.
Microsoft sees a big opportunity in it, especially in Tier 2 and Tier 3 markets. It has been partnering with smaller businesses and offering them tools and solutions for their digital transformation journey. For instance, it tied up with brands like Joyalukkas and Senco Gold & Diamonds to predict a growing demand during festive seasons. There are many similar stories found in other industries.
Read the full story here.
Challenge Accepted
Sam Altman’s brash reply that later went viral hurting enough Indian sentiments, that you can try to build a technology like OpenAI’s but it will be “totally hopeless” irked many for it seemingly questioning Indian developers’ ability to create something as powerful as ChatGPT. India has taken up the challenge.
IIT Madras' AI4Bharat initiative focuses on developing open-source AI models for Indian languages. Their models, IndicBart and IndicBERT, support multiple tasks like question answering, machine translation, and text-generation. These models are specifically designed for Indic languages and have achieved good performance with fewer parameters compared to other models.
Read the full story here.
Blackouts on Reddit
Subredditors are on a protest today. Over 5000 of the 6500 top subreddits went private to register their protest over the proposed API changes that affected third-party apps like Apollo, Reddit for Fun and many others, which are facing an impending shutdown.
In April, Reddit CEO Steve Huffman announced that the company is going to make changes in its API policy and will charge LLM companies for sourcing data from the community platform. He, however, mentioned that the third-party apps, which are enhancing the experience of Reddit users, will not be affected by the policy change and will continue sourcing data for free. A few months later, the policy is impacting both LLM companies and third-party apps alike. If Apollo plans to continue giving the service, it will have to pay about $20 million annually to Reddit.
Read the full story here.
Комментариев нет:
Отправить комментарий
Примечание. Отправлять комментарии могут только участники этого блога.