| | | | | | Hey there! Today, your friendly AI Human, Amit Raja Naik, is thinking about how compute will become the currency of the future. Who knows, maybe soon, we'll say, “A token saved is a token earned!” The future does look exciting… | | | | | | | | | | | | The Indian government recently struck a deal with NVIDIA to procure 10,000 GPUs and offer them to local startups, researchers, academic institutions, and other users at a subsidised rate under its INR 10,000 crore India AI Mission. Former chief architect of Aadhaar Pramod Varma described it as quite ‘tricky’ to evaluate which startups will receive how many GPUs. "Besides procuring for their own purposes, the Indian government can potentially create a financial product, like a compute bond, where startups and VCs can buy vouchers by investing into it,” added Varma in an exclusive interview with AIM. He further said that this bond would allow the government to pool the demand for computational resources from multiple startups and VCs, giving the government an upper hand. “The government can say if so many investments have come through this bond, I have a collective negotiation power, instead of each startup/VC trying to negotiate [independently] for their startup,” said Varma. Altman recently said in an interview with Lex Fridman, “Compute is going to be the currency of the future. It may become the most valuable commodity in the world. We should invest significantly in expanding compute resources.” In a similar vein, Altman proposed a concept where everyone would have access to a portion of GPT-7’s computing resources. “I wonder if the future looks something more like ‘universal basic compute’ than universal basic income, where everyone receives a slice of GPT-7 compute,” Altman speculated. | | | | | | | Towards Open Cloud Compute | | | | | Recently, People+AI launched Open Cloud Compute (OCC), a project that seeks to create an open network of compute resources, making it easier for businesses, especially startups, to access the compute power they need without being locked into specific cloud providers.
“Our idea is to have many, many micro data centres collectively behaving like a mega data centre. That is our network model,” said Varma, drawing an analogy that one bee doesn't matter, but a swarm of bees is suddenly very powerful.
Several compute providers are emerging in India, including Yotta, E2E Networks, Johnaic, Ola Krutrim, and Jarvislabs. Although these providers are not as large as hyperscalers like Microsoft Azure, AWS, and Google Cloud, they have the potential to challenge them collectively.
Yotta, backed by the Hiranandani group, is set to establish a GPU infrastructure with 32,768 GPUs by the end of 2025. Meanwhile, NeevCloud plans to acquire 40,000 GPUs by 2026. Jarvislabs has also secured access to thousands of NVIDIA H100s.
“One of the challenges these smaller players are facing is discoverability. Besides helping them with marketing, OCC also aims to support them in figuring out the right tax subsidies, infrastructural policies and ease of doing business,” Tanvi Lall, the director of strategy at People+AI, told AIM.
At the same time, India's data centres' rapid growth is currently being fueled by coal-generated power, threatening sustainability goals and exacerbating the nation's water crisis. Read more here. | | | | | | | Varma said that OCC allows lower capital businesses and SMEs to come in and play the larger game. “Today, you can perfectly imagine a 105,000 square feet data centre suddenly becoming 500,000 square feet of compute.”
To date, OCC has already teamed up with 24 technology partners, including Oracle Cloud, Vigyan Labs, Protean Cloud, Dell, NeevCloud, and Tata Communications, among others. He said the concept is similar to how Microsoft Azure or AWS works. They could have ten or more data centres in the country, but users are only concerned about the APIs they provide. Any user can simply log into the Open Cloud Compute Network, and upon typing their requirements in the search box, they will be shown multiple providers. Each provider card displays the location, usage cost, and a green rating of the provider. It also includes the SLAs promised. “The idea is to create an open network of providers coming together powered by protocols rather than a platform aggregating everything. They can remain decentralised, but they can be discovered, transacted, or contracted through a protocol, and that's a very, very interesting way, as big as the internet,” added Varma.
OCC aligns with national initiatives like the India AI Mission, which aims to build a scalable AI computing infrastructure by deploying thousands of GPUs through public-private collaborations.
According to Lall, hyperscalers like AWS, Azure and Google Cloud could even be part of the network. “ Our entire approach is plus one. The idea is not to leave certain folks out. There is room for everybody and that is the reason we approached Oracle Cloud.”
“If the hyperscalers feel they have something to offer in the Indian context, they are welcome. It would also be foolish for us to imagine that everyone will abandon the big CSPs as and when the network is up and running,” said Lall.
Check out the full story here. | | | | | | | Vector Databases are Ridiculously Good | | | | | Building large language models requires complicated data structures and computations, which conventional databases are not designed to handle. Consequently, the importance of vector databases has surged since the onset of the generative AI race. He further added that vector databases, with their ability to store floating-point arrays and be searched using a similarity function, offer a practical and efficient solution for AI applications. Enjoy the full story here. | | | | | | | BluSmart raised $24 million in Pre-Series B funding, led by MS Dhoni Family Office and responsAbility Investments AG, to scale operations, expand EV infrastructure, and support sustainable mobility initiatives in major Indian cities. Apple recently recorded $8 billion in annual sales in India, driven by expanded manufacturing and new flagship stores. The company’s revenue in India surged by 33% in the fiscal year ending March 2024. AMD has partnered with IIT Bombay’s SINE incubator to support semiconductor startups in India by providing grants for developing energy-efficient Spiking Neural Network chips. | | | | | AIM Workshop: RAG & Fine Tuning in GenAI with Snowflake | | | | | | | Join Prashant Wate from Snowflake India for an exciting workshop on RAG & Fine Tuning in GenAI. Learn how to optimise models and create seamless AI apps effortlessly. Date: July 25, 2024 Time: 6 - 7.30 PM | | | | | | | | | Cypher 2024 marks a significant expansion as it celebrates its 8th edition by branching out to the USA in addition to its already established presence in India. Browse through the links below to learn more about the different editions of Cypher 2024. These links will guide you to comprehensive event information, including agendas, speakers, registration details, and more. | | | | | Enjoying Sector 6 (formerly AIM Daily XO)? Share it with colleagues or friends – they can sign up here. We love hearing from our readers! Have thoughts on our new format? Questions, comments, or ideas are always welcome. If there’s a specific topic in AI or analytics that you're curious about, tell us! Reach out to us at info@analyticsindiamag.com. Stay tuned for more insights in our next edition!
Curated with ♥️ in Namma Bengaluru | | | | | | | | |
Комментариев нет:
Отправить комментарий
Примечание. Отправлять комментарии могут только участники этого блога.