IT이야기2024. 3. 13. 05:38

Transformer framework/architecture 덕에 AI가 사람이 사용할만한 진전을 이루었는데, Transformer를 대체하고 AI evolution을 이끌 architecture  는 뭐가 있는지 물어보니.

Pathways를 가장 먼저 꼽니다. 이것도 구글이 만들고 있으니 장단점을 잘 알고 잘 보안할수도 있을듯. 그런데 모든 AI 모델이 transformer로 train되고 있으니, 더 좋을 것을 만들어 내더라도 전환하는데 시간이 많이 걸릴듯.

  1. Pathways by Google AI: This architecture focuses on building a single model capable of thousands of tasks by utilizing a flexible foundation and modular components. It tackles the issue of specialized models by enabling a more general-purpose approach (https://blog.google/technology/ai/introducing-pathways-next-generation-ai-architecture/).
  2. Generative AI Frameworks: These frameworks like Langchain focus on Generative AI models that create entirely new content. They leverage large language models (LLMs) like me and go beyond pattern recognition in data, aiming for a deeper understanding (https://www.analyticsvidhya.com/blog/2023/04/what-is-generative-ai/).
  3. AIfES for Edge AI: This framework targets specifically edge AI, where processing happens on devices themselves. AIfES aims for better hardware integration and flexibility to handle the evolving needs of on-device AI (https://pubmed.ncbi.nlm.nih.gov/38236682/).

-----------

  1. Pathways: Google Research is working on a next-generation AI architecture called Pathways. Unlike current models that specialize in individual tasks, Pathways aims to handle thousands or even millions of tasks simultaneously. Rather than training each model from scratch for a specific problem, Pathways synthesizes existing strengths and adapts to new tasks quickly. This architecture reflects a better understanding of the world and has the potential to tackle complex challenges we face today.
  2. Mamba: While the Transformer remains dominant, there are contenders like Mamba. Mamba achieves five times higher throughput than Transformers due to its recurrent nature. However, it’s essential to note that the Transformer is unlikely to relinquish its throne anytime soon, especially given the recent successes of language models like ChatGPT and Gemini, which build upon the Transformer’s foundation.
  3. BASED
Posted by 쁘레드
IT이야기2024. 3. 7. 04:00

AMD가 Xilinx를 인수한 이후에 젤 큰 업데이트 인것 같습니다. 2-3년 이내에 FPGA가 AI 관련 system에서 아주 중요한 일을 할수 있을것으로 기대하고 있습니다. Spartan family를 유심히 봐야할것 같습니다.

https://ir.amd.com/news-events/press-releases/detail/1186/amd-extends-market-leading-fpga-portfolio-with-amd-spartan

 

AMD Extends Market-Leading FPGA Portfolio with AMD Spartan UltraScale+ Family Built for Cost-Sensitive Edge Applications

Browse AMD’s company-wide and financial press releases.

ir.amd.com

https://www.phoronix.com/news/AMD-Spartan-UltraScale-Plus

 

AMD Announces Spartan UltraScale+ FPGA Family - Phoronix

Michael Larabel is the principal author of Phoronix.com and founded the site in 2004 with a focus on enriching the Linux hardware experience. Michael has written more than 20,000 articles covering the state of Linux hardware support, Linux performance, gra

www.phoronix.com

https://semiengineering.com/using-fpgas-for-ai/

 

Using FPGAs For AI

How good are standard FPGAs for AI purposes, and how different will dedicated FPGA-based devices be from them?

semiengineering.com

https://embeddedcomputing.com/technology/processing/semiconductor-ip/fpga-insights-and-trends-2023-unleashing-the-power-of-fpga

 

FPGA Insights and Trends 2023: Unleashing the Power of FPGA - Embedded Computing Design

Step into the world of limitless innovation and technological transformation as we delve into the revolutionary rise of field-programmable gate arrays (FPGAs) and the booming market of 2023.

embeddedcomputing.com

Xilinx가 70%이상의 점유율을 가지고 있습니다.
Intel/Altera가 FPGA개발에 좋다고 답변한 사람이 많다는 것도 주목할 만하네요

Posted by 쁘레드
추천영화드라마2024. 3. 5. 03:59

IMAX도 아니고 RPX도 아닌 극장에서 봤는데도 시간가는줄 모르고 봤습니다. 가족모두 끝나고 최근 기억나는 영화중 최고다고 극찬. 최근 몇년중에서는 흥행기록도 최고인데, 다른 대작 Sci-Fi영화에 비해서는 흥행성적은 안좋네요. 영화관이 줄고 좌석도 줄고 있어서 어벤져스 엔드게임같은 흥행은 앞으로 어려울것 같습니다.

Dune: Part Two, released in February 2024, dominated its opening weekend at the box office, grossing a staggering $178.5 million globally. Here's how it compares to other famous sci-fi movies' first weeks:

  • Avengers: Endgame: $357 million
  • Star Wars: The Force Awakens (2015): $247.8 million (holds the all-time record for the biggest opening weekend)
  • Avatar (2009): $241.5 million (second-highest grossing opening weekend)
  • Avengers: Infinity War (2018): $258 million (highest for the Marvel Cinematic Universe)
  • Jurassic World (2015): $208.8 million
  • The Avengers (2012): $207.4 million

--------

 

Posted by 쁘레드