IT이야기2024. 3. 13. 05:38

Transformer framework/architecture 덕에 AI가 사람이 사용할만한 진전을 이루었는데, Transformer를 대체하고 AI evolution을 이끌 architecture  는 뭐가 있는지 물어보니.

Pathways를 가장 먼저 꼽니다. 이것도 구글이 만들고 있으니 장단점을 잘 알고 잘 보안할수도 있을듯. 그런데 모든 AI 모델이 transformer로 train되고 있으니, 더 좋을 것을 만들어 내더라도 전환하는데 시간이 많이 걸릴듯.

  1. Pathways by Google AI: This architecture focuses on building a single model capable of thousands of tasks by utilizing a flexible foundation and modular components. It tackles the issue of specialized models by enabling a more general-purpose approach (https://blog.google/technology/ai/introducing-pathways-next-generation-ai-architecture/).
  2. Generative AI Frameworks: These frameworks like Langchain focus on Generative AI models that create entirely new content. They leverage large language models (LLMs) like me and go beyond pattern recognition in data, aiming for a deeper understanding (https://www.analyticsvidhya.com/blog/2023/04/what-is-generative-ai/).
  3. AIfES for Edge AI: This framework targets specifically edge AI, where processing happens on devices themselves. AIfES aims for better hardware integration and flexibility to handle the evolving needs of on-device AI (https://pubmed.ncbi.nlm.nih.gov/38236682/).

-----------

  1. Pathways: Google Research is working on a next-generation AI architecture called Pathways. Unlike current models that specialize in individual tasks, Pathways aims to handle thousands or even millions of tasks simultaneously. Rather than training each model from scratch for a specific problem, Pathways synthesizes existing strengths and adapts to new tasks quickly. This architecture reflects a better understanding of the world and has the potential to tackle complex challenges we face today.
  2. Mamba: While the Transformer remains dominant, there are contenders like Mamba. Mamba achieves five times higher throughput than Transformers due to its recurrent nature. However, it’s essential to note that the Transformer is unlikely to relinquish its throne anytime soon, especially given the recent successes of language models like ChatGPT and Gemini, which build upon the Transformer’s foundation.
  3. BASED
Posted by 쁘레드
IT이야기2024. 3. 7. 04:00

AMD가 Xilinx를 인수한 이후에 젤 큰 업데이트 인것 같습니다. 2-3년 이내에 FPGA가 AI 관련 system에서 아주 중요한 일을 할수 있을것으로 기대하고 있습니다. Spartan family를 유심히 봐야할것 같습니다.

https://ir.amd.com/news-events/press-releases/detail/1186/amd-extends-market-leading-fpga-portfolio-with-amd-spartan

 

AMD Extends Market-Leading FPGA Portfolio with AMD Spartan UltraScale+ Family Built for Cost-Sensitive Edge Applications

Browse AMD’s company-wide and financial press releases.

ir.amd.com

https://www.phoronix.com/news/AMD-Spartan-UltraScale-Plus

 

AMD Announces Spartan UltraScale+ FPGA Family - Phoronix

Michael Larabel is the principal author of Phoronix.com and founded the site in 2004 with a focus on enriching the Linux hardware experience. Michael has written more than 20,000 articles covering the state of Linux hardware support, Linux performance, gra

www.phoronix.com

https://semiengineering.com/using-fpgas-for-ai/

 

Using FPGAs For AI

How good are standard FPGAs for AI purposes, and how different will dedicated FPGA-based devices be from them?

semiengineering.com

https://embeddedcomputing.com/technology/processing/semiconductor-ip/fpga-insights-and-trends-2023-unleashing-the-power-of-fpga

 

FPGA Insights and Trends 2023: Unleashing the Power of FPGA - Embedded Computing Design

Step into the world of limitless innovation and technological transformation as we delve into the revolutionary rise of field-programmable gate arrays (FPGAs) and the booming market of 2023.

embeddedcomputing.com

Xilinx가 70%이상의 점유율을 가지고 있습니다.
Intel/Altera가 FPGA개발에 좋다고 답변한 사람이 많다는 것도 주목할 만하네요

Posted by 쁘레드
추천영화드라마2024. 3. 5. 03:59

IMAX도 아니고 RPX도 아닌 극장에서 봤는데도 시간가는줄 모르고 봤습니다. 가족모두 끝나고 최근 기억나는 영화중 최고다고 극찬. 최근 몇년중에서는 흥행기록도 최고인데, 다른 대작 Sci-Fi영화에 비해서는 흥행성적은 안좋네요. 영화관이 줄고 좌석도 줄고 있어서 어벤져스 엔드게임같은 흥행은 앞으로 어려울것 같습니다.

Dune: Part Two, released in February 2024, dominated its opening weekend at the box office, grossing a staggering $178.5 million globally. Here's how it compares to other famous sci-fi movies' first weeks:

  • Avengers: Endgame: $357 million
  • Star Wars: The Force Awakens (2015): $247.8 million (holds the all-time record for the biggest opening weekend)
  • Avatar (2009): $241.5 million (second-highest grossing opening weekend)
  • Avengers: Infinity War (2018): $258 million (highest for the Marvel Cinematic Universe)
  • Jurassic World (2015): $208.8 million
  • The Avengers (2012): $207.4 million

--------

 

Posted by 쁘레드
경제이야기/Stock2024. 3. 2. 02:33

이번주에 AMD가 $300B Market cap을 넘어섰습니다. 오늘은 장중이지만 주가가 200달라도 넘어가네요.

AMD의 성장세가 무섭습니다. 서버시장에서 인텔의 아성을 위협하고 있고 GPU분야에서는 유일한 NVidia와 경쟁할수 있는 회사입니다. 게다가 세계 최고의 FPGA solution을 가지고 있습니다. AI시대에 계속 높은 성장률을 이룰것으로 보입니다.

Fastest GPU (MI300x)
Fastest CPU (Epyc)
Fastest FPGA Versal VP1902

 

 

 

Posted by 쁘레드
Posted by 쁘레드
IT이야기2024. 1. 25. 01:22

https://www.ml6.eu/blogpost/unlocking-the-secrets-of-life-ai-protein-models-demystified

 

#AIinBiology #ProteinEngineering #AIProteinModels #DrugDesign #StructurePrediction #FunctionAnalysis #ArtificialIntelligence #Pr

This blogpost is aimed at those who want to understand how artificial intelligence is being implemented in the field of biology, specifically with regard to proteins. We give a brief overview of what proteins are, their characteristics and the applications

www.ml6.eu

거대 기업들의 역활을 잘 정리한것 같다

  • Google의 Deepmind는 DeepX, Alpahfold
  • Meta의 ESM
  • Microsoft의 MIF-ST

MS의 protein sequence model은 github에 PyTorch, python opensource로 공개도 되어 있다

https://github.com/microsoft/protein-sequence-models

 

GitHub - microsoft/protein-sequence-models

Contribute to microsoft/protein-sequence-models development by creating an account on GitHub.

github.com

이 리포트를 만든 사람이 다니는 회사도 상당히 재미있다. Business solution을 E2E로 지원한다고 하는데 사람 숫자는 많지 않고 machine learning과 AI관련 솔루션 정도를 소개하는 수준 정도로 일을 하는것 같다. 오피스는 독일 베를린(Berlin)과 네델란드 암스테르담(Amsterdam).

 

Posted by 쁘레드
추천영화드라마2024. 1. 13. 07:27

영화 If I Stay 영화를 보면 Portland, Clackamas 지역에 눈 경보가 있다는 뉴스가 나오면서 지역이 포틀랜드 지역이라는 것을 이야기 합니다. 주인공이 사는 집과 지역은 전형적인 미국의 Pacific Northwest의 (중하) 중산층 가정으로 그리집니다. 그러나 영화촬영은 캐나다 밴쿠버 지역에서 했다고 나오네요.

오레곤 서부해안에서 그렘린 (Gremlins, 1984)이 촬영된 것으로도 유명한데요, 궁금해서 포틀랜드를 기반으로 한 영화는 어떤것이 있는지 알아봤더니오

----------------

Major blockbusters:

  • Twilight saga (2008-2012): The entire series, including iconic locations like Forks High School and Bella's Swan family home.
  • Free Willy (1993): The heartwarming story of a boy and his orca whale was filmed at the Oregon Coast Aquarium and Keizer Station Park.
  • Animal House (1978): The legendary college comedy classic used the University of Oregon campus as its primary filming location.

Acclaimed independent films:

  • Gus Van Sant's works: He often features Portland as a backdrop, including "Mala Noche" (1985), "Drugstore Cowboy" (1989), "My Own Private Idaho" (1991), and "Elephant" (2003).
  • Paranoid Park (2007): Gus Van Sant again captures the city's underbelly in this gritty coming-of-age tale.
  • Leave No Trace (2018): A poignant drama about a father and daughter living off the grid, filmed in Forest Park and the surrounding wilderness.

Other notable mentions:

  • Untraceable (2008): Diane Lane stars in this thriller against the backdrop of Portland's urban landscape.
  • Homeward Bound: The Incredible Journey (1993): The heartwarming animal adventure features scenes filmed in Washington Park and along the Oregon Coast.
  • Kindergarten Cop (1990): Arnold Schwarzenegger patrols the halls of Astor Elementary School in this action comedy.
  • Night of the Living Dead (1968): The iconic low-budget horror film utilized local cemeteries and Forest Park for its eerie atmosphere.
  • Recent TV series: "Portlandia" (2011-2018) hilariously satirized the city's culture, while "Grimm" (2011-2017) incorporated Portland's unique atmosphere into its fantasy-crime narrative.

This is just a small selection, and there are hundreds of other movies and TV shows that have been filmed in the Portland area. Exploring resources like:

----------------

  1. Twilight (2008): Some scenes from the popular vampire romance film were shot in St. Helens, Oregon, which is near Portland.
  2. Portlandia (2011-2018): Although not a movie, this television series is a satirical sketch comedy set and filmed in Portland. It humorously portrays the city's unique culture.
  3. Drugstore Cowboy (1989): This film, directed by Gus Van Sant, is set in and around Portland. It follows a group of drug addicts and their criminal activities.
  4. Wild (2014): Starring Reese Witherspoon, this film is based on Cheryl Strayed's memoir and features scenes shot on the Pacific Crest Trail in Oregon, which includes areas near Portland.
  5. My Own Private Idaho (1991): Another film by Gus Van Sant, it's set in Portland and stars River Phoenix and Keanu Reeves.
  6. Grimm (2011-2017): Again, not a movie, but this TV series is filmed in and around Portland. It's a fantasy crime drama that incorporates Portland's urban and natural landscapes.
  7. Paranoid Park (2007): Directed by Gus Van Sant, this film is set in Portland and follows a teenage skateboarder who becomes involved in a murder investigation.

 

Posted by 쁘레드
IT이야기2024. 1. 9. 07:37

지금까지는 스타벅스 네트웍이 그남아 안정적이고 빠른 편이라서 스타벅스에서 충전도 하면서 유튜브에 올리면 됐었는데, 스타벅스가 돈이 없는지 upload 속도가 2-4배 느려졌다. 스타벅스는 구글에서 네트웍을 셋업해 줬는데 그 관계까 끝났나?

------------------------

피닉스 아리조나에서 어디가면 좋을까 바드에거 물으니

Sure, here are some places with good wifi near Phoenix, AZ that you can go to upload your soccer videos:

  • Jobot Coffee, Diner & Bar at 333 E Roosevelt St, Phoenix, AZ 85004, USA has a rating of 4.5 stars on Google Maps.
  • Scooter's Coffee at 4030 N 7th Ave, Phoenix, AZ 85013, USA is a drive-thru chain serving espresso & other coffee drinks, plus a variety of smoothies & pastries. It has a rating of 4.5 stars on Google Maps.
  • Songbird Coffee & Tea House - Phoenix, AZ at 812 N 3rd St Ac, Phoenix, AZ 85004, USA is a hip cafe with brewed-to-order coffee & tea, comfy sofas & house-baked pastries (with vegan options). It has a rating of 4.7 stars on Google Maps.
  • Window Coffee Bar at 903 W Camelback Rd, Phoenix, AZ 85013, USA has a rating of 5 stars on Google Maps.
  • Lola Coffee at 1001 N 3rd Ave #6, Phoenix, AZ 85003, USA is a bright & airy cafe offering fair-trade, hand-roasted coffees, homemade pastries & poetry nights. It has a rating of 4.5 stars on Google Maps.

I hope this helps!

-----------------------

Bing에게 미국에서 어디 가야하는지 물으니

Upload까지 고려하면 Dunkin' Donuts와 Joe & The Juice를 가야한다고 한다. 2024년에는 좀 달라졌을 수도 있을듯.

I can understand that you are looking for a coffee shop chain with fast network speed to upload videos to YouTube. According to a recent study by PCMag, the fastest coffee chain Wi-Fi in 2019 was Joe & the Juice1. They have an average download speed of 42.4Mbps 1. However, if you are looking for a big national chain, Dunkin’ Donuts has the fastest Wi-Fi speed compared to Starbucks 12.

I hope this information helps you find a coffee shop with fast network speed. Let me know if you have any other questions.

Posted by 쁘레드
IT이야기2024. 1. 3. 07:23

Python programming에 도움줄 AI programming helper는 어떤것이 좋을까.

  • 13B LosslessMegaCoder
  • 15B WizardCoder
  • 2.8B Phi-2
  • 6.8B Magicoder-S-DS

https://huggingface.co/spaces/mike-ravkine/can-ai-code-results

 

Can Ai Code Results - a Hugging Face Space by mike-ravkine

 

huggingface.co

 

Posted by 쁘레드
IT이야기2023. 12. 30. 09:09

여기에 이름 올리면 안되는데. 머스크는 정말 매년 새롭습니다. 2024년에도 또 좋고 나쁜 뉴스로 또 놀래켜 줄거라 믿습니다.

  1. Elon Musk
  2. Disney CEO Bob Iger
  3. Silicon Valley Bank CEO Greg Becker
  4. Credit Suisse CEO Ulrich Körner
  5. Binance CEO Changpeng Zhao
  6. China Renaissance CEO Bao Fan
  7. Country Garden chairperson Yang Huiyan
  8. Adani Group founder Gautam Adani
  9. Walgreens CEO Rosalind Brewer
  10. BP CEO Bernard Looney

From top, clockwise: Disney CEO Bob Iger, Credit Suisse CEO Ulrich Körner, Tesla, SpaceX CEO, and X (formerly Twitter) owner and former CEO Elon Musk, China Renaissance CEO Bao Fan, Silicon Valley Bank CEO Greg Becker, Country Garden CEO Yang Huiyan, BP CEO Bernard Looney, Walgreens Boots Alliance CEO Rosalind Brewer, Adani Group CEO Gautam Adani, Binance CEO Changpeng Zhao.

https://www.cnn.com/2023/12/29/business/elon-musk-other-ceos-very-bad-2023/index.html

 

Elon Musk and these other 9 bosses had a terrible, horrible, no good, very bad 2023 | CNN Business

 

www.cnn.com

 

'IT이야기' 카테고리의 다른 글

미국 YouTube에 비디오 올릴때 어딜가면 좋을까  (0) 2024.01.09
Python AI programming helper  (0) 2024.01.03
리눅스 윈도우 dual boot  (0) 2023.12.27
AI Powered Video editor  (0) 2023.12.06
2023 슈퍼컴퓨터 순위 top500  (0) 2023.11.15
Posted by 쁘레드