Microsoft goes all in on ChatGPT. In talks of a 10 billion dollar investment and more

[ORDER_66]

CEO just got ousted

What did he do???

 

[bnew]

What did he do???

theres more info in the link

Sam Altman's sister, Annie Altman, claims Sam has severely abused her — LessWrong

TW: Sexual assault, abuse, child abuse, suicidal ideation, severe mental illnesses/trauma, graphic (sexual) langauge …

www.lesswrong.com

Sam Altman's sister, Annie Altman, claims Sam has severely abused her​

by pl5015

33 min read7th Oct 202387 comments

Sam Altman's sister, Annie Altman, claims Sam has severely abused her​

by pl5015

33 min read7th Oct 202387 comments

​

TW: Sexual assault, abuse, child abuse, suicidal ideation, severe mental illnesses/trauma, graphic (sexual) langauge



This post aims to aggregate a collection of statements made by Annie Altman, Sam Altman's (lesser-known) younger sister, in which Annie asserts that she has suffered various (severe) forms of abuse from Sam Altman throughout her life (as well as from her brother Jack Altman, though to a lesser extent.)

Annie states that the forms of abuse she's endured include sexual, physical, emotional, verbal, financial, technological (shadowbanning), pharmacological (forced Zoloft), and psychological abuse.

I do not attempt to speak for Annie; rather, my goal is to provide an objective and unbiased aggregation of the claims Annie has made, as well as of relevant media surrounding this topic.

I have made this post because I think that it is valuable to be aware of the existence of the claims that Annie has made against Sam, given his strong influence over the development and alignment of increasingly powerful AI models. I have also made this post because I think that these claims are not covered well elsewhere (at least, at the time of this post's writing.)

Disclaimer: I have tried my best to assemble all relevant information I could find related to this (extremely serious) topic, but this is likely not a complete compendium of information regarding the (claimed) abuse of Annie Altman by Sam Altman.

Disclaimer: I would like to note that this is my first post on LessWrong. I have tried my best to meet the writing standards of this website, and to incorporate the advice given in the New User Guide. I apologize in advance for any shortcomings in my writing, and am very much open to feedback and commentary.

Relevant excerpts from Annie's social media accounts​

c.f. Annie Altman's:

• X account
  
• (primary) Instagram account
  
• Medium account (her blog)
  
• Youtube account
  
• TikTok account
  
• Podcast, All Humans Are Human (formerly/alternately known as the Annie Altman Show, The HumAnnie, and True shyt)
  
  
  • Especially: 21. Podcastukkah #5: Feedback is feedback with Sam Altman, Max Altman, and Jack Altman, published Dec 7, 2018
    
    
  
  

Note: throughout these excerpts, I'll underline and/or bold sections I feel are particularly important or relevant.

From her X account​

1. 
   
   1. "I’m not four years old with a 13 year old “brother” climbing into my bed non-consensuallyanymore. (You’re welcome for helping you figure out your sexuality.) I’ve finally accepted that you’ve always been and always will be more scared of me than I’ve been of you."
      
      1. Note: The "brother" in question (obviously) being Sam Altman.
         
         
   2. 
      
      1. "Aww you’re nervous I’m defending myself? Refusing to die with your secrets, refusing to allow you to harm more people? If only there was little sister with a bed you could uninvited crawl in, or sick 20-something sister you could withhold your dead dad’s money from, to cope."
         
         
      
      
   
   
2. 
   
   1. "Sam and Jack, I know you remember my Torah portion was about Moses forgiving his brothers. “Forgive them father for they know not what they’ve done” Sexual, physical, emotional, verbal, financial, and technological abuse. Never forgotten."
      
   2. 
      
      1. "Thank you for the love and for calling I spade a spade. I experienced every single form of abuse with him - sexual, physical, verbal, psychology, pharmacological (forced Zoloft, also later told I’d receive money only if I went back on it), and technological (shadowbanning)"
         
         
   3. 
      
      1. "I experienced sexual, physical, emotional, verbal, financial, and technological abuse from my biological siblings, mostly Sam Altman and some from Jack Altman."
         
         
      
      
   
   
3. 
   
   1. "{I experienced} Shadowbanning across all platforms except onlyfans and pornhub. Also had 6 months of hacking into almost all my accounts and wifi when I first started the podcast"
      
   2. Sam Altman's sister says he sexually abused her when she was 4 | Hacker News,
      
      1. Some commenters on Hacker News claim that a post regarding Annie's claims that Sam sexually assaulted her at age 4 has been being repeatedly removed.
         
         
      
      
   
   
4. 
   
   1. "I feel strongly that others have also been abused by these perpetrators. I’m seeking people to join me in pursuing legal justice, safety for others in the future, and group healing. Please message me with any information, you can remain however anonymous you feel safe."
      
      
5. 
   
   1. "This tweet endorsed to come out of my drafts by our Dad
      
      
      
      He also said it was “poor foresight” for you to believe I would off myself before ~justice is served~"
      
      
6. 
   
   1. (Jokingly) "{Sam's 'nuclear backpack'} may also hold our Dad and Grandma’s trusts {which} him {Sam} and my birth mother are still withholding from me, knowing I started sex work for survival because of being sick and broke with a millionaire “brother”"
      
   2. A reply to Annie's post: "https://nymag.com/intelligencer/article/sam-altman-artificial-intelligence-openai-profile.html…I feel like you are misrepresenting things here. If the article is correct of course. "Sam offered to buy Annie a house." Isn't that a big financial help?"
      
      1. Annie's replies:
         
         1. 
            
            1. "There were other strings attached they made it feel like an unsafe place to actually heal from the experiences I had with him."
               
               
         2. 
            
            1. "The offer was after a year and half no contact {with Sam}, and {I} had started speaking up online. I had already started survival sex work. The offer was for the house to be connected with a lawyer, and the last time I had a Sam-lawyer connection I didn’t get to see my Dad’s will for a year."
               
   
   
7. 
   
   1. "I was too sick for “normal” standing jobs. Tendon and nerve pain, and ovarian cysts. “Pathetic” to you seems to mean something outside of your understanding"
      
8. 
   
   1. Annie states that (Sam's) technological abuse (shadowbanning) has made it hard for her to make an income / financially support herself.
      
   2. She refers to Sam as her "first client" in her (current) sexual line of work.
      

 

[re'up]

That's too messy no matter what's true and what's not for anyone that high profile position, the board probably wanted him gone for awhile now.

 

[bnew]

 

[BaggerofTea]

The story of half the white women I have dealt with. Always some molestation of abuse in the picture

 

[bnew]

Bing Search Gets Generative AI Captions Feature, Here's What It Does

The newly introduced Generative AI Captions feature is powered by OpenAI's latest LLM, GPT 4.

www.ibtimes.co.uk

Bing Search Gets Generative AI Captions Feature, Here's What It Does​

The newly introduced Generative AI Captions feature is powered by OpenAI's latest LLM, GPT 4.​

By

Vinay Patel @VinayPatelBlogs

11/21/23 AT 8:25 AM GMT

Microsoft's latest update lets Bing Search results shows AI generated webpage summaries and snippets. WIKIMEDIA COMMONS

Microsoft has added a new feature dubbed Generative AI Captions to Bing Search. The feature offers customised snippets and summaries of individual web pages.

Microsoft recently rebranded Bing Chat to Copilot. Aside from this, the Redmond-based tech giant is rolling out new features to its Bing Search.

In a blog post, Microsoft said Generative Captions are powered by OpenAI's latest large language model (LLM), GPT 4. After analysing search queries, the feature extracts information from a webpage and presents them in what it describes as "easily digestible snippets".

Generative Captions will be different for every query and will probably generate unique snippets based on what the user is looking for. Microsoft also clarified that the feature isn't always likely to reflect the exact words used on the page since it generates these captions using a mixture of signals and techniques.

Furthermore, the company noted that website owners will have the option to opt out of Generative Captions by using the NOCACHE and NOARCHIVE tags. However, they might have to do this manually.

Microsoft also added a slew of new features to its Bing Webmaster tools. Now, website owners can see how much traffic they are getting from search queries and Bing Chat.

The latest Bing Search feature could turn out to be an alternative to Google's Notes feature for the search results and articles on Discover, which is part of Google Search.

Microsoft updates Bing Chat​

According to an earlier report, Microsoft is planning to let users turn off Bing Chat's search engine. While the company has neither confirmed nor denied this speculation yet, it has updated the Bing AI chatbot service.

This update will restrict people from generating fake film posters such as those containing Disney's logo and help the company avoid copyright infringement, as per a report by The Register.

Social media users have been using AI to generate images of dogs as Disney characters for a while now. Much to their chagrin, the trend caught the attention of the entertainment giant.

I saw this morning Disney AI Poster Trend Drives Microsoft To Alter Bing Image Creator: Illustrations 297677818, 283175153, 291280580 © Stockeeco | Stock Photos & Images, Vectors, Video & Audio - Dreamstime

Microsoft is steering clear of the dog house after its… https://t.co/9gbzUMpLx1 👁

— alasdair lennox (@isawthismorning) November 20, 2023

As a result, Microsoft decided to temporarily block the word "Disney" in people's prompts, according to a Financial Times report. While the ban has been lifted, Bing has reportedly stopped recreating Disney's wording or logo.

This incident has reignited controversy surrounding AI text-to-image models' ability to violate copyright. Apparently, these models were trained on protected IP and trademarks and are capable of accurately generating the content.

In one of the examples, a person asked Midjourney AI to generate an image of an "average woman of Afghanistan". Notably, the AI tool came up with an almost carbon copy of the iconic 1984 photo of Sharbat Gula, taken by American photographer Steve McCurry.

This is the best example I've found yet of how derivative AI 'art' is. The person who generated the image on the left asked Midjourney to generate 'an average woman of Afghanistan'. It produced an almost carbon copy of the 1984 photo of Sharbat Gula, taken by Steve McCurry. 1/ pic.twitter.com/D0FDbqrcPA

— Anwen Kya (@Kyatic) November 16, 2023

Artists and illustrators, who have sued companies building AI text-to-image tools argue that the software can directly rip off their work and copy their styles. The defendants, on the other hand, believe it is imperative to protect AI-generated images under fair use since the images simply transform original works rather than replace them.

Microsoft now lets you uninstall Edge, Bing, Cortana​

It will be interesting to see whether Microsoft will introduce stricter rules for using its AI image creator. In the meantime, the company has rolled out a new update for Windows users in Europe, allowing them to uninstall some of its basic apps including Cortana, the Edge browser and Bing Search.

IBT UK Morning Brief - Let the best of International News come to you

Sign up and stay up to date with our daily newsletter.

You can unsubscribe at any time. By signing up you are agreeing to our Terms of Service and Privacy Policy.

It is worth noting that Microsoft is not rolling out this update to provide a superior user experience or to let users decide which app they want to get rid of. Instead. the tech behemoth is making this change to comply with The Digital Markets Act (DMA).

DMA, which was announced by the European Union, urges Microsoft to give its users the option to remove all basic apps. This act is slated to come into effect in March 2024 in the European Economic Area (EEA).

 

[bnew]

Microsoft’s Edge Copilot AI can’t really summarize every YouTube video

It leans on text from subtitles and transcriptions.

www.theverge.com

Microsoft’s Edge Copilot AI can’t really summarize every YouTube video​

The chatbot’s summarization feature relies on preprocessed video data or existing subtitles and transcripts.​

By Amrita Khalid, one of the authors of audio industry newsletter Hot Pod. Khalid has covered tech, surveillance policy, consumer gadgets, and online communities for more than a decade.

Dec 8, 2023, 9:18 PM EST|7 Comments / 7 New

Image: The Verge

One feature added to Microsoft’s AI Copilot in the Edge browser this week is the ability to generate text summaries of videos. But Edge Copilot’s time-saving feature is still fairly limited and only works on pre-processed videos or those with subtitles, as Mikhail Parakhin, Microsoft’s CEO of advertising and web services, explained.

As spotted by MSPowerUser, Parakhin writes, “In order for it to work, we need to pre-process the video. If the video has subtitles - we can always fallback on that, if it does not and we didn’t preprocess it yet - then it won’t work,” in response to a question.



In other words, on its own Edge Copilot doesn’t so much summarize videos as it summarizes the text transcripts of the videos. Copilot can also perform a similar function throughout Microsoft 365, including summarizing Teams video meetings and calls for customer service agents — and in both cases, the audio needs to be transcribed first by Microsoft. Copilot on Microsoft Stream can also summarize any video, but again, it requires users to generate a written transcript.

Microsoft

The conversation started after designer Pietro Schirano posted a screen recording of Edge Copilot summarizing a YouTube video about the GTA VI trailer. In this case, Copilot appeared to be doing its job perfectly. The user in the recording presses the “Generate video summary” button in the Copilot sidebar, and mere seconds later, Copilot churns one out, complete with highlights and timestamps.

Of course, many platforms, including YouTube and Vimeo, can automatically generate transcripts and subtitles — if users enable the feature. After The Verge asked Parakhin on X if we could assume most publicly available videos (i.e. YouTube) weren’t pre-processed, he replied: “Should work for most videos.”

Copilot is just the latest example of the generative AI race Microsoft is competing in with Google (and others). Last month, Google upgraded the YouTube extension for its Bard chatbot to enable it to summarize the content of a video and surface specific information from it. Just this week, Google announced a major Gemini update that has its own issues — the company’s editing may have misrepresented some of the AI’s capabilities in a demo, and it doesn’t always have its facts straight.

Parakhin has been candid about the various stages of Copilot’s evolution on social media. While on a plane on Tuesday morning, the machine learning expert posted on X: “Adding ability for Edge Copilot to use information in videos - on a flight.”

 

[bnew]

Microsoft Copilot app arrives on iOS, bringing free ChatGPT-4 to iPhone and iPad

Microsoft has released its Copilot app for iOS devices, just two days after I reported exclusively that the iOS version was almost ready. Now, iPhone and iPad users can download it from the Apple App Store. Copilot isn’t just another name for Bing Chat; it brings some cool new things to the...

www.windowslatest.com

Microsoft Copilot app arrives on iOS, bringing free ChatGPT-4 to iPhone and iPad​

By Mayank Parmar

December 30, 2023



Microsoft has released its Copilot app for iOS devices, just two days after I reported exclusively that the iOS version was almost ready. Now, iPhone and iPad users can download it from the Apple App Store. Copilot isn’t just another name for Bing Chat; it brings some cool new things to the table.

Microsoft Copilot app is available via Apple’s App Store, and the tech giant clarified that the AI app is optimized for iPad. In our tests, we also noticed that Copilot app offers better experience than the dedicated ChatGPT app for iPad.

While Bing integrates search, rewards, and chat functionalities, Copilot streamlines its focus on an advanced chat interface, incorporating features like the innovative DALL-E 3. Unlike Bing, which combines search and AI, Copilot emerges as a ChatGPT-like app tailored to iOS devices.

Microsoft Copilot for iPad​

Copilot maintains its versatility as a multi-functional assistant on Android, supporting GPT Vision, GPT-4, and DALL-E. The addition of ChatGPT-4 Turbo, available to select users, enhances its ability to provide information on recent events, especially with the search plugin disabled.

​

Copilot is ChatGPT-4 for iOS, but it’s absolutely free. You can write emails, stories, or even summarize tough texts. It’s great with languages too, helping you translate, proofread, and more. And it’s all free, which Microsoft says won’t change.

​

It also plugin support, even third-party plugins at no extra cost. This can be super handy for planning trips or sprucing up your resume. Plus, there’s the Image Creator that turns your words into pictures right on your phone.

 

[bnew]

Microsoft launches Copilot Pro for $20 per month per user

Copilot Pro gives you the latest features and best models that Microsoft AI has to offer.

searchengineland.com

Microsoft launches Copilot Pro for $20 per month per user​

Copilot Pro gives you the latest features and best models that Microsoft AI has to offer.​

Barry Schwartz on January 15, 2024 at 2:00 pm | Reading time: 2 minutes

Copilot Pro, the most advanced and fastest version of Copilot, has been released today by Microsoft. Copilot, the new name for the new Bing Chat experience, now has a paid version that costs $20 per month per user. This brings “a new premium subscription for individuals that provides a higher tier of service for AI capabilities, brings Copilot AI capabilities to Microsoft 365 Personal and Family subscribers, and new capabilities, such as the ability to create Copilot GPTs,” Microsoft announced.

Features in Copilot Pro. Copilot Pro has these features, that are above and beyond normal Copilot:

• A single AI experience that runs across your devices, understanding your context on the web, on your PC, across your apps and soon on your phone to bring the right skills to you when you need them.
  
• Access to Copilot in Word, Excel, PowerPoint, Outlook, and OneNote on PC, Mac, and iPad for Microsoft 365 Personal and Family subscribers.
  
• Priority access to the very latest models, including the new OpenAI’s GPT-4 Turbo. With Copilot Pro you’ll have access to GPT-4 Turbo during peak times for faster performance and, coming soon, the ability to toggle between models to optimize your experience how you choose, Microsoft explained.
  
• Enhanced AI image creation with Image Creator from Designer (formerly Bing Image Creator) – ensuring it’s faster with 100 boosts per day while bringing you more detailed image quality as well as landscape image format.
  
• The ability to build your own Copilot GPT – a customized Copilot tailored for a specific topic.
  
  

Video overview. Here is a video overview of the new Copilot Pro:

What else is new. Microsoft also announced these general improvements around Copilot:

• Copilot GPTs. Copilot GPTs let you customize the behavior of Microsoft Copilot on a topic that is of particular interest to you.
  
• Copilot mobile app. The Copilot mobile app is now available for Android and iOS.
  
• Copilot in the Microsoft 365 mobile app. Copilot is being added to the Microsoft 360 mobile app for Android and iOS for individuals with a Microsoft account.
  
  

Why we care. If you love Copilot, aka Bing Chat, and want to get the best out of it, you may want to try Copilot Pro. It will give you the more advanced AI models, priorities your prompts before others and give you more usage than the free version.

 

[bnew]

Microsoft makes its AI-powered reading tutor free | TechCrunch

Microsoft has released an AI-powered app, Reading Coach, designed to help students improve their reading comprehension.

techcrunch.com

Microsoft makes its AI-powered reading tutor free​

Kyle Wiggers @kyle_l_wiggers / 1:00 PM EST•January 18, 2024

Image Credits: Nicolas Economou/NurPhoto / Getty Images

Microsoft today made Reading Coach, its AI-powered tool that provides learners with personalized reading practice, available at no cost to anyone with a Microsoft account.

As of this morning, Reading Coach is accessible on the web in preview — a Windows app is forthcoming. And soon (in late spring), Reading Coach will integrate with learning management systems such as Canva, Microsoft says.

“It’s well known that reading is foundational to a student’s academic success; studies show that fluent readers are four times more likely to graduate high school and get better jobs,” Microsoft writes in a blog post. “With the latest AI technology, we have an opportunity to provide learners with personalized, engaging, and transformative reading experiences.”

Reading Coach builds on Reading Progress, a plug-in for the education-focused version of Microsoft Teams, Teams for Education, designed to help teachers foster reading fluency in their students. Inspired by the success of Reading Progress (evidently), Microsoft launched Reading Coach in 2022 as a part of Teams for Education and Immersive Reader, the company’s cross-platform assistive service for language and reading comprehension.

Image Credits: Microsoft

Reading Coach works by having learners identify words they struggle with the most and presenting them with tools to support independent, individualized practice. Based on an educator’s preferences, the tools available can include text to speech, syllable breaking and picture dictionaries.

After a learner practices in Reading Coach, educators can view their work, including which words the student practiced, how many attempts they made and which tools they used. Educators can also share this information with students if they choose.

Recently, Reading Coach received a spruce-up in the form of a “choose your own story” feature, powered by Microsoft’s Azure OpenAI Service, that lets learners tap AI to generate their own narrative adventure.

Akin to the AI-generated story tool on the Amazon Echo Show, Reading Coach’s “choose your own story” has learners select a character, setting and reading level and have AI create content based on these selections and the learner’s most challenging words. (Microsoft says that story content is moderated and filtered for things like “quality, safety and age appropriateness.”) Reading Coach provides feedback on pronunciation, listening to the learner read the story and awarding badges that unlock new characters and scenes as they progress.

Learners who opt not to create their own story can pick from curated passages in ReadWorks, a library of resources for reading comprehension.

“Reading Coach intrinsically motivates learners to continue advancing their skills in several ways,” Microsoft continues. “With the use of AI in an impactful, safe, responsible way, we believe that personalized learning at scale is within reach.”

Microsoft’s rosy view of AI for teaching reading comprehension isn’t shared by all educators, it’s key to note. Experts say that there isn’t a foolproof tool on the market for measuring comprehension, which involves assessing what students know and the strength of their vocabulary as well as whether they can sound out and pronounce words. Students can inadvertently affect evaluations by pressing a wrong button. Or they might get bored with a task a tool’s presenting to them and disengage, leading to a low score.

All that being said, teachers don’t think tools like Reading Coach can hurt. In a recent EdWeek Research Center survey, 44% of educators said that they think adaptive tech does a better job of accurately assessing a students’ reading level than non-adaptive software or pen-and-paper methods.

 

[bnew]

MSN

• Google's legal dispute with Alphabet revealed Microsoft's unsuccessful attempts to have Apple switch to Bing, highlighting Bing's lack of appeal to users.
• Microsoft tried to sell Bing to Apple, but Apple declined due to Bing's lower search quality and investment.
• Given how Bing was an early home for Copilot. it raises questions about the impact of Bing on Microsoft's AI progress.
  

While Bing hasn't exactly made a big splash in the search engine market, one could argue that the service was a good stepping stone for Copilot. After all, Copilot for the Web took over Bing Chat's place, and it has only snowballed from there. However, recent news has revealed that Microsoft did try to sell Bing to Apple, but the deal was cut off due to the quality of Bing's search results.

Microsoft Copilot banner© Provided by XDA Developers

Related

Microsoft Copilot: What is it, and how does it work?​

Is Microsoft Copilot the best AI chatbot available right now?

The time when Microsoft Bing could have been Apple's​

A screenshot of Microsoft's website for Bing AI search© Provided by XDA Developers

As reported by CNBC, the news broke during a legal battle with Alphabet, the holding company for Google. This was during a discussion on whether Google has a monopoly on web searches, with Google arguing that it's playing fair. As part of its argument, it revealed that Microsoft tried to convince Apple to use Bing as its default search engine in 2009, 2013, 2015, 2016, 2018, and 2020. However, each time, Microsoft got the same result:

“In each instance, Apple took a hard look at the relative quality of Bing versus Google and concluded that Google was the superior default choice for its Safari users. That is competition,” Google wrote in the filing.

Furthermore, during Microsoft's 2018 attempt, it offered Apple the chance to either buy Bing or enter a joint venture over it. And as you might expect, Apple wasn't impressed. As per Eddy Cue, Apple’s senior vice president of services:

“Microsoft search quality, their investment in search, everything was not significant at all. And so everything was lower. So the search quality itself wasn’t as good. They weren’t investing at any level comparable to Google or to what Microsoft could invest in. And their advertising organization and how they monetize was not very good either.”

Unfortunately, while Google is trying to argue its case that it doesn't have a monopoly, it's having some collateral damage on Microsoft's own reputation. However, it's an interesting topic to think about; if Bing did end up becoming part of Apple's product line, would Microsoft go on to release Copilot? Was the switch from Bing Chat to Copilot an important catalyst for Microsoft's continued development, or would it have gone full steam ahead even if it lost Bing? Perhaps we'll never know, but at least we have proof that Bing isn't impressing many people, no matter how much Microsoft pesters users to make the switch to Bing.

 

[bnew]

Spoiler: full text

1/1
phi-3-mini: 3.8B model matching Mixtral 8x7B and GPT-3.5

Plus a 7B model that matches Llama 3 8B in many benchmarks.

Plus a 14B model.

[2404.14219] Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone

To post tweets in this format, more info here: https://www.thecoli.com/threads/tips-and-tricks-for-posting-the-coli-megathread.984734/post-52211196

Spoiler: larger images

Spoiler: thread continued

Spoiler: full text

1/5
Microsoft just released Phi-3

Phi-3 14B beats Llama-3 8B, GPt-3.5 and Mixtral 8x7b MoE in most of the benchmarks.

Even the Phi-3 mini beats Llama-3 8B in MMLU and HellaSwag.

2/5
More details and insights to follow in tomorrow's AI newsletter.

Subscribe now to get it delivered to your inbox first thing in the morning tomorrow: Unwind AI | Shubham Saboo | Substack

3/5
Reaserch Paper:

4/5
This is absolutely insane speed of Opensource AI development.

5/5
True, all of this is happening so fast!!


To post tweets in this format, more info here: https://www.thecoli.com/threads/tips-and-tricks-for-posting-the-coli-megathread.984734/post-52211196

Spoiler: larger images

Spoiler: thread continued

Spoiler: full text

1/2
phi-3 is out! never would have guessed that our speculative attempt at creating synthetic python code for phi-1 (following TinyStories) would eventually lead to a gpt-3.5-level SLM. defly addicted to generating synth data by now...

2/2
hf:

Spoiler: links

https://langfuse.datastrain.io/project/cluve1io10001y0rnqesj5bz4/traces/484ec288-6a9d-480b-bcca-9c8dfd965325?observation=b86ac62c-9ac2-40d2-9916-63e4c3e11b17…
@Prince_Canuma
mlx-community (MLX Community)
@answerdotai
@AIatMeta
@huggingface
@MicrosoftAI

microsoft/Phi-3-mini-4k-instruct · Hugging Face

Spoiler: larger images

Spoiler: thread continued

Spoiler: full text

1/5
Amazing numbers. Phi-3 is topping GPT-3.5 on MMLU at 14B. Trained on 3.3 trillion tokens. They say in the paper 'The innovation lies entirely in our dataset for training - composed of heavily filtered web data and synthetic data.'

2/5
Small is so big right now!

3/5
phi-3-mini: 3.8B model matching Mixtral 8x7B and GPT-3.5

Plus a 7B model that matches Llama 3 8B in many benchmarks.

Plus a 14B model.

[2404.14219] Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone

4/5
The prophecy has been fulfilled!


5/5
Wow.
'Phi-3-mini can be quantized to 4-bits so that it only occupies ≈ 1.8GB of memory. We tested the quantized model by deploying phi-3-mini on iPhone 14 with A16 Bionic chip running natively on-device and fully offline achieving more than 12 tokens per second.'


To post tweets in this format, more info here: https://www.thecoli.com/threads/tips-and-tricks-for-posting-the-coli-megathread.984734/post-52211196

Spoiler: larger images

Spoiler: thread continued

Spoiler: full text

1/9
Run Microsoft Phi-3 locally in 3 simple steps (100% free and without internet):

2/9
1. Install Ollama on your Desktop

- Go to https://ollama.com/ - Download Ollama on your computer (works on Mac, Windows and Linux)
- Open the terminal and type this command: 'ollama run phi3'

3/9
2. Install OpenWeb UI (ChatGPT like opensource UI)

- Go to https://docs.openwebui.com - Install the docker image of Open Web UI with a single command
- Make sure Docker is installed and running on your computer

4/9
3. Run the model locally like ChatGPT

- Open the ChatGPT like UI locally by going to this link: http://localhost:3000 - Select the model from the top.
- Query and ask questions like ChatGPT

This is running on Macbook M1 Pro 16GB machine.

5/9
If you find this useful, RT to share it with your friends.

Don't forget to follow me
@Saboo_Shubham_ for more such LLMs tips and resources.

6/9
Run Microsoft Phi-3 locally in 3 simple steps (100% free and without internet):

7/9
Not checked yet.
@ollama was the first to push the updates!

8/9
That would be fine-tuning. You can try out
@monsterapis for nocode finetuning of LLMs.

9/9
Series of language models that pretty much outperformed llama-3 even with the small size.


To post tweets in this format, more info here: https://www.thecoli.com/threads/tips-and-tricks-for-posting-the-coli-megathread.984734/post-52211196

Spoiler: larger images

microsoft/Phi-3-mini-4k-instruct · Hugging Face

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

huggingface.co

Also 128k-instruct: microsoft/Phi-3-mini-128k-instruct-onnx · Hugging Face
Edit: All versions: Phi-3 - a microsoft Collection