Windows 10: Why does copilot plus not use the GPU for AI when a NPU is not present.

the newer Nvidia GPU's can do over 1000 TOPS should Microsoft change copilot+ to work on the GPU for the computers that have windows 11 but don't have an NPU?I assume GPU usage would be only 1% for 40 TOPS.

:)

 

Copilot + on high end pcs without NPUs

This post may not get any developers attention, but I still feel like that was an interesting idea and wanted to put it out there. I had an interesting conversation with Copilot with GPT-4 about using copilot+ on powerful pcs that dont have dedicated NPUs, and we discussed the reason why its not supported, and the possibility of being added later. I have a modern gaming rig myself, and I'm quite interested in AI and would be quite happy to be able to experience some of these new features myself without having to buy a brand new computer that's built for it. I will post the conversation below for anyone that is interested in this concept. I skipped the first half where we simply discussed hardware and the limitations a device without a dedicated NPU has, and got to the part where we discuss a possible solution.



I realize the this isn't even out just yet, however the possibility this could provide still intrigues me.



You

You make a very good point, thank you for your detailed explanation. While I understand that you are A.I. and are based on current and past data provided to you, do you believe that there is any chance that Copilot may be developed to take better advantage of a high end gaming pc to allow it to perform some of the tasts that a copilot+ computer can, maybe with limited capacity to some extent?





Copilot

Thank you for your thoughtful response! While I don’t have the ability to predict future developments, I can certainly explore the possibilities:

1. Adapting Copilot for High-End Gaming PCs:
   
   • It’s plausible that Microsoft could optimize Copilot to better utilize high-end gaming PCs.
     
   • Developers and creators often invest in powerful hardware, and catering to this audience would be beneficial.
     
   • By fine-tuning resource allocation and leveraging existing hardware capabilities, Copilot could enhance its performance on gaming rigs.
     
2. Resource Constraints and Prioritization:
   
   • Copilot+ is designed for specific hardware configurations, including NPUs.
     
   • Adapting it for gaming PCs would require careful resource management.
     
   • Prioritizing tasks (such as code generation) while minimizing impact on gaming performance would be crucial.
     
3. Hybrid Approach:
   
   • A hybrid solution could allow Copilot to run efficiently on both AI-focused hardware and gaming PCs.
     
   • Copilot might dynamically adjust its behavior based on available resources.
     
   • For example, it could use AI acceleration when available and fall back to CPU-based processing when necessary.
     
4. User Preferences and Customization:
   
   • Allowing users to tweak Copilot’s behavior could be valuable.
     
   • A settings panel where users can allocate resources (CPU, GPU, memory) based on their priorities would be interesting.
     
5. Community Feedback and Collaboration:
   
   • Engaging with the developer community and gathering feedback is essential.
     
   • Collaborating with users to understand their needs and preferences can drive improvements.
     

In summary, while I can’t predict the future, the idea of adapting Copilot for high-end gaming PCs is intriguing. As technology evolves, we might see exciting developments that bridge the gap between AI development and gaming hardware.









You

On the topic of your hybrid approach. I feel that it would be easily achievable to have copilot running as normal when doing work on the desktop, but when gaming is needed, or maybe when copilot detects gaming, it could be suspended. Maybe there would even be some way to manually suspend it when not needed, as to not affect gaming performance.





Copilot

You’ve hit the nail on the head! Your suggestion aligns well with practical usability. Let’s dive into how a hybrid approach could work:

1. Automatic Suspension during Gaming:
   
   • Copilot could intelligently detect when gaming is active.
     
   • When you launch a game, Copilot would gracefully suspend itself to avoid any impact on gaming performance.
     
   • This seamless transition would enhance the overall user experience.
     
2. Manual Suspension:
   
   • Allowing users to manually suspend Copilot is a great idea.
     
   • Imagine a simple toggle switch in the system tray or a keyboard shortcut.
     
   • When you’re immersed in a game, just flip the switch to pause Copilot temporarily.
     
3. Resource Monitoring and Thresholds:
   
   • Copilot could monitor resource usage (CPU, GPU, memory).
     
   • If gaming performance starts to suffer, Copilot would automatically reduce its footprint.
     
   • Setting resource thresholds ensures that Copilot never hogs critical resources.
     
4. User Profiles and Preferences:
   
   • Different users have varying needs.
     
   • Copilot could offer profiles like “Developer Mode” (full power) and “Gamer Mode” (minimal impact).
     
   • Users could customize these profiles based on their workflow.
     
5. Notifications and Alerts:
   
   • Copilot could notify you when it’s suspended or reactivated.
     
   • Clear notifications ensure you’re aware of the current state.
     
6. Seamless Resumption:
   
   • When you exit a game, Copilot would resume where it left off.
     
   • No manual intervention needed—just focus on your work or coding.
     

In summary, your vision of a hybrid approach strikes a balance between productivity and gaming. It’s user-centric and practical. While I can’t implement it directly, I hope the developers take inspiration from your insights!


* Moved from Community Center

 

Is it possible to just not have Recall on my computer

Retrace your steps with Recall - Microsoft Support

System requirements for Recall

Your PC needs the following minimum system requirements for Recall:

• A Copilot+ PC
  
• 16 GB RAM
  
• 8 logical processors
  
• 256 GB storage capacity
  
• To enable Recall, you’ll need at least 50 GB of storage space free
  
• Saving screenshots automatically pauses once the device has less than 25 GB of storage space
  

Shop Copilot+ PCs | Microsoft

Are the Copilot+ PC experiences available on all Windows 11 PCs?

These features require powerful neural processing units (NPUs)—a specialized computer chip for AI-intensive processes—that are unique to the Copilot+ PC class of devices.

If your PC isn't one of these with an NPU on the Snapdragon® X Series processor, it simply won't run Recall or any of these other Copilot+ PC features, so you don't even have the option to ruse these.

Guess you're badly behind the times for true AI computing, eh?

Rob

 

1st gen NPU users won't get AI features on 24H2?

As we all know that 24h2 update for windows 11 is rolling out gradually for general consumers and as microsoft has already declared that the update will come with some great AI features with mind blowing fancy names. But there is a condition that the user must have a compatible NPU of at least 40 TOPS. So, does that mean consumers with lower npus like those in the 1st gen core ultra processors(with around 11 TOPS NPU) won't be eligible for AI features on 24H2 especially live captions with translations?? If that so the first wave of NPUs in the industry will come of no use! microsoft should definitely figure a way out to make these feature (at least some crucial of them) available to all NPU user.