Approx. read time: 2.7 min.
Post: Apple Accelerates AI Innovation: Spotlight and Xcode to Embrace Next-Gen Features
Apple Accelerates AI Innovation: Spotlight and Xcode to Embrace Next-Gen Features. Apple is intensifying its efforts in AI, focusing on enhancing Spotlight and Xcode, as reported by Bloomberg. The company is actively developing an AI-driven code completion feature akin to Microsoft’s GitHub Copilot, undergoing broader internal testing of novel generative AI capabilities in Xcode, aiming for a release to external developers within the year. Additionally, Apple is exploring generative AI applications in consumer products, including automatic playlist generation for Apple Music, Keynote slideshows, and AI-powered search functionalities in Spotlight, potentially allowing users to make natural language inquiries for tasks such as retrieving weather updates or navigating app-specific functions.
While Apple has been less visible than other major corporations in publicizing AI research and innovations, it recently unveiled MLX, an open-source machine learning framework designed for easy AI model training on Apple silicon. Other AI contributions include MGIE, a text-to-image AI model, and Keyframer, an AI animator. The new programming tool, mirroring Microsoft’s GitHub Copilot and Amazon’s Code Whisperer, will leverage a large language model for code prediction and completion, enhancing app testing efficiency.
Microsoft’s Satya Nadella highlighted GitHub Copilot’s success, with 1 million subscribers as of November 2023, and future enhancements including a real-time coding assistance chat feature. Microsoft plans further announcements at Build 2024, while Apple is expected to share more on its AI ventures at the WWDC developers event later this year.
Apple CEO Tim Cook has been cautious in his statements on generative AI, yet confirmed the rollout of new AI features in an investor call. Apple’s board was briefed on these developments, indicating significant progress in AI integration across its software suite.
Apple Accelerates AI Innovation: Spotlight and Xcode to Embrace Next-Gen Features
Apple Research Highlights:
- Computer Vision and Speech and Natural Language Processing (2024): Advancing Speech Accessibility with Personal Voice.
- Speech and Natural Language Processing (2023): Voice Trigger System for Siri; Learning Iconic Scenes with Differential Privacy.
- Computer Vision, Privacy, Data Science and Annotation, Accessibility, Methods and Algorithms (2022-2021): Various projects including Fast Class-Agnostic Salient Object Segmentation, Improved Speech Recognition for Stutterers, 3D Parametric Room Representation, On-Device Scene Analysis, Transformers on Apple Neural Engine, User Mobility and COVID-19, Panoptic Segmentation, Neural Network Subspaces, Radiance Fields of Indoor Scenes, Private On-Device Learning for Photo Recognition, Accessibility Enhancements, Language Identification from Short Strings, and more.
- Speech and Natural Language Processing (2018-2017): Enhancements to Siri, including far-field optimization, semantic context in language models, personalized “Hey Siri” functionality, and on-device DNN for voice trigger and face detection.
- Privacy and Computer Vision (2017): Projects focusing on privacy with Differential Privacy Team, deep learning for facial detection, real-time handwritten Chinese character recognition, and synthetic image realism improvement.
Related Videos:
Related Posts:
Spotlight on Israeli based Pegasus Spyware software(Opens in a new browser tab)