Background AI Intelligence

One of the core promises of AI is that the more it knows about a person, the better it will be able to assist them with tasks and make appropriate suggestions, which requires apps and devices to monitor activity continuously and gather context.

Continuous data collection naturally brings privacy and security concerns. However, startups are building such applications with the belief that the market for personalized assistance outweighs these challenges.

Former Plaud executive Peter Mo is developing Ambi to provide real-time intelligence and insights by continuously listening to users.

The company announced that it has raised $26 million across multiple funding rounds led by Luminous Ventures, which has backed companies like Meituan and Unitree Robotics, alongside Original Design Manufacturer Huaqin.

Ecosystem Expansion

Ambi is releasing applications for iPhones, Macs, and Apple Watch. While these apps function like meeting note-takers, users can configure them to run continuously in the background to capture context throughout the day.

Traditional meeting note-taking software automates post-call tasks using summaries and action items. Ambi aims to advance this workflow by having its AI agent initiate tasks during the meeting itself.

The AI agent can proactively surface relevant knowledge and suggestions during a meeting by analyzing calendar data, meeting history, knowledge bases, and web sources. Users can also transfer tasks seamlessly across devices.

Image Credits:Ambi

The way we interact with intelligence is often limited to the screen, and traditional hardware requires recordings to transfer to a phone, upload to the cloud, and undergo processing before insights are available. Ambi is designed to provide AI access anytime and anywhere, according to co-founder and CEO Mo.

The company plans to capture additional workflow data through an upcoming desktop application that observes user activities and stores important details in memory for personalized recommendations, a capability shared by apps like Littlebird and Minimi.

The startup is also developing dedicated hardware equipped with a screen, speaker, camera, and microphones to capture context and display information.

Image Credits:Ambi

Privacy and Consent Challenges

Ambi's launch arrives amid scrutiny regarding AI devices that lack clear indicators to alert nearby individuals that data is being recorded. It remains unclear whether Ambi's applications or upcoming hardware will feature sufficient third-party notification mechanisms if users fail to disclose their use of the technology.

Certain meeting transcription companies have faced lawsuits for recording conversations without consent, and Apple's continuous speech transcription features have similarly stimulated privacy discussions.

Mo noted that ambient data capture can be disabled by users at any time and remains off by default. While the startup stated it encrypts user data without storing raw recordings, specific encryption standards were not detailed, leaving the responsibility of disclosure primarily with the user.

Users must be informed to notify others about ambient capture, Mo explained, adding that the broader industry has yet to fully solve disclosure challenges when individuals intentionally conceal data collection.

Ambi currently employs over 50 staff across offices in San Francisco, Beijing, Shanghai, and Shenzhen, and is actively hiring go-to-market personnel alongside AI engineers to refine speech recognition models.