From 25a14e89188e0c87a941266b61785c5f10aaec8c Mon Sep 17 00:00:00 2001 From: Joshua Schrier Date: Sat, 21 Feb 2026 10:42:51 -0500 Subject: [PATCH 1/2] update meta AI glasses --- .../2024-07-18-Hacking-Meta-Rayban-Glasses.md | 21 ++++++++++++++++--- 1 file changed, 18 insertions(+), 3 deletions(-) diff --git a/_posts/2024-07-18-Hacking-Meta-Rayban-Glasses.md b/_posts/2024-07-18-Hacking-Meta-Rayban-Glasses.md index 8f8c975..0f29e15 100644 --- a/_posts/2024-07-18-Hacking-Meta-Rayban-Glasses.md +++ b/_posts/2024-07-18-Hacking-Meta-Rayban-Glasses.md @@ -1,11 +1,15 @@ --- title: "Hacking Meta Rayban Glasses" date: 2024-07-18 -tags: fashion diy webdev llama3 +tags: fashion diy webdev llama3 ai --- Confession: I bought a pair of [Meta Rayban smart glasses](https://www.meta.com/smart-glasses/). Built in functionality is cool, but of course, a hackers gotta hack. **So how can you run other things on them?...** +(There is steady progress, so I am breaking this up by year...) + +# 2024 + - [Write a WhatsApp server to intercept messages](https://jovanovski.medium.com/part-2-getting-chatgpt-working-on-meta-smart-glasses-82e74c9a6e1e). The idea is that you can then tell the glasses to send a message to that WhatsApp name, and then your app on the other side can run something and send it back as a WhatsApp message. There's an [implementation that uses PHP](https://github.com/jovanovski/meta-glasses-gpt/tree/main/whatsapp-approach), but I'm sure you could cook up a little Flask app to do this. Heck...host it on Modal with all those credits burning a hole in my pocket - Indeed, there are [tutorials](https://www.youtube.com/watch?v=uN_MNOaoxBU) and [examples](https://github.com/gustavz/whatsbot) on how to build WhatsApp webhook apps in flask. - Better: Meta has an official tutorial on [Sending Messages with WhatsApp in Your Python Applications](https://developers.facebook.com/blog/post/2022/10/24/sending-messages-with-whatsapp-in-your-python-applications/) @@ -18,7 +22,17 @@ Confession: I bought a pair of [Meta Rayban smart glasses](https://www.meta.com - Just in case you were wondering...you don't have to say 'Hey Meta..." to use the voice features. They all work fine if you say "Ok Meta..." or...you can configure the touch button (touch and hold) to activate the assistant without any wake words. I'm still waiting for someone to hack the wake word so you can say "Control..." (like in [Max Headroom](https://youtu.be/gCgIEgMpspI?si=2j3FoPuaWEL0PpGG)) -# Mini-review and FAQ +# 2026 + +- The "send messages to WhatsApp" approach has been formalized as [metaphor](https://rsteckler.github.io/metaphor/). Under the hood, it uses [whatsapp-api](https://rsteckler.github.io/metaphor/docs/whatsapp/) to intercept messages and then dispatch them to other applications. [Code on github.](https://github.com/rsteckler/metaphor) + +- Back in November 2025, Meta released a preview of the [Wearables Device Access Toolkit](https://wearables.developer.meta.com) which allows you to develop iOS & Android apps to intercept camera, microphone, speaker, and wear-detection. There's a special "developer' mode that you can enable to avoid the need for approvals. + - They've even [made it easy for you](https://wearables.developer.meta.com/docs/ai-solutions) to use AI coding tools to assist in parsing the API + +- [VisionClaw](https://github.com/sseanliu/VisionClaw) uses the Wearables API to interface with Gemini and optionally [OpenClaw (formerly Clawdbot)](https://en.wikipedia.org/wiki/OpenClaw)...so now any of the reckless things you can do with OpenClaw you can do from your glasses. + + +# Mini-review and FAQ (circa 2024) - Q: How do you like them? Pros/cons. - A: In summary: they're a camera and bluetooth headphones/microphone that you wear as glasses. Fit and finish is excellent. Battery life is minimum viable product level: you can drain them in a few hours by taking a bunch of photos or videos or bluetooth audio...maybe fine if you are an optional glasses wearer (and can thus take them off to charge), less good if you have to wear glasses all day. It's useful to be able to take hands-free photos (I can see lots of opportunities for making tutorials). AI assistant features are hit-or-miss: It's kind of neat to have "Hey meta, take a look and define this word" (use photo, interpret where finger is pointed, return a definition). But translation failed on a chinese newspaper headline (as of 07/2024). I am a very text-oriented person, so audio-based interactions are novel for me. @@ -28,7 +42,8 @@ Confession: I bought a pair of [Meta Rayban smart glasses](https://www.meta.com - Q: How can you connect multiple devices for audio? - A: [See these Reddit instructions](https://www.reddit.com/r/RayBanStories/comments/17xlych/comment/lfoqt7m/); tldr—-turn off bluetooth on your existing device, put them in the case, push the pairing button on the back of the case until the light turns blue, then just pair them. You can pair multiple your glasses to multiple devices. The AI and message functions still pass through from your phone. -# Ideas for applications that should exist + +# Ideas for applications that should exist (circa 2024) My running list of app ideas (probably using the Whatsapp hack): From ff205dc962bdc7393debe015626c49496215a0b9 Mon Sep 17 00:00:00 2001 From: Joshua Schrier Date: Sat, 21 Feb 2026 10:45:20 -0500 Subject: [PATCH 2/2] add links to wine across the disciplines --- ...023-08-29-Imaginary-Syllabi:-Wine-Across-the-Disciplines.md | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a/_posts/2023-08-29-Imaginary-Syllabi:-Wine-Across-the-Disciplines.md b/_posts/2023-08-29-Imaginary-Syllabi:-Wine-Across-the-Disciplines.md index 0515199..60c893f 100644 --- a/_posts/2023-08-29-Imaginary-Syllabi:-Wine-Across-the-Disciplines.md +++ b/_posts/2023-08-29-Imaginary-Syllabi:-Wine-Across-the-Disciplines.md @@ -39,7 +39,7 @@ There's clearly a shadow curriculum here, which is teaching students how to know - Analytical chemistry: [Acid-base and precipitation equilbria of potassium hydrogen tartarate in wine](https://doi.org/10.1021/ed081p94)...with a possible lab experiment, or at least some equilibrium calculation - Organic chemistry: Relating [wine aromas by sniffing them](https://www.lenez.com/en/kits/wine/masterkit_54) to individual molecules and molecule types; basic organic nomenclature - Textbook: Waterhouse et al, [Understanding Wine Chemistry (2024)](https://amzn.to/42WgyAb) - + - (02/2026) NMR and data analysis of wine and adulturation, presented at a public outreach level [J Chem Educ 2026](https://dx.doi.org/10.1021/acs.jchemed.5c00652) (but you need a 700 MHz NMR)...uses [MagMet-W](https://pubs.acs.org/doi/10.1021/acsfoodscitech.4c00298) sofwtare - Business: Guest speaker winemaker - Statistics: ["Lady tasting tea" problems in statistics](https://en.wikipedia.org/wiki/Lady_tasting_tea), and how to make sense of wine ranking surveys, taste tests, etc. - Literature: So many options to choose from.... @@ -60,6 +60,7 @@ There's clearly a shadow curriculum here, which is teaching students how to know - Operations Research/Logistics: [Wine transportation](https://www.dhl.com/global-en/delivered/globalization/the-art-of-wine-transportation.html) - Material's science: [The Glass of Wine: The Science, Technology, and Art of Glassware for Transporting and Enjoying Win](https://amzn.to/4bSx99K) (book) - Computer Science: [Winemaking and AI](https://nypost.com/2025/03/10/lifestyle/heres-how-ai-has-taken-over-the-winemaking-industry/) +- Relgion/History: [Monks and Wine](https://amzn.to/4awGANK) --- yes, that's the name of the book. 'nuff said. # Example tasting topics ("labs")