Natural language input

[tomthe]

There is a 14mb "LLM" fine tuned on tool calling: https://huggingface.co/spaces/benoitfavre/needle-playground

If you gave it all buttons/trackers as tools, it would probably be able to create good json out of natural language sentences. As a user I could combine it with a STT keyboard --> Speech to tracking!

[SamAmco]

Interesting idea! What sorts of things would you want to do though? Just "Track that I did xyz and add a note abc" kind of stuff? I could imagine it could also work for creating graphs/functions, and maybe search.

I did have a similar thought not too long ago. I imagined a model that would write Lua against some interface which could control T&G. I imagined it being run in a cloud though. I expect small fine tuned models that write Lua are probably a little more rare 🤔

[tomthe]

I am not sure how many tools this really small model can handle, probably only very simple stuff. I thought about "I started work today at 10 past 8 am and finished at 4 50 pm" ... "I drank one beer" --> the mini-LLM would generate JSON and T&G would interpret that json as the correct button presses...