Very interesting.
I agree with @codexeditor that there are obvious privacy concerns.
But also ... why do I want AI processing my writing in a TfT? Whose 'thought' is getting augmented by the tool? Mine? Or the AIs?
For a long time, I've believed that the greatest hits of personal productivity tools (including TfTs) were that they found a class of 'syntactic commonalities' but were 'semantically neutral' ie. an outliner processes tree-shaped data. A spread-sheet processes grid-shaped ...
But neither tells you WHAT you should be representing as a tree or grid. That's down to you and your individual goals. Nor does it care HOW you represent it beyond that basic 'geometry'.
Now, though, we're gonna get AI tools that are VERY opinionated about your content
AIs trained on huge data-sets from across the web are absolutely riddled with the biases and prejudices (And not just mean in the political / ethical sense) of 'everyone else'
If I use an AI-empowered TfT, are the thoughts it helps me have going to be constrained by that?
The point of a PKM / personal bicycle for the mind is surely to augment my own individuality and idiosyncrasies.
If, instead, it gives me some crunch of everyone else's individuality, what am I getting?
Now don't get me wrong. I'm fascinated by the possibilities. I'm diving into AI Painting at the moment. And I'm wonderfully impressed by its creativity and potential.
Why don't I feel like this about writing?
Well partly, of course, I'm totally untrained and incompetent with images. I love AI Painting because it gives me control over, and a way to experiment and learn more about, something I was previously ignorant and excluded from.
Incorporating opinionated decisions
of others is a worthwhile trade-off for me; for the chance to experiment and learn.
Perhaps if I were already a visual artist, with a well developed aesthetic, I'd be far less excited by AI Painting
Meanwhile, I flatter myself that I'm already pretty good at thinking & writing
I'm not looking for a TfT to teach me how to think and write. Just to leverage my existing capabilities.
Is this a valid intuition? Or is it just naivety? Would an AI that sorted incoming links and expanded scrappy notes according to its own criteria, nevertheless ...
be a genuine leveraging of my capacities?