I don't know how to explain this. I am not an it professional.
I will half explain it.
Filesystems are great ways to share data, and can easily be mounted on all kinds of systems.
But their queries are slow, oh so slow. Probably due to the unstructured hierarchical component of them and the mass
of individual entities and the actual storage access itself..
But if you pair a filesystem with a database you get the best of both worlds. With clever indexing, filesystems can be searched very fast.
However, the credentialling red tape to access a database is often separate and convoluted, when you take into account access tokens and sso and web apis. But why is this if we are just talking about data storage and retrieval at the end of the day.
So, this idea is to do everything through a filesystem interface, easily mounted on all kinds of systems. If you can mount the 'drive' you are guaranteed access to heavy filesystem data plus a fast database.
Normal ls, find, etc accesses normal files.
But to access the paired database, you ls a special subfolder in any folder.
Roughly equivalent to a rest call like curl etc.
Ls /usr/tmp to get tmp file list
Ls -ltr /usr/tmp/.db/searchkey/searchvalue/ would be similar to select * from /usr/tmp where searchkey=searchvalue and path startswith '/usr/tmp
Or maybe instead of that .sqlite style files are used but they are special and are not actually files; they are managed by a database system. Opening a file handle to that file actually opens a secure connection to a database. Lucene or sql searches then give very fast results.
But the key thing is that access is granted directly. Access between filesystem and database is 1:1, tokens used for one give access to the other, groups and ownership shared between the two.
Surely this is done already but I haven't seen it. Aws roles.may give access to both db and fs at the same time? But that is not an sso scheme.
Why do filesystems and databases be at odds with each other, why can't they just be one thing?
I did ask chatgpt about this and it mentioned hadoop but it also gave a command that had a traditional url in it.
Halfbaking over, here is some nice raw chicken pies!