Not to be a downer if you’re anti-AI, but you should know a functional, small, 1B parameter model only needs ~85GB of data if the training data set is high quality (the four-year old chinchilla paper set out the 20 to 1 optimization rule for ai training, so it may require even less today).

That’s basically nothing. If a language has over ~130,000 books or an equivalent amount of writing (1,500 books is about a gig in plain ascii), a functional text-based ai model could be built that uses it.

My understanding is there are next to zero languages in existence today that do not have this amount of quality text. Certainly, spoken languages that have no written word are not accessible like this, but most endangered languages with few speakers that have a historical written word could in theory have ai models built that effectively communicate in those languages. The only problem is digitization.

To give you an idea of what this means for less-written languages and a website revolving around them, look at worldcat (which is does NOT have anywhere near most of the written text available entirely online for each language listed, it’s JUST a resource for libraries): https://www.oclc.org/en/worldcat/inside-worldcat.html

But this gets even harder for a theoretical website used to avoid an LLM that can read it, because this is all assuming creating an ai model for language from scratch. That is not necessary today because of transfer learning.

Major LLM models with over 100 diverse major languages can be fined-tuned on an insignificant amount of data (even 1GB could work in theory) and produce results like those of a 1B parameter model trained solely on one language. This is because the multi-lingual models developed cross-cultural vector-based understandings of Grammer.

In truth, the only remaining major barriers for any language not understood by fine-tuning an ai model today is both (1) digitization and (2) character recognition. Digitization will vanish as an issue for basically every written language that has a unique script within the next ten years. Character recognition and the economic viability of building the character recognition will be the only remaining issue.

Ironically, in creating such a website, you will be creating more data for a future potential ai model to use in training. Especially if whatever you write makes the language of greater economic importance.

I love that you’re providing genuine answers to questions in this thread, it’s always needed because the questions are often genuine, but coming from a place of very well-justified anguish or anger.

Something something “the ambiguity of language, curses” 😭

It’s all good my friend

It’s a shower thought, ain’t that deep.

Yeah that’s a very fair analysis.

Also, being a selfish prick is nothing to be proud of.

Tell me you didn’t read past the title without telling me 😭😭😭

Tell me you didn’t read past the title without telling me 😭😭😭

You’re following rules no one else does and only wanting to try if it’s guaranteed to succeed.

That’s categorically an opposite of what “that said, it’s still worth going after the guy criminally. He deserves prison and the AG should give it a shot” means, right? I said try even if it’s not guaranteed. My contribution to our conversation was opining on the likelihood of success.

Throw his ass in jail for murder with no bail

I’d love this, and think it’s unlikely.

He can beat the charges, but he’ll never get the months/years of his life back while awaiting trial

Make it so in the back of every ICE agent’s head there’s a constant reminder: “There could be consequences”.

Regardless of how we accomplish it, nothing gets fixed till that thought is always in their minds.

Yes to all of this!

I’m hopeful that a civil lawsuit would succeed, but I think the officer will escape criminal liability because federal courts get to determine scope of duty/egregiousness of conduct before state courts can touch federal officers.

That said, it’s still worth going after the guy criminally. He deserves prison and the AG should give it a shot.

Terrible headline, it’s honestly kind of impressive that the chronological order of just two events could be screwed up in a single sentence fragment meant to convey information in an entertaining way.

Yeah but France is my favorite South American country

I see through this charade! He just wants to have closer relations with the French!

I wonder how much rooftop space in Vienna could be cannibalized for solar panels.