[Tag search]

Why language models need not get worse

Thursday 9 February 2023, 00:00

Sam Kriss has a Substack posting in which he describes the zairja of the world and then links it to his ideas on why AI is getting worse. Basically, what I get from the piece is that he's saying successive generations of GPT models have produced less and less valuable output as they better and better approximate the average content of the World Wide Web. Nearly all of the Web is garbage, and so an approximation of the average Web document is garbage too. The output from older models is weird and interesting because more random and less accurately approximating the average Web document; the output from new models is boring and worthless. My own view is that these issues are not as serious or as inevitable as he presents them. There seem to be some gaps in Kriss's understanding of how language models, and the ChatGPT Web service in particular, work; and filling in the gaps points to some natural solutions for the problem he describes.

...(more, 2 comments)

"Grimoire" fonts

Sunday 26 June 2011, 10:15

Here's a project that provides, among other things, free vector fonts of magical glyphs from the Lesser and Greater Keys of Solomon. I found it by way of sourceforge.jp's flagging it as a similar project to Tsukurimashou.

...(more, 2 comments)

Projector's credit union

Friday 2 November 2001, 07:02

I went to open an account at the Projector's Credit Union. The PCU branch was tucked away behind the flashy modern CIBC branch, so that one would have to drive through the CIBC parking lot to get there. It was a small square building that looked like an old converted house, sitting at the edge of the parking lot among some scrubby blackberry bushes. I had chosen to deal with the Projector's Credit Union largely on the recommendation of my sister, who had told me that the tellers there were cute girls.

...(more)