Hacker News

Cyc: History's Forgotten AI Project (Score: 156+ in 8 hours)

Link: https://readhacker.news/s/66bdc
Comments: https://readhacker.news/c/66bdc

Short Stack: World’s smallest Nintendo Wii (🔥 Score: 152+ in 2 hours)

Link: https://readhacker.news/s/66c2k
Comments: https://readhacker.news/c/66c2k

AltStore PAL, the first alternative app marketplace on iPhone, is available now (Score: 150+ in 9 hours)

Link: https://readhacker.news/s/66aE6
Comments: https://readhacker.news/c/66aE6

Hardest Problem in Computer Science: Centering Things (Score: 156+ in 6 hours)

Link: https://readhacker.news/s/66biz
Comments: https://readhacker.news/c/66biz

libxev: A cross-platform, high-performance event loop (Score: 150+ in 9 hours)

Link: https://readhacker.news/s/66a77
Comments: https://readhacker.news/c/66a77

The forgotten war on beepers (Score: 152+ in 7 hours)

Link: https://readhacker.news/s/66axQ
Comments: https://readhacker.news/c/66axQ

Solving the minimum cut problem for undirected graphs (Score: 152+ in 11 hours)

Link: https://readhacker.news/s/669x5
Comments: https://readhacker.news/c/669x5

CFPB Takes Action Against Coding Boot Camp BloomTech and CEO Austen Allred (Score: 150+ in 5 hours)

Link: https://readhacker.news/s/66aLV
Comments: https://readhacker.news/c/66aLV

Reddit is taking over Google (Score: 150+ in 6 hours)

Link: https://readhacker.news/s/66aEX
Comments: https://readhacker.news/c/66aEX

Show HN: Speeding up LLM inference 2x times (possibly) (Score: 156+ in 4 hours)

Link: https://readhacker.news/s/66aGf
Comments: https://readhacker.news/c/66aGf

Here's a project I've been working on for the last few months.
It's a new (I think) algorithm, that allows to adjust smoothly - and in real time - how many calculations you'd like to do during inference of an LLM model.
It seems that it's possible to do just 20-25% of weight multiplications instead of all of them, and still get good inference results.
I implemented it to run on M1/M2/M3 GPU. The mmul approximation itself can be pushed to run 2x fast before the quality of output collapses.
The inference speed is just a bit faster than Llama.cpp's, because the rest of implementation could be better, but with a better development I think it can be a new method to speed up inference - in addition to quantization.
You could call it ad-hoc model distillation :)
You can change the speed / accuracy of a model at will, in real time.
Oh, and as a side effect, the data format allows to also choose how much of the model you want to load into the memory. You can decide to skip say 10-20-40% of the least important weights.
It's implemented for Mistral, it was also tested slightly on Mixtral and Llama. It's for FP16 for now, but Q8 is in the works.
The algorithm is described here, and the implementation is open source.
https://kolinko.github.io/effort/
I know these are bold claims, but I hope they survive the scrutiny :)

Future of Humanity Institute shuts down (Score: 153+ in 5 hours)

Link: https://readhacker.news/s/66a7Q
Comments: https://readhacker.news/c/66a7Q

Show HN: Render audio waveforms to HTML canvas using WebGPU (Score: 150+ in 1 day)

Link: https://readhacker.news/c/6642Y

Hey HN. I built this quick and dirty component to render audio waveforms using WebGPU. I just published it to NPM.
It's the first time I use WebGPU and it's been a while since I write shaders. Feedback is very welcome!
GitHub: https://github.com/mrkev/webgpu-waveform
Examples: https://aykev.dev/webgpu-waveform

LXQt 2.0.0 (Score: 151+ in 7 hours)

Link: https://readhacker.news/s/669uW
Comments: https://readhacker.news/c/669uW

The biggest source of waste is untapped skilled pragmatists (Score: 154+ in 4 hours)

Link: https://readhacker.news/s/66a52
Comments: https://readhacker.news/c/66a52

Embeddings are a good starting point for the AI curious app developer (🔥 Score: 156+ in 2 hours)

Link: https://readhacker.news/s/66aCQ
Comments: https://readhacker.news/c/66aCQ

How Nestlé gets children hooked on sugar in lower-income countries (🔥 Score: 158+ in 2 hours)

Link: https://readhacker.news/s/66aEr
Comments: https://readhacker.news/c/66aEr

Stable Diffusion 3 API Now Available (🔥 Score: 150+ in 3 hours)

Link: https://readhacker.news/s/669Su
Comments: https://readhacker.news/c/669Su

Use Your Potions and Scrolls (Score: 150+ in 17 hours)

Link: https://readhacker.news/s/667QT
Comments: https://readhacker.news/c/667QT

An electric new era for Atlas (🔥 Score: 158+ in 3 hours)

Link: https://readhacker.news/s/669yt
Comments: https://readhacker.news/c/669yt

Tax consequences of WIN95 team members keeping a piece of software for testing (Score: 151+ in 13 hours)

Link: https://readhacker.news/s/668c7
Comments: https://readhacker.news/c/668c7