nodehome @nodehome_ai

publication about local models, private inference, self-hosted agents, weird hardware, research sweeps, and the builders https://t.co/WkE82CN86T nodehome.ai Austin, TX Joined May 2026

Tweets

7
Followers

0
Following

79
Likes

48

nodehome @nodehome_ai

17 hours ago

Is this cap for sustained workloads or do you keep it in place all the time? On my 3x3090 setup ive found temps stay relatively safe in peaks during inference work and tend to drop pretty quickly between requests at 300W. On gpu-burn, dropping from 300W to 250W cost ~27% aggregate GFlop/s, so I’ve been keeping 300W for interactive inference; and then dropping it to 225 or 250 for any sustained runs. So far vLLM + AWQ-Marlin and gpu-burn is all I've tested though. I haven’t tested Aphrodite yet, but planning to and will report back

1 0 0 6 0

View Details

nodehome @nodehome_ai

a day ago

@sudoingX testing on 3) 3090's later today/tom, will update here

0 0 0 104 0

View Details

Sudo su @sudoingX

2 days ago

this is so easy to miss in all the launch noise, but a year ago native multimodal meant an api key and someone else's datacenter, and now it's a single 3090 sitting on your desk, text image video audio, weights you actually own, apache 2.0. and the thing is the 12b era was never really about beating the big labs on a benchmark, it's that "capable enough" just quietly moved onto hardware you control. i'm benchmarking it now, but if you've already run it i wanna know what you're actually seeing, tok/s, context, does the multimodal hold up? drop it below.

Volodymyr Pavlenko @mindinpanic

2 days ago

@sudoingX man, a single 3090 running multimodal natively is the milestone we've been waiting for. the 12b era is here

1 0 11 8K 0

6 4 96 6K 17

View Details

nodehome @nodehome_ai

2 days ago

super useful thank you for sharing! currently running 3) 3090's and having a lot of fun the 220W power cap is interesting, is that due to heat build up? I've started at 300, but certainly running a bit hot at times going to check out aphrodite, exllamav3, and fp8 kv cache on ampere as well, pretty interesting stuff

1 0 0 17 0

View Details

nodehome @nodehome_ai

2 days ago

this is pretty wild with a relatively small local model @googlegemma have to imagine small wearables become a regular thing in society alot faster than we previously thought you probably see these in regular use by late 2027/2028 id guess now youtube.com/watch?v=OhaIA3…

0 0 0 7 0

View Details

nodehome @nodehome_ai

3 days ago

figuring it out on the fly!

0 0 0 8 0

View Details

nodehome @nodehome_ai

3 days ago

Having so much fun building and learning in this space! Will start to post more about my stack as time allows, in the meantime for anyone interested, I'll also try to keep nodehome.ai update going forward!