@superalesha@QwenDevs Same dream - but most likely be Qwen 4 .... given that 3.8 flash-next (preview) has landed - and there is likely some strong improvements there that a 35b MoE (or larger) could benefit from and make it a total beast ...
At least that's my thought - source: my opinion... lol
@_ryu15_ keep tweaking - i have 2 5060ti 16Gb cards and 64Gb ram + NVMe. Get the right offload to NVMe for the nGram table - and push that ubatch up. I get ~128k context with ~ 200 prefill + 15-20 decode -> degrades to 150pre/11-15 decode.
Good luck!
@_ryu15_ There is also hypothesis for speculative decoding with n-gram that can move the 1-at-a-time threshold 'up' ... Theoretically. This would be a game changer if spec-decoding (MTP) could gen a batch and then pre-select multiples instead of the single - ...
Not sure it is viable.
@Bingeljell Yeah, that's how I got my human animations going - and they are .... good placeholders LOL.
But quadrupeds, anthropods, serpentine, flyers, etc... non-humanoid types for my fantasy RPG project - it is REALLY bad at those... like - Not even placeholder useable yet... LOL
@ben_sage Failing to get the concept of PIV - as the basic building block of agent-generated-coding:
Plan
Implement
Validate
Iterate.
2nd mistake, not knowing how to RALPH loop over multiple PIVs for larger items - or directing their agents to decompose problems into PIV loops. Validate
As close as I could get with the 5h limit @thsottiaux - here I set with 2 business seats, both limited - have 108% of a use-limit left - and I can't 'burn it'.
you have a reset button - you need a 'turn off limit' button to let folks participate in these burn sessions - or bank
@oheyspun I will be honest - it could be a home run - but it will likely fall trap to the same things that make all versions of wow uninteresting:
1. Fast leveling (get to max in less than 40 hrs gameplay)
2. Content invalidation cadence (every patch)
3. Bots and toxic monetization
@thsottiaux Can we disable the 5h limit so I can go fast for more than 15 minutes? @thsottiaux please???
(Or offers those that have the 5h limit a banked reset since we CAN'T participate in the 'burn before reset' events??)
Thanks!
@thsottiaux Tried to get my useage down before reset - turned on Sol and Fast - and then - 5h limit plugged that gap - so here I set with a ton of useage - and no way to use it pre-reset.
Please offer these as 'banked' if you insist on the 5h limit/throttle.
@CrazyRetroGame1 I started a 'solo-mmo-project' - not to launch a game, but to 'learn how to scale' - so that means I try to do it all via AI with minimal direct code/input from myself.
Learned a TON about ai-coding properly (validation means EVERYTHING) - and now trying to do iterations cleanly
@0xBakeer@Alibaba_Qwen@QwenDevs I don't have the hardware myself - but sounds like a COOL experiment - and would be IMMENSELY useful to folks in the <32gb +64Gb ram local enthusiast scene.
(Shameless plug hehe)
@0xBakeer@Alibaba_Qwen@QwenDevs@0xBakeer - saw your work here: github.com/0xBakeer/qwen3…
Have you considered combining that with:
Flash-Next tensor census + layer-wise REAP calibration + 25/37.5/50% pruning sweep - and seeing if quality holds?
Possible to draft a 24-32Gb derivative w/ 95%+ retained?
46 Followers 270 FollowingOne must seek the truth in order to find it, and the truth shall set you free! All praise goes to The Most High YHWH Elohiym, so please send your thanks to Him!
182K Followers 1K FollowingPastor, Lakepointe Church. This = where I talk politics / culture.
IG: josh_howerton // FB & TikTok: howertonjosh
Team sometimes tweets for me.
709 Followers 628 FollowingChristian, husband & father of 4. Techie + Marketer. Building tools for the Agentic & AI world. More info: https://t.co/oazj1P2FAT
8K Followers 0 FollowingOur mission is to share the message of salvation in Jesus Christ and reveal the truth about His extraordinary creation to the world.
415K Followers 585 FollowingWorld's Highest IQ (276) Record Holder, verified by World Memory Championships & Official World Record®. Mensa Member. Christian. NFA. DYOR.
3K Followers 318 Following⚡I benchmark local LLMs on 4x RTX 3090s.
exact configs, tok/s, VRAM, and what broke.
❤️ https://t.co/tIPzthsdkv - 2xDGX Spark
🚀96GB VRAM | Local AI
11K Followers 5 FollowingThis is the official account for @Alibaba_Qwen Developers. Let's build!
Apply to be a Qwen Ambassador here: https://t.co/unvFq4oCRY
18K Followers 154 FollowingIn The World of AI is a captivating YouTube channel that explores the fascinating world of Artificial Intelligence (AI), Machine Learning, LLMs, & etc.
1.6M Followers 2 FollowingWe're an AI safety and research company that builds reliable, interpretable, and steerable AI systems. Talk to our AI assistant @claudeai on https://t.co/FhDI3KQh0n.
5.1M Followers 4 FollowingOpenAI’s mission is to ensure that artificial general intelligence benefits all of humanity. We’re hiring: https://t.co/dJGr6LgzPA
2K Followers 18 FollowingCreator And Writer Of GrandSon,👴🏾👨🏼🦰..Yet Another GAMING NERD!..😱😬..New to X.,👉😲..Seasoned To Apple Music And Spotify...💪😉👌..
74K Followers 268 FollowingWelcome to the Official Twitter feed for The Lord of the Rings Online, the only massively-multiplayer game based on J.R.R. Tolkien's masterpiece!
303K Followers 27 FollowingMaster long-term professions, trade, build, craft, and gather to help shape the living world of BitCraft together.
Play now on Steam
https://t.co/7FQCFXVwgp
12K Followers 7 FollowingBuild, explore, craft, conquer and pledge… Pick your goals and create your own stories. What world will you make?
#paxdei Discord: https://t.co/UszgEukjDk