Just for fun: When do you think that the Orion O6 will ship?

O6 will start shipping this week. The Cix chips delayed to ship to us, we guess the reason is the impact of the US BIS OSATs restriction in Feb, 2025. But now we have finished production of this new batch, still can not fulfill all pending orders but should cover most of them. The AI PC Kits will start shipping next week so for those who ordered together will start shipping next week.

5 Likes

AllNet shipped mine.

2 Likes

They shipped mine aswell :star_struck:

1 Like

any eta for single AI PC Cases?

Arace said this week for the AI Case kits.

I closed the poll. The “wisdom of the crowd” selected 2025-03-31 as the day the boards would start their journey and my board is shipping as well.

Thanks everyone who voted in the two polls, you were right both times!

Still have not gotten my AI kit from Arace.

Any idea if anyone has received this yet?

I’ve been considering purchasing an O6 as a compact (and relatively low power) machine to run an LLM (probably Qwen 3A30B or another MoE in case anyone’s interested).

Was hoping there’d be a review of the AI Kit first though - but can’t seem to find anyone who’s actually received it.

Also, if anyone has LLM benchmarks available, would love to see them. I realize we don’t have NPU or mainline GPU drivers yet - so curious to see how prompt ingestion is on the CPU.

Still have not received any notice for shipping on my 32 GB AI kit order.

1 Like

I ordered the 32GB board model from Arace and purposely didn’t order the so called “AI kit” as it was said by others to block the order. I received my board pretty fast (one week or so). The acrylic enclosure is OK and sufficient to put on my desk. A full enclosure could of course have been better for a finished product but that one is already quite correct (and way better than having a naked board lying on the desk).

FWIW on this machine, Qwen3-30B-A3B delivers me about 18.5 tok/s (with the DRAM controller sped up by 10%). It looks like a nice solution for this board.

1 Like

Allnet shipped my 16gb and 32gb board about a month ago now ordered it in DEC

Thanks for the update. I might wait a bit before purchasing - would really like to wait until someone’s able to give feedback on the build quality of the AI Kit.

Thanks! That’s pretty decent - is that with a Q4_M quant? The other alternative I’m looking at is a Rock 5B+ - but that’s only 64bit LPDDR5, so it’ll probably have roughly half the token gen performance of the O6.

On the flip-side though, I think idle power consumption is a lot better. I haven’t seen anyone get the O6 to idle on less than 10W so far (I think 14W?)

It’s Q4_0 or Q4_1 (both deliver the same perf here). Not tried IQ4 on this one yet, though it should be similar with slightly higher quality and a longer startup time (Q4_1 has no boot-time conversion to do and is instant). And regarding Rock5B+ vs Orion-O6, my Rock5-itx (which has the same RAM as 5B+) has exactly half of the DRAM bandwidth of O6, thus will produce half the token rate, so yeah, it will be quite a bit limited.

To be honest, despite the memory controller’s limitations that make it impossible for the CPU domain to use the full memory bandwidth, this board’s DRAM remains one of the fastest that I have access to, and by a good margin. Most of my other boards, PCs etc are in the 20-30GB/s range, this one is at 40-45. The only ones I have a regular access to and that beat it are a Sapphire Rapids Xeon with 4 channels of DDR5-4400 (110GB/s) and and Ampere Altra with 6x2933 (130 GB/s). I’m having good hopes in the forthcoming AMD “AI” max+ 395 (256-bit 8000MT/s -> 256GB/s theoretical BW). We’ll see… In the mean time for such memory intensive use cases, the O6 is a great product.

1 Like

Thanks for the details, appreciate it!

I’m having good hopes in the forthcoming AMD “AI” max+ 395 (256-bit 8000MT/s -> 256GB/s theoretical BW

This is the other thing I’m tossing up on waiting for. Where I am, I’m quite constrained on power (solar-only), so I’m considering having both - particularly if the O6’s idle consumption can get below 10W. As you said, it’s actually pretty damn decent for the price-point. Hopefully we get good NPU support so that we’ll be able to take advantage of it for the prompt ingestion in future too.

Still showing as ‘unfulfilled’ on ARACE — I also saw on X that Patrick / ServeTheHome reported he didn’t receive the correct model he ordered — though I half wonder if he was sent a review unit as well, and his main order just hasn’t shipped yet?

Is there any update for those who wanted to get the ‘AI kit’ with the nice case?

You can ask Arace to split your order so they ship the Orion O6 separately from the AI case, I did this when they offered back in early April.

2 Likes

From Discord:

2 Likes

That’s great news, howeverTariffs make ordering the O6 in the US untenable :sob:

Tom send an update in the discord that the power button seems to be loose in some cases and they’re investigating it with a new eta tomorrow

It’s so funny to see this again. Why communcating via sane communcation channels (like your own forum) when you can also choose a crappy platform a lot of people avoid at all costs and where Trump can trash everything originating from Mainland China with his next Executive Order?

:joy: