[Discussion] Add alternative lower-cost configurations (e.g. 6× RTX 3090 / 3080-class)

[alber70g]

Great work on the autonomous-computer project. The high-end configs with RTX 5090s are powerful but the cost is extremely high.

I suggest adding alternative configurations for a more budget-friendly approach, for example using 6× RTX 3090s or even 3080s. These can still run strong models like Ornith, Qwen and similar families together with diarization, speech-to-text and other local tools.

[kyle-aus]

The good news is the physical size is actually pretty similar. Our case uses adjustable GPU brackets, so it should be able to accommodate 3090s, or 3080s without much trouble.

I really like your idea of offering a 6× GPU configuration. Is there one of our existing case designs that you'd recommend for a 6× GPU build? Or do you think this deserves a completely new form factor—maybe a triangular chassis instead of a square cube box?

I'd love to hear your thoughts, real-world feedback like this helps us prioritize what to build next.

[cguldogan]

I actually have four RTX 3090s as well, including two Founders Edition cards, and I’m planning to use the 4× RTX 5090 design for this purpose. I assume that should work without any major issues?

By the way, I’m not very familiar with the CNC side of things, and I think many others may be in the same position. How should we order the CNC-machined parts? Would it be possible to add this information to the repository?

It would also be useful to include details about the parameters, pre-processing, post-processing, materials, tolerances, and file formats required when ordering from a well-known CNC machining service.

I may not build a six-GPU setup immediately, but I think I could complete a four-RTX-3090 build quite quickly. I really like the vertical GPU layout, and it looks like six cards might fit as well.

[kyle-aus]

A 4× RTX 3090 build should work well with our 4× RTX 5090 design. Since the 3090 is generally smaller than the 5090, GPU clearance shouldn't be an issue. The only thing we'd want to verify is whether you plan to use an NVLink bridge, since the 3090 supports it, though it's not necessary or recommended for this build.

By the way, I’m not very familiar with the CNC side of things, and I think many others may be in the same position. How should we order the CNC-machined parts? Would it be possible to add this information to the repository?

You can order the case from our website here: https://www.autonomous.ai/computer/buy

It would also be useful to include details about the parameters, pre-processing, post-processing, materials, tolerances, and file formats required when ordering from a well-known CNC machining service.

That's a great suggestion. At the moment, our parts are intentionally designed to be straightforward for most CNC fabrication shops.

• Tolerances depend on the CNC machine, tooling, and the operator's experience. It's common for the shop to make a few adjustments after the first run to dial everything in. We've already included the required tolerances in the provided STEP files.

• For materials, the outer panels use 3–4 mm 6061 aluminum, while the internal GPU mounting parts are up to 6 mm thick.

• The parts can be assembled as-is, or you can apply your preferred finish, such as spray paint. For our builds, we use sandblasting followed by anodizing.

• The STEP files are all you need. If a shop requires DXF files, they can easily export them from the STEP models.

[kyle-aus]

@cguldogan @alber70g

About the 6-GPU case:

I really like the vertical GPU layout, and it looks like six cards might fit as well.

We did our internal discussions and base on our build experience, we wouldn't recommend putting six GPUs into a cube-style CNC aluminum case. Here are the main reasons:

Heat: Six GPUs generate a tremendous amount of heat and can quickly warm up the entire room.
Noise: The exhaust fans need to run at high speed under load, making the system quite loud.
Power: Finding a suitable consumer-grade PSU configuration for six high-end GPUs can be challenging.

For a 6-GPU system, we believe the best approach is to use a rackmount server chassis installed in a dedicated server room with proper power, cooling, and ventilation.

[CatsLurkerer]

Actually, seems that still with 3000 series are way too expensive even if they are from past gpu generations, I suggest a new tier called "Essential" which includes 1x RTX 4060 TI 16 GB's

[kyle-aus]

A 3-fan RTX 4060 Ti 16 GB should fit our current case without issues. The shorter 2-fan models would need a small mounting modification since the case is designed around longer GPUs.

We also like the idea of an "Essential" tier. Since the case already has 4 GPU slots, you can start with a single GPU today and easily add more cards or upgrade to newer GPU models later as your needs grow.