Back to all articles
•Technology

AI Startup General Compute Secures Loan for Inference-Specific Chips

View original source

General Compute, an AI inference cloud startup, has secured a $400 million loan from Upper90, marking a unique financial strategy for tech hardware investments. This loan will use inference-specific chips as collateral, a first for the industry.

  • The demand for cost-effective AI tools is driving the development of infrastructure that utilizes open source models rather than expensive new LLMs from leading labs.
  • General Compute, founded by Finn Puklowski and Jason Goodison, had previously raised $15 million for developing an inference neocloud based on silicon from SambaNova, an Intel-backed company.
  • These chips, labeled SN50, are emphasized for their efficiency, not requiring expensive cooling, and offering 16 times faster inference capabilities compared to typical GPU-based clouds.
  • The market trend suggests interest in alternatives to Nvidia's market dominance, with firms like TensorWave and new entrants like OpenRouter and Fireworks gaining momentum.
  • Upper90, led by Billy Libby, strategically moves towards funding companies like General Compute amidst a shift from Nvidia GPUs, highlighting the evolution in AI infrastructure financing and the diversification of chip supply chains.