Meta claims developers can run inference on Llama 3.1 405B on their own infrastructure at roughly 50% the cost of using closed models like GPT-4o, for both user-facing and offline inference tasks.

supports (1)

• SOpen Source AI is the Path Forward expert_estimate
  weight

  0.60

  locator: 'Why Open Source AI Is Good for Developers' section, efficiency bullet

  “Developers can run inference on Llama 3.1 405B on their own infra at roughly 50% the cost of using closed models like GPT-4o, for both user-facing and offline inference tasks.”