"100% overcapacity" is also known as "50% load factor". It's common knowledge to... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

nine_k on July 10, 2024 | parent | context | favorite | on: End-to-end congestion control cannot avoid latency...

"100% overcapacity" is also known as "50% load factor".

It's common knowledge to run your API nodes at 20%-60% CPU load, no more, exactly to curb tail latency.

sambazi on July 10, 2024 [–]

just think about your competitive edge if you could manage to cramp more load w/o affecting latency

jdougan on July 11, 2024 | [–]

Depends on what you have to pay (and not just in money) to get there.

Consider applying for YC's Fall 2026 batch! Applications are open till July 27.
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact