Blog

Hongbo Shi

LLM performance engineer at Parasail, specializing in inference optimization including speculative decoding, quantization, and distributed serving. He brings experience from Anuttacon and nearly five years at Amazon, where he led the model processing platform and optimization.