AWS, NVIDIA, and Heidi Health have published a technical guide demonstrating that using NVIDIA CUDA Multi-Process Service (MPS) on Amazon EC2 G7e instances can reduce GPU infrastructure requirements for speech recognition by 75%. The architecture optimizes automatic speech recognition and diarization workloads to maintain sub-second latency while maximizing hardware utilization.