Inspecting Model Inference Configurations for LLMs and Image Generation Models