Concentrator-based growable packet switch