Concurrency for scale out