parallelloop's Introduction

ParallelLoop 💞

Parallel + functional operations in swift

Features:

👯‍♂️ Process data in parallel over many cpu-cores and awaits
💜 Functional operations you already know and love
⚛️ Thread safe values across cpu-cores with AtomicValue
⏩ Easily stride big data-sets with the array divide operation
🎚Toggle concurrency on / off

Examples:

// Parallel map
let result = [0, 1, 2, 3].concurrentMap { i in
   i * 2
}
print(result) // 0, 2, 4, 6

// Parallel forEach
[1, 2, 3, 4].concurrentForEach {
   print($0) // 1,2,3,4
}

// Parallel compactMap
let array = [0, 1, nil, 3].concurrentCompactMap { i in
   i * 2
}
print(array) // 0, 2, 6

// Parallel reduce
let str: String = [0, 1, 2].concurrentReduce("") {
   $0 + "\( $1)"
} // "012"
print(str)

// Atomic value:
let x: Atomic<Int> = .init(0) // can be written and read across cores and threads
DispatchQueue.concurrentPerform(iterations: 1000) { y in
   x.mutate { $0 += 1 }
}
print(x.value) // 1000

// Stride concurrent operations on big data sets
// We stride to utlize cores better
// The cost of managing threads out way the benefit on big data sets
let batches = Array(0..<1000).divideBy(by: 20) // try different amounts
batches.concurrentForEach { batch in // one batch at the time (50 times), avoids cpu admin overhead
   batch.forEach { $0 } // only assigns 20 operations at the time
} // Use .flatMap { $0 } if you need to flatten the result etc

// or even easier:
// The batches method also ensures a good distribution for big and small data sets
// great when the data-set count varies
Array(0..<1000).batches(spread: 20).concurrentForEach { batch in
   batch.forEach { $0 }
}

// Another example using flatMap:
let values: [Int] = Array(0..<1000).batches(spread: 20).concurrentFlatMap { batch in
   batch.map { $0 }
}

Installation:

Swift packag manager: .package(url: "https://github.com/passbook/ParallelLoop.git", .branch("master"))
XCode package-manager: search for ParallelLoop

Recommend Projects