Software Engineering Stack Exchange
Software Engineering Stack Exchange

Questions tagged [parallel-programming]

For questions about programming in such a way that a task can be divided among multiple threads/workers which work simultaneously ('in parallel') on the subtasks, leading to performance gains.

73 questions
63
votes
12 answers

What kind of problems does MapReduce solve?

I have been reading about MapReduce for a while -- but what I can't understand is how someone would make a decision to use (or not use) MapReduce. I mean, what are the problem patterns that signal that MapReduce could be used.
treecoder
  • 9,475
  • 10
  • 47
  • 84
50
votes
5 answers

What is it about functional programming that makes it inherently adapted to parallel execution?

I've been reading over and over that functional languages are ideal (or at least very often useful) for parallelism. Why is this? What core concepts and paradigms are typically employed and which specific problems do they solve? On an abstract…
Louis Thibault
  • 2,178
  • 3
  • 16
  • 17
26
votes
10 answers

Programming language where every function call/block is done in a separate thread?

I'm currently creating a programming language for fun where the idea is that every function call/new block (if clauses, loops etc) will work in a separate thread. Instead of creating new Threads the standard should be that it does that…
Grimbox
  • 377
  • 3
  • 4
22
votes
11 answers

Do algorithms depend on computer architectures?

I read somewhere (forgot which book it is) that algorithms are independent of computer architectures. Some even say algorithms are themselves computation (machines?)? On the other hand, books on parallel programming have chapters on parallel…
Tim
  • 5,405
  • 7
  • 48
  • 84
17
votes
2 answers

Debug multiprocessing in Python

What are some good practices in debugging multiprocessing programs in Python?
vonPetrushev
  • 293
  • 1
  • 2
  • 7
9
votes
1 answer

How to design a good generic tiled image downloader?

Tiled images Tiled images are large images that have been split in smaller square tiles. There are several tiled image formats, with different ways of organizing the tile files. A tiled image on the web can be downloaded only by finding all the…
lovasoa
  • 199
  • 4
8
votes
1 answer

Parallel programming library? (+ some features)

Note: this is a reposting as the question has been considered non-suitable for the Stack Overflow forum and should have been posted here. The original topic is there. I'd like to talk of multithreading, parallelism and the libraries available today…
Ceylo
  • 183
  • 1
  • 4
7
votes
3 answers

How do I know if a set of code is a good candidate for parallelization?

How can I tell in an application if there are parts that will benefit from using the C# Task library (I believe that is the Parallel processing library.) Given other optimizations have been done, how do I know other than just try it? In C#, can I…
johnny
  • 3,669
  • 3
  • 21
  • 35
7
votes
1 answer

Immediately awaiting an asynchronous call

While working on an inherited project, I noticed the original dev(s) created many asynchronous functions that never seem to take advantage of being, well, asynchronous. For example: // The async method private async Type myFuncAsync() { .. gets…
8protons
  • 1,359
  • 1
  • 10
  • 27
6
votes
1 answer

Help/suggestions for Parallel assembly line scheduling (Dynamic programming)

I am working on a problem similar to the assembly line scheduling by dynamic programming.The issue is that unlike the classic problem where we have predefined stations now I only have information which task should run before which other(could be…
user109405
6
votes
1 answer

Which parallel pattern to use?

I need to write a server application that fetches mails from different mail servers/mailboxes and then needs to process/analyze these mails. Traditionally, I would do this multi-threaded, launching a thread for fetching mails (or maybe one per…
Wim Van Houts
  • 161
  • 3
6
votes
1 answer

How can I benchmark concurrent key-value stores?

I have some concurrent key-value store implementations that are implemented with hash tables and search trees that I would like to compare. I would like to benchmark them with a real world application where several threads stresses the key-value…
Kjell
  • 69
  • 4
6
votes
1 answer

Asynchronously returning a hierarchal data using .NET TPL... what should my return object "look" like?

I want to use the .NET TPL to asynchronously do a DIR /S and search each subdirectory on a hard drive, and want to search for a word in each file... what should my API look like? In this scenario I know that each sub directory will have 0..10000…
makerofthings7
  • 6,038
  • 4
  • 39
  • 77
6
votes
5 answers

Cloud computing platforms often default to one CPU. Does this mean I shouldn't use Parallel Programming?

Almost every cloud instance I can find defaults one CPU. Why is this only one CPU now, and should I expect this to increase in the future? Does this design impact my code design so that I exclude technologies like Task Parallel Library? This is on…
makerofthings7
  • 6,038
  • 4
  • 39
  • 77
6
votes
8 answers

When should I use parallelism?

After asking this question, I got to realize that parallelism may not always be good. So far I can see that parallelism (under c#) is A little complicated code-wise Will probably insert some concurrency complications Will not always be faster I…
Mithir
  • 1,339
  • 3
  • 13
  • 23
1
2 3 4 5