What is Parallel Processing and Vector Processing

In this course, we will study parallel processing, the advantages, and disadvantages of parallel processing and vector processing, the classes of parallel computers, vector processing, and the difference between the two.

What is parallel processing?

In parallel processing instead of processing the instructions sequentially, we process them parallelly. This process enables the system to perform concurrent data processing and hence helping it to achieve faster performance.

Types of parallel processing

Bit Level

It is based on increasing the word size of the processor. By increasing the word size the number of instructions to be executed by the processor decreases.

Instruction Level Parallelism

It is a measure of how many instructions can be executed simultaneously.

Data Parallelism

It focuses on distributing the data among different nodes, which operates on data in parallel. It can be applied to arrays and matrices.

Task Parallelism

It focuses on distributing the tasks to different processors.

Parallel Processing

What are the advantages of parallel processing?

  1. Parallel processing makes execution fast.

  2. Much more suited for modeling, simulating and understanding complex problems.

  3. Parallel processing saves cost.

  4. It has a large storage and can do quick computations.

What are the disadvantages of parallel processing?

  1. Programming is quite difficult.

  2. Sometimes the results may not be good.

  3. There is a need for better cooling technologies in the case of computers like a cluster.

  4. Power consumption is high in computers like multi-core.

  5. The solutions given are a little harder to implement.

What are the classes of parallel computers?

Multicore Computing

The multi-core processor is a processor having many processors or processing units. The multi-core processor can issue multiple instructions per clock cycle from multiple instruction streams.

Symmetric Multiprocessing

Asymmetric multiprocessor is a computer system consisting of multiple identical processors. These processors share the memory and are connected via a bus.

Distributed Computing

A distributed memory multiprocessor is a distributed memory computer system in which the processing elements are connected via a network.

Cluster Computing

It is a group of loosely coupled computers that work together closely. The machines connected do not have symmetry.

Massively Parallel Computing

It is a single computer consisting of various network processors. They have some properties the same as the cluster computers.

Grid Computing

It is the most distributed form of parallel computing. It uses the computer communicating over the internet to work on a given problem.

What is vector processing?

What are the advantages of vector processing?

What are the disadvantages of vector processing?

What is the difference between vector processing and parallel processing?

It is simultaneous processing of the same tasks on two or more processors It is the processing of mathematical operations on a large scale array
The resources can be included in a single computer consisting of multiple processors The resources can be included in a single computer consisting of multiple registers
In this, there are various processors that are working In this, there is only one processor that is working