Al-Bahir Journal for Engineering and Pure Sciences


Analyze the possibilities of implementing a parallel algorithm to test the singularity of the N-th order matrix. Design and implement in ( C/C++) a solution based on sending messages between nodes using the PVM system library. Distribute the load among the nodes such that the computation time is as small as possible. Find out how the execution time and calculation acceleration depend on the number of nodes and the size of the problem (indicate the table and graphs). Based on the results, estimate the communication latency, for what size the task is (well) scalable on the given architecture, and what is the maximum size when the calculation is still bearable on the available architecture by divide the program into master -slave model which is able to send tasks and collect the results to receive it by master computer.


[1] Santos CMP, Aude JS. PM-PVM A portable multithreaded PVM. In: Proceedings 13th International Parallel Processing Symposium and 10th Symposium on Parallel and Distributed Processing, IPPS/SPDP; 1999.

[2] Yang Tao. Lecture notes on parallel scientific computing department of computer science university of California at santa barbara. 1998.

[3] Geist Al, Adam Beguelin, Jack Dongarra, Jiang Weicheng, Manchek Robert, Sunderam Vaidy. PVM: Parallel virtual machine. The MIT Press; 1994.

[4] El-Rewini Hesham. Advance computer architecture and parallel processing. NJ: John Wiley & Sons; 2005. [5] Jordan HF, Jordan HE. Fundamentals of paralle computing. Prentice Hall; 2002.

[6] Schneider electric, Master-Slave Principle, Digital image. https://product-help.schneider-electric.com/ED/ES_Power/ NT-NW_Modbus_IEC_Guide/EDMS/DOCA0054EN/ DOCA0054xx/Master_NS_Modbus_Protocol/Master_NS_ Modbus_Protocol-2.htm#:~:text¼The%20master%2Dslave% 20principle%20is,at%20www.modbus.org. [Accessed 18 November 2023].

[7] Akl SG. The Design and analysis of parallel algorithms. Englewood Cliffs, NJ: Prentice Hall; 1989.

[8] Gropp W, et al. The sourcebook of parallel computing. Morgan Kaufmann; 2002. Fig. 5. System Speedup. 86 AL-BAHIR JOURNAL FOR ENGINEERING AND PURE SCIENCES 2024;4:80e87

[9] Joseph J, Fellenstein C. Grid computing. Prentice Hall; 2003.

[10] Craig J. MATH10212 linear algebra textbook, D. Poole, linear algebra: a modern introduction. Thompson; 2006. ISBN 0- 534-40596-7.

[11] Maarten V, Andrew S. Distributed systems. third ed. CreateSpace Independent Publishing Platform; 2017. [12] Gederberg T. Parallel Processing using Parallel Processing using PVM on a Linux Cluster. CENG 2007;6532.