Multiprocessing

This is a specialized wrapper around multiprocessing.Process object. It launches multiple separate processes with the same input ‘function’ but different argument that comes from an iterable object like tuple or list.

Start by importing UBCS LCP auxiliary package library.

first you can install the auxiliary library

pip3 install ubcs_auxiliary

you may need to upgrade the library if it was installed before

pip3 install --upgrade ubcs_auxiliary

>>> from ubcs_auxiliary.multiprocessing import MultiProcessing
>>> def function(N, **kwargs):
      """
      an example function for test purposes. It sleeps for N seconds. Prints statements when sleep starts and finishes.
      """
      from time import time, sleep
      import os
      print_text_kwarg(**kwargs)
      print_dict_kwarg(**kwargs)
      print_var_kwarg(**kwargs)
      print('Starting Process: pid: {}'.format(os.getpid()))
      t1 = time()
      print('[{} s] Start sleeping for {} seconds'.format(round(time()-t1,4),N))
      print('[{} s] Sleeping... '.format(round(time()-t1,4)))
      sleep(N)
      print('[{} s] Done sleeping for {} seconds'.format(round(time()-t1,4),N))
>>> kwargs = {'text': 'my new text', 'var' : 15.64, 'dict' : {'key':'my new value'}}
>>> mp = MultiProcessing(function, (1,2,3), kwargs = kwargs)
kwarg text = my new text
kwarg dict = {'key': 'my new value'}
kwarg var = 15.64
Starting Process: pid: 14789
[0.0 s] Start sleeping for 1 seconds
[0.0002 s] Sleeping...
kwarg text = my new text
kwarg dict = {'key': 'my new value'}
kwarg var = 15.64
Starting Process: pid: 14790
[0.0 s] Start sleeping for 2 seconds
[0.0 s] Sleeping...
kwarg text = my new text
kwarg dict = {'key': 'my new value'}
kwarg var = 15.64
Starting Process: pid: 14792
[0.0 s] Start sleeping for 3 seconds
[0.0 s] Sleeping...
In [3]: [1.0013 s] Done sleeping for 1 seconds
[2.0001 s] Done sleeping for 2 seconds
[3.0002 s] Done sleeping for 3 seconds

Or you can import

>>> from ubcs_auxiliary.multiprocessing import MultiProcessing, test, function
>>> test()
kwarg text = my new text
kwarg dict = {'key': 'my new value'}
kwarg var = 15.64
Starting Process: pid: 14789
[0.0 s] Start sleeping for 1 seconds
[0.0002 s] Sleeping...
kwarg text = my new text
kwarg dict = {'key': 'my new value'}
kwarg var = 15.64
Starting Process: pid: 14790
[0.0 s] Start sleeping for 2 seconds
[0.0 s] Sleeping...
kwarg text = my new text
kwarg dict = {'key': 'my new value'}
kwarg var = 15.64
Starting Process: pid: 14792
[0.0 s] Start sleeping for 3 seconds
[0.0 s] Sleeping...
In [3]: [1.0013 s] Done sleeping for 1 seconds
[2.0001 s] Done sleeping for 2 seconds
[3.0002 s] Done sleeping for 3 seconds

class ubcs_auxiliary.multiprocessing.MultiProcessing(function, args, **kwargs)

__init__(function, args, **kwargs)

This is a specialized wrapper around multiprocessing.Process object. It launches multiple separate processes with the same input ‘function’ but different argument that comes from an iterable object like tuple or list.

Parameters

function :: function

function object

args :: list or tuple

iterable of arguments

kwargs :: dictionary

keyword arguments that will be passed to the function

Returns

jobs :: list

list of jobs

Examples

>>> mp = ParallelProcessing(function, (1,2,3))

#.. automodule:: ubcs_auxiliary.multiprocessing # :members: