A RetroSearch Logo

Home - News ( United States | United Kingdom | Italy | Germany ) - Football scores

Search Query:

Showing content from https://mail.python.org/pipermail/python-dev/2015-September/141530.html below:

[Python-Dev] Yet another "A better story for multi-core Python" comment

[Python-Dev] Yet another "A better story for multi-core Python" commentTerry Reedy tjreedy at udel.edu
Wed Sep 9 07:33:44 CEST 2015
On 9/8/2015 2:08 PM, Stephen J. Turnbull wrote:
> R. David Murray writes:
>   > On Tue, 08 Sep 2015 10:12:37 -0400, Gary Robinson <garyrob at me.com> wrote:
>   > > 2) Have a mode where a particular data structure is not reference
>   > > counted or garbage collected.
>   >
>   > This sounds kind of like what Trent did in PyParallel (in a more generic
>   > way).
>
> Except Gary has a large persistent data structure, and Trent's only
> rule is "don't persist objects you want to operate on in parallel."
> The similarity may be purely superficial, though.

That rule, which includes not modifying persistent data, is only for the 
parallel threads. In his wikipedia search example, the main thread loads 
60 GB of data (and perhaps occasionally updates it) while multiple 
parallel threads, running of multiple cores, search the persistent data 
like busy little bees.

-- 
Terry Jan Reedy

More information about the Python-Dev mailing list

RetroSearch is an open source project built by @garambo | Open a GitHub Issue

Search and Browse the WWW like it's 1997 | Search results from DuckDuckGo

HTML: 3.2 | Encoding: UTF-8 | Version: 0.7.4