Gdtyjr

I am attempting to build a number of figures with tikz...one keeps failing to build and the log file indicates I'm running out of memory.

I've used

initexmf --edit-config-file pdflatex
initexmf --dump=pdflatex

To increase the available memory up to the point I think I can...the config file now reads

pool_size=40000000 
main_memory=50000000 
extra_mem_bot=40000000

And yet the log file tells me

43000001 words of memory out of 43000000

What's frustrating is that I have built this figure before on an older computer with less memory...it's cut and paste code....which makes me think maybe I've screwed something up that's letting something run away.

Here's code for the figure

%%%%%%%%%%%%%%%%%%%%%%
documentclasssinglecol-new
%%%%%%%%%%%%%%%%%%%%%%

usepackagepgfplots
usepgfplotslibrarygroupplots
usetikzlibrarypgfplots.groupplots
usetikzlibraryplotmarks
usetikzlibrarypatterns
usetikzlibrarycalc
usepgfplotslibraryexternal

usepackage[external]tcolorbox
tcbset
 external/prefix=jobname-,
 external/safety=0mm,
 external/input source on error=false,
 

pgfplotssetcompat = 1.12

tcbEXTERNALIZE
tikzexternalize



%%%%%%%%%%%%%%%%%%%%%%
begindocument
%%%%%%%%%%%%%%%%%%%%%%


beginfigure[h!]
 centering
 beginextikzpicture[runs=2]fig7
 beginaxis[
 height=8cm,
 width=8cm,
 xmin=0,
 xmax=10000,
 %legend style=draw=none,
 legend style=at=(0.9,0.4),
 xlabel = $fracV(A)Resource Cost$ Ratio,
 ylabel = P(X),
 width=0.75textwidth,
 y tick label style=
 /pgf/number format/.cd,
 fixed,
 fixed zerofill,
 precision=1,
 /tikz/.cd
 ,
 x tick label style=
 /pgf/number format/.cd,
 fixed,
 fixed zerofill,
 precision=0,
 /tikz/.cd
 ,
 scaled ticks=false,
 ]
 addplot+[black, mark=o,line join=round, mark repeat=1000] table[col sep=comma, y=Empirical, x=X]CDFs.csv;
 addlegendentryscriptsize Empirical Data
 addplot+[black, mark=x,line join=round, mark repeat=1000] table[col sep=comma, y=PT, x=X]CDFs.csv;
 addlegendentryscriptsize Extended Pearson-Tukey
 addplot+[black, mark=|,line join=round, mark repeat=1000] table[col sep=comma, y=SM, x=X]CDFs.csv;
 addlegendentryscriptsize Extended Swanson-Megill
 addplot+[black, mark=square,line join=round, mark repeat=1000] table[col sep=comma, y=BM, x=X]CDFs.csv;
 addlegendentryscriptsize Bracket Median
 endaxis
 endextikzpicture
 captionElicited CDFs
 labelCDFGraph
endfigure

enddocument

Obviously the data is important here, but I'm not sure how to include it. It's 10,002 rows by 5 columns of floating point numbers to make 4 line graphs...it's honestly one of the simplest graphs in this paper...

The data file looks like

X Empirical PT BM SM
0 0 0.001 0.001 0.001
1 0 0.001 0.001 0.001
2 0 0.001 0.001 0.001
3 0 0.001 0.001 0.001
4 0 0.001 0.001 0.001
5 0 0.001 0.001 0.001
6 0 0.001 0.001 0.001
7 0 0.001 0.001 0.001
8 0 0.001 0.001 0.001
9 0 0.00101 0.001 0.001
10 0 0.00101 0.001 0.001
11 0 0.00101 0.001 0.001
12 0 0.00101 0.00101 0.00101

....
9990 1 1 1 1
9991 1 1 1 1
9992 1 1 1 1
9993 1 1 1 1
9994 1 1 1 1
9995 1 1 1 1
9996 1 1 1 1
9997 1 1 1 1
9998 1 1 1 1
9999 1 1 1 1
10000 1 1 1 1

Interestingly, I uninstalled and then re-installed the pgf package and this issue disappeared. Not sure if that counts as an "answer"...

Having a need to bump memory in MiKTeX

I searched around and collected the following recommendations which allowed me to revisit and run this plot.

 > initexmf --edit-config-file=pdfLaTeX

In notepad change or if no prior value add the following lines

main_memory=12000000
extra_mem_bot=99999999
font_mem_size=3000000

save the file and back at prompt run

> initexmf --dump=pdflatex

If you get an error message you need to repeat and reduce values until --dump=pdflatex does not error (for speed use a "binary chop", half last difference)

previously the points required

2008247 words of memory out of  3000000 (default) for 25%

2938707 words of memory out of  3000000 (default) for 45%

However the final working log shows for the full 10000 points 100%

  793011 words of memory out of 12000000

approx. 10% of expected ! (guess it gets partially cleared during run time)