Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

incremental = false mode causes Pkg.precompile to overload all threads when multithreading #778

Closed
IanButterworth opened this issue Feb 1, 2023 · 4 comments · May be fixed by #781
Closed

incremental = false mode causes Pkg.precompile to overload all threads when multithreading #778

IanButterworth opened this issue Feb 1, 2023 · 4 comments · May be fixed by #781

Comments

@IanButterworth
Copy link
Sponsor Member

IanButterworth commented Feb 1, 2023 •
edited

Locally, about 5 minutes into the test suite, during the create_app incremental = false, filter = false testset the Pkg.precompile (11 dependencies successfully precompiled in 137 seconds below) causes my 16 core machine to max out, while only precompiling a handful of packages in parallel.

It doesn't happen in other Pkg.precompile jobs in other testsets before this.

Then an error is thrown but tests pass

Note that this is current julia master (no LLVM image paralelization) and PackageCompiler has pkgimages disabled.

julia> versioninfo()
Julia Version 1.10.0-DEV.469
Commit c18909d6557 (2023-02-01 14:13 UTC)
Platform Info:
  OS: Linux (x86_64-linux-gnu)
  CPU: 32 × AMD Ryzen 9 5950X 16-Core Processor
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-14.0.6 (ORCJIT, znver3)
  Threads: 16 on 32 virtual cores

┌ Info: starting: create_app testset
│   incremental = false
└   filter = false
[ Warning: PackageCompiler: This does not look like an official Julia build, functionality may suffer.
┌ Warning: it is not recommended to create an app/library without a preexisting manifest
└ @ PackageCompiler ~/Documents/GitHub/PackageCompiler.jl/src/PackageCompiler.jl:70
    Updating registry at `/tmp/jl_kafMYK/registries/General.toml`
   Installed HelloWorldC_jll ─ v1.2.1+1
   Installed Preferences ───── v1.3.0
   Installed LLVMExtra_jll ─── v0.0.16+0
   Installed micromamba_jll ── v1.2.0+0
   Installed Example ───────── v0.5.3
   Installed JLLWrappers ───── v1.4.1
  Downloaded artifact: LLVMExtra
  Downloaded artifact: HelloWorldC
  Downloaded artifact: fooifier
    Updating `/tmp/jl_14yokA/MyApp/Project.toml`
  [a8cc5b0e] + Crayons v4.1.1
  [7876af07] + Example v0.5.3
  [dca1746e] + HelloWorldC_jll v1.2.1+1
  [dad2f222] + LLVMExtra_jll v0.0.16+0
  [f8abcde7] + micromamba_jll v1.2.0+0
    Updating `/tmp/jl_14yokA/MyApp/Manifest.toml`
  [a8cc5b0e] + Crayons v4.1.1
  [7876af07] + Example v0.5.3
  [692b3bcd] + JLLWrappers v1.4.1
  [21216c6a] + Preferences v1.3.0
  [dca1746e] + HelloWorldC_jll v1.2.1+1
  [dad2f222] + LLVMExtra_jll v0.0.16+0
  [f8abcde7] + micromamba_jll v1.2.0+0
  [0dad84c5] + ArgTools v1.1.1
  [56f22d72] + Artifacts
  [2a0f44e3] + Base64
  [ade2ca70] + Dates
  [8ba89e20] + Distributed
  [f43a241f] + Downloads v1.6.0
  [7b1f6079] + FileWatching
  [b77e0a4c] + InteractiveUtils
  [4af54fe1] + LazyArtifacts
  [b27032c2] + LibCURL v0.6.3
  [76f85450] + LibGit2
  [8f399da3] + Libdl
  [56ddb016] + Logging
  [d6f4376e] + Markdown
  [ca575930] + NetworkOptions v1.2.0
  [44cfe95a] + Pkg v1.10.0
  [de0858da] + Printf
  [3fa0cd96] + REPL
  [9a3f8284] + Random
  [ea8e919c] + SHA v0.7.0
  [9e88b42a] + Serialization
  [6462fe0b] + Sockets
  [fa267f1f] + TOML v1.0.3
  [a4e569a6] + Tar v1.10.0
  [cf7118a7] + UUIDs
  [4ec0a83e] + Unicode
  [deac9b47] + LibCURL_jll v7.84.0+0
  [29816b5a] + LibSSH2_jll v1.10.2+0
  [c8ffd9c3] + MbedTLS_jll v2.28.0+0
  [14a3606d] + MozillaCACerts_jll v2022.10.11
  [83775a58] + Zlib_jll v1.2.13+0
  [8e850ede] + nghttp2_jll v1.48.0+0
  [3f19e933] + p7zip_jll v17.4.0+0
  Downloaded artifact: micromamba
PackageCompiler: bundled artifacts:
  ├── HelloWorldC_jll - 12.448 KiB
  ├── LLVMExtra_jll - 3.159 MiB
  ├── MyApp
  │   └── fooifier - 22.635 KiB
  └── micromamba_jll - 13.865 MiB
  Total artifact file size: 17.058 MiB
┌ Debug: instantiating project at "/tmp/jl_14yokA/MyApp"
└ @ PackageCompiler ~/Documents/GitHub/PackageCompiler.jl/src/PackageCompiler.jl:514
┌ Debug: running `/home/ian/Downloads/julia-c18909d655/bin/julia --color=yes --startup-file=no --pkgimages=no --output-ji /tmp/jl_VYq2qe/corecompiler.ji -g0 -O0 /home/ian/Downloads/julia-c18909d655/share/julia/base/compiler/compiler.jl`
│   JULIA_CPU_TARGET = "generic;sandybridge,-xsaveopt,clone_all;haswell,-rdrnd,base(1)"
└ @ PackageCompiler ~/Documents/GitHub/PackageCompiler.jl/src/PackageCompiler.jl:231
⠸ [01m:19s] PackageCompiler: compiling base system image (incremental=false)┌ Debug: running `/home/ian/Downloads/julia-c18909d655/bin/julia --color=yes --startup-file=no --pkgimages=no --sysimage=/tmp/jl_VYq2qe/corecompiler.ji -g1 -O0 --output-ji=/tmp/jl_VYq2qe/sys.ji /tmp/jl_VYq2qe/sysimage_packagecompiler_117cde4e-a252-11ed-22c3-fb4fc72ae03e.jl`
│   JULIA_CPU_TARGET = "generic;sandybridge,-xsaveopt,clone_all;haswell,-rdrnd,base(1)"
└ @ PackageCompiler ~/Documents/GitHub/PackageCompiler.jl/src/PackageCompiler.jl:250
✔ [02m:24s] PackageCompiler: compiling base system image (incremental=false)
┌ Debug: ensurecompiled: running `/home/ian/Downloads/julia-c18909d655/bin/julia --color=yes --startup-file=no --pkgimages=no --sysimage=/tmp/jl_VYq2qe/sys.ji -e 'using Pkg; Pkg.precompile()'`
│   JULIA_LOAD_PATH = "/tmp/jl_14yokA/MyApp:@stdlib"
└ @ PackageCompiler ~/Documents/GitHub/PackageCompiler.jl/src/PackageCompiler.jl:274
Precompiling environment...
  11 dependencies successfully precompiled in 137 seconds
┌ Debug: running precompilation execution script...
└ @ PackageCompiler ~/Documents/GitHub/PackageCompiler.jl/src/PackageCompiler.jl:309
┌ Debug: run_precompilation_script: running `/home/ian/Downloads/julia-c18909d655/bin/julia --color=yes --startup-file=no --pkgimages=no --sysimage=/tmp/jl_VYq2qe/sys.ji --compile=all --trace-compile=/tmp/jl_packagecompiler_h67Shg/jl_PrJjRU /home/ian/Documents/GitHub/PackageCompiler.jl/test/../examples/MyApp/precompile_app.jl`
│   JULIA_LOAD_PATH = "/tmp/jl_14yokA/MyApp:@stdlib"
└ @ PackageCompiler ~/Documents/GitHub/PackageCompiler.jl/src/PackageCompiler.jl:287
[ Info: PackageCompiler: Executing /home/ian/Documents/GitHub/PackageCompiler.jl/examples/MyApp/precompile_app.jl => /tmp/jl_packagecompiler_h67Shg/jl_PrJjRU
ARGS = ["arg"]
Base.PROGRAM_FILE = "/home/ian/Documents/GitHub/PackageCompiler.jl/test/../examples/MyApp/precompile_app.jl"
DEPOT_PATH = ["/tmp/jl_kafMYK"]
LOAD_PATH = ["/tmp/jl_14yokA/MyApp", "@stdlib"]
pwd() = "/home/ian/Documents/GitHub/PackageCompiler.jl/test"
Base.active_project() = "/tmp/jl_14yokA/MyApp/Project.toml"
Sys.BINDIR = "/home/ian/Downloads/julia-c18909d655/bin"
(Base.JLOptions()).opt_level = 2
(Base.JLOptions()).nthreads = 0
(Base.JLOptions()).check_bounds = 0
Dict{Base.PkgId, Module} with 51 entries:
  Downloads [f43a241f-c20a-4ad4-852c-f6b1247861c6] => Downloads
  Example [7876af07-990d-54b4-ab0e-23690620f79a] => Example
  Unicode [4ec0a83e-493e-50e2-b9ac-8f72acf5a8f5] => Unicode
  Main [top-level] => Main
  REPL [3fa0cd96-eef1-5676-8a61-b3b8758bbffb] => REPL
  NetworkOptions [ca575930-c2e3-43a9-ace4-1e988b2c1908] => NetworkOptions
  HelloWorldC_jll [dca1746e-5efc-54fc-8249-22745bc95a49] => HelloWorldC_jll
  OpenBLAS_jll [4536629a-c528-5b80-bd46-f80d51c5b363] => OpenBLAS_jll
  Serialization [9e88b42a-f829-5b0c-bbe9-9e923198166b] => Serialization
  libblastrampoline_jll [8e850b90-86db-534c-a0d3-1478176c7d93] => libblastrampoline_jll
  Profile [9abbd945-dff8-562f-b5e8-e1ebf5ef1b79] => Profile
  UUIDs [cf7118a7-6976-5b1a-9a39-7adc72f591a4] => UUIDs
  LLVMExtra_jll [dad2f222-ce93-54a1-a47d-0025e8a3acab] => LLVMExtra_jll
  Logging [56ddb016-857b-54e1-b83d-db4d58db5568] => Logging
  Random [9a3f8284-a2c9-5f02-9a11-845980a1fd5c] => Random
  LinearAlgebra [37e2e46d-f89d-539d-b4ee-838fcccc9c8e] => LinearAlgebra
  Printf [de0858da-6303-5e67-8744-51eddeeeb8d7] => Printf
  ArgTools [0dad84c5-d112-42e6-8d28-ef12dabb789f] => ArgTools
  SparseArrays [2f01184e-e22b-5df5-ae63-d93ebab69eaf] => SparseArrays
  Base64 [2a0f44e3-6c83-55bd-87e4-b1978d98bd5f] => Base64
  Markdown [d6f4376e-aef5-505a-96c1-9c027394607a] => Markdown
  CompilerSupportLibraries_jll [e66e0078-7015-5450-92f7-15fbd957f2ae] => CompilerSupportLibraries_jll
  MozillaCACerts_jll [14a3606d-f60d-562e-9121-12d972cd8159] => MozillaCACerts_jll
  Distributed [8ba89e20-285c-5b6f-9357-94700520ee1b] => Distributed
  LibCURL_jll [deac9b47-8bc7-5906-a0fe-35ac56dc84c0] => LibCURL_jll
  TOML [fa267f1f-6049-4f14-aa54-33bafae1ed76] => TOML
  Core [top-level] => Core
  CRC32c [8bf52ea8-c179-5cab-976a-9e18b702a9bc] => CRC32c
  LazyArtifacts [4af54fe1-eca0-43a8-85a7-787d91b784e3] => LazyArtifacts
  micromamba_jll [f8abcde7-e9b7-5caa-b8af-a437887ae8e4] => micromamba_jll
  Tar [a4e569a6-e804-4fa4-b0f3-eef7a1d5b13e] => Tar
  LibGit2 [76f85450-5226-5b5a-8eaa-529ad045b433] => LibGit2
  Mmap [a63ad114-7e13-5084-954f-fe012c677804] => Mmap
  Test [8dfed614-e22c-5e08-85e1-65c5234f0b40] => Test
  Sockets [6462fe0b-24de-5631-8697-dd941f90decc] => Sockets
  Future [9fa8497b-333b-5362-9e8d-4d0656e87820] => Future
  nghttp2_jll [8e850ede-7688-5339-a07c-302acd2aaf8d] => nghttp2_jll
  SharedArrays [1a1011a3-84de-559e-8e89-a11a2f7dc383] => SharedArrays
  Libdl [8f399da3-3557-5675-b5ff-fb832c97cbdb] => Libdl
  SHA [ea8e919c-243c-51af-8825-aaa63cd721ce] => SHA
  Pkg [44cfe95a-1eb2-52ea-b672-e2afdf69b78f] => Pkg
  FileWatching [7b1f6079-737a-58dc-b8bc-7a2ca5c1b5ee] => FileWatching
  Artifacts [56f22d72-fd6d-98f1-02f0-08ddc0907c33] => Artifacts
  Dates [ade2ca70-3891-5945-98fb-dc099432e06a] => Dates
  InteractiveUtils [b77e0a4c-d291-57a0-90e8-8db25a27a240] => InteractiveUtils
  p7zip_jll [3f19e933-33d8-53b3-aaab-bd5110c3b7a0] => p7zip_jll
  MyApp [f943f3d7-887a-4ed5-b0c0-a1d6899aa8f5] => MyApp
  LibCURL [b27032c2-a3e7-50c8-80cd-2d36dbcbfd21] => LibCURL
  JLLWrappers [692b3bcd-3c85-4b1f-b108-f13ce0eb3210] => JLLWrappers
  Base [top-level] => Base
  Preferences [21216c6a-2e73-6563-6e65-726566657250] => Preferences

Running a jll package:
HelloWorld artifact at /tmp/jl_kafMYK/artifacts/8c8251b0c21615bce0701995eded26ac7697b5cc/bin/hello_world
Hello, World!

is_crayons_loaded() = false
Running the artifact
The result of 2*5^2 - 10 == 40.000000

unsafe_string((Base.JLOptions()).image_file) = "/tmp/jl_VYq2qe/sys.ji"
Example.domath(5) = 10
sin(0.0) = 0.0
outputo: ok
myrand: ok
ERROR: TaskFailedException

    nested task error: Timed out waiting to read host:port string from worker.
    Stacktrace:
     [1] worker_from_id(pg::Distributed.ProcessGroup, i::Int64)
       @ Distributed ~/Downloads/julia-c18909d655/share/julia/stdlib/v1.10/Distributed/src/cluster.jl:1093
     [2] worker_from_id
       @ ~/Downloads/julia-c18909d655/share/julia/stdlib/v1.10/Distributed/src/cluster.jl:1090 [inlined]
     [3] #remote_do#170
       @ ~/Downloads/julia-c18909d655/share/julia/stdlib/v1.10/Distributed/src/remotecall.jl:557 [inlined]
     [4] remote_do
       @ ~/Downloads/julia-c18909d655/share/julia/stdlib/v1.10/Distributed/src/remotecall.jl:557 [inlined]
     [5] kill(manager::Distributed.LocalManager, pid::Int64, config::Distributed.WorkerConfig; exit_timeout::Int64, term_timeout::Int64)
       @ Distributed ~/Downloads/julia-c18909d655/share/julia/stdlib/v1.10/Distributed/src/managers.jl:738
     [6] kill
       @ ~/Downloads/julia-c18909d655/share/julia/stdlib/v1.10/Distributed/src/managers.jl:736 [inlined]
     [7] create_worker(manager::Distributed.LocalManager, wconfig::Distributed.WorkerConfig)
       @ Distributed ~/Downloads/julia-c18909d655/share/julia/stdlib/v1.10/Distributed/src/cluster.jl:604
     [8] setup_launched_worker(manager::Distributed.LocalManager, wconfig::Distributed.WorkerConfig, launched_q::Vector{Int64})
       @ Distributed ~/Downloads/julia-c18909d655/share/julia/stdlib/v1.10/Distributed/src/cluster.jl:545
     [9] (::Distributed.var"#45#48"{Distributed.LocalManager, Vector{Int64}, Distributed.WorkerConfig})()
       @ Distributed ./task.jl:514
    
    caused by: Timed out waiting to read host:port string from worker.
    Stacktrace:
     [1] read_worker_host_port(io::Base.PipeEndpoint)
       @ Distributed ~/Downloads/julia-c18909d655/share/julia/stdlib/v1.10/Distributed/src/cluster.jl:344
     [2] connect(manager::Distributed.LocalManager, pid::Int64, config::Distributed.WorkerConfig)
       @ Distributed ~/Downloads/julia-c18909d655/share/julia/stdlib/v1.10/Distributed/src/managers.jl:575
     [3] create_worker(manager::Distributed.LocalManager, wconfig::Distributed.WorkerConfig)
       @ Distributed ~/Downloads/julia-c18909d655/share/julia/stdlib/v1.10/Distributed/src/cluster.jl:600
     [4] setup_launched_worker(manager::Distributed.LocalManager, wconfig::Distributed.WorkerConfig, launched_q::Vector{Int64})
       @ Distributed ~/Downloads/julia-c18909d655/share/julia/stdlib/v1.10/Distributed/src/cluster.jl:545
     [5] (::Distributed.var"#45#48"{Distributed.LocalManager, Vector{Int64}, Distributed.WorkerConfig})()
       @ Distributed ./task.jl:514

...and 3 more exceptions.

Stacktrace:
  [1] sync_end(c::Channel{Any})
    @ Base ./task.jl:445
  [2] macro expansion
    @ ./task.jl:477 [inlined]
  [3] addprocs_locked(manager::Distributed.LocalManager; kwargs::Base.Pairs{Symbol, Union{}, Tuple{}, NamedTuple{(), Tuple{}}})
    @ Distributed ~/Downloads/julia-c18909d655/share/julia/stdlib/v1.10/Distributed/src/cluster.jl:490
  [4] addprocs_locked
    @ ~/Downloads/julia-c18909d655/share/julia/stdlib/v1.10/Distributed/src/cluster.jl:456 [inlined]
  [5] addprocs(manager::Distributed.LocalManager; kwargs::Base.Pairs{Symbol, Union{}, Tuple{}, NamedTuple{(), Tuple{}}})
    @ Distributed ~/Downloads/julia-c18909d655/share/julia/stdlib/v1.10/Distributed/src/cluster.jl:450
  [6] addprocs
    @ ~/Downloads/julia-c18909d655/share/julia/stdlib/v1.10/Distributed/src/cluster.jl:443 [inlined]
  [7] #addprocs#262
    @ ~/Downloads/julia-c18909d655/share/julia/stdlib/v1.10/Distributed/src/managers.jl:465 [inlined]
  [8] addprocs
    @ ~/Downloads/julia-c18909d655/share/julia/stdlib/v1.10/Distributed/src/managers.jl:462 [inlined]
  [9] real_main()
    @ MyApp /tmp/jl_14yokA/MyApp/src/MyApp.jl:77
 [10] julia_main()
    @ MyApp /tmp/jl_14yokA/MyApp/src/MyApp.jl:25
 [11] top-level scope
    @ ~/Documents/GitHub/PackageCompiler.jl/examples/MyApp/precompile_app.jl:4
 [12] include(mod::Module, _path::String)
    @ Base ./Base.jl:456
 [13] exec_options(opts::Base.JLOptions)
    @ Base ./client.jl:307
 [14] _start()
    @ Base ./client.jl:522
[ Info: PackageCompiler: Done
┌ Debug: running `/home/ian/Downloads/julia-c18909d655/bin/julia --color=yes --startup-file=no --pkgimages=no -O3 --sysimage=/tmp/jl_VYq2qe/sys.ji --project=/tmp/jl_14yokA/MyApp --output-o=/tmp/jl_2ZEzi5qnC7.o /tmp/jl_i7EZYLMLmf`
│   JULIA_CPU_TARGET = "generic;sandybridge,-xsaveopt,clone_all;haswell,-rdrnd,base(1)"
└ @ PackageCompiler ~/Documents/GitHub/PackageCompiler.jl/src/PackageCompiler.jl:408
✔ [01m:38s] PackageCompiler: compiling nonincremental system image
┌ Debug: running `g++ -m64 -march=x86-64 -shared -L/home/ian/Downloads/julia-c18909d655/lib -L/home/ian/Downloads/julia-c18909d655/lib/julia -o /tmp/jl_14yokA/MyAppCompiled/lib/julia/sys.so -Wl,--whole-archive /tmp/jl_2ZEzi5qnC7.o -Wl,--no-whole-archive -Wl,-rpath-link,/home/ian/Downloads/julia-c18909d655/lib -Wl,-rpath-link,/home/ian/Downloads/julia-c18909d655/lib/julia -ljulia -ljulia-internal -fPIC -Wl,-soname,sys.so '-Wl,-rpath,$ORIGIN:$ORIGIN/julia'`
└ @ PackageCompiler ~/Documents/GitHub/PackageCompiler.jl/src/PackageCompiler.jl:193
┌ Debug: running `gcc '-DJULIA_MAIN="MyApp.julia_main"' -DNEW_DEFINE_FAST_TLS_SYNTAX -m64 -march=x86-64 -o /tmp/jl_14yokA/MyAppCompiled/bin/MyApp /home/ian/Documents/GitHub/PackageCompiler.jl/src/embedding_wrapper.c -O2 '-Wl,-rpath,$ORIGIN/../lib:$ORIGIN/../lib/julia' -std=gnu99 -I/home/ian/Downloads/julia-c18909d655/include/julia -fPIC -L/home/ian/Downloads/julia-c18909d655/lib -L/home/ian/Downloads/julia-c18909d655/lib/julia -Wl,--export-dynamic -Wl,-rpath-link,/home/ian/Downloads/julia-c18909d655/lib -Wl,-rpath-link,/home/ian/Downloads/julia-c18909d655/lib/julia -ljulia -ljulia-internal`
└ @ PackageCompiler ~/Documents/GitHub/PackageCompiler.jl/src/PackageCompiler.jl:193
┌ Debug: running `gcc '-DJULIA_MAIN="MyApp.second_main"' -DNEW_DEFINE_FAST_TLS_SYNTAX -m64 -march=x86-64 -o /tmp/jl_14yokA/MyAppCompiled/bin/SecondApp /home/ian/Documents/GitHub/PackageCompiler.jl/src/embedding_wrapper.c -O2 '-Wl,-rpath,$ORIGIN/../lib:$ORIGIN/../lib/julia' -std=gnu99 -I/home/ian/Downloads/julia-c18909d655/include/julia -fPIC -L/home/ian/Downloads/julia-c18909d655/lib -L/home/ian/Downloads/julia-c18909d655/lib/julia -Wl,--export-dynamic -Wl,-rpath-link,/home/ian/Downloads/julia-c18909d655/lib -Wl,-rpath-link,/home/ian/Downloads/julia-c18909d655/lib/julia -ljulia -ljulia-internal`
└ @ PackageCompiler ~/Documents/GitHub/PackageCompiler.jl/src/PackageCompiler.jl:193
┌ Debug: running `gcc '-DJULIA_MAIN="MyApp.wrong_return_type"' -DNEW_DEFINE_FAST_TLS_SYNTAX -m64 -march=x86-64 -o /tmp/jl_14yokA/MyAppCompiled/bin/ReturnType /home/ian/Documents/GitHub/PackageCompiler.jl/src/embedding_wrapper.c -O2 '-Wl,-rpath,$ORIGIN/../lib:$ORIGIN/../lib/julia' -std=gnu99 -I/home/ian/Downloads/julia-c18909d655/include/julia -fPIC -L/home/ian/Downloads/julia-c18909d655/lib -L/home/ian/Downloads/julia-c18909d655/lib/julia -Wl,--export-dynamic -Wl,-rpath-link,/home/ian/Downloads/julia-c18909d655/lib -Wl,-rpath-link,/home/ian/Downloads/julia-c18909d655/lib/julia -ljulia -ljulia-internal`
└ @ PackageCompiler ~/Documents/GitHub/PackageCompiler.jl/src/PackageCompiler.jl:193
┌ Debug: running `gcc '-DJULIA_MAIN="MyApp.erroring"' -DNEW_DEFINE_FAST_TLS_SYNTAX -m64 -march=x86-64 -o /tmp/jl_14yokA/MyAppCompiled/bin/Error /home/ian/Documents/GitHub/PackageCompiler.jl/src/embedding_wrapper.c -O2 '-Wl,-rpath,$ORIGIN/../lib:$ORIGIN/../lib/julia' -std=gnu99 -I/home/ian/Downloads/julia-c18909d655/include/julia -fPIC -L/home/ian/Downloads/julia-c18909d655/lib -L/home/ian/Downloads/julia-c18909d655/lib/julia -Wl,--export-dynamic -Wl,-rpath-link,/home/ian/Downloads/julia-c18909d655/lib -Wl,-rpath-link,/home/ian/Downloads/julia-c18909d655/lib/julia -ljulia -ljulia-internal`
└ @ PackageCompiler ~/Documents/GitHub/PackageCompiler.jl/src/PackageCompiler.jl:193
┌ Debug: running `gcc '-DJULIA_MAIN="MyApp.undefined"' -DNEW_DEFINE_FAST_TLS_SYNTAX -m64 -march=x86-64 -o /tmp/jl_14yokA/MyAppCompiled/bin/Undefined /home/ian/Documents/GitHub/PackageCompiler.jl/src/embedding_wrapper.c -O2 '-Wl,-rpath,$ORIGIN/../lib:$ORIGIN/../lib/julia' -std=gnu99 -I/home/ian/Downloads/julia-c18909d655/include/julia -fPIC -L/home/ian/Downloads/julia-c18909d655/lib -L/home/ian/Downloads/julia-c18909d655/lib/julia -Wl,--export-dynamic -Wl,-rpath-link,/home/ian/Downloads/julia-c18909d655/lib -Wl,-rpath-link,/home/ian/Downloads/julia-c18909d655/lib/julia -ljulia -ljulia-internal`
└ @ PackageCompiler ~/Documents/GitHub/PackageCompiler.jl/src/PackageCompiler.jl:193
┌ Info: done: create_app testset
│   incremental = false
└   filter = false
[ Warning: PackageCompiler: This does not look like an official Julia build, functionality may suffer.
┌ Debug: instantiating project at "/tmp/jl_14yokA/MyLib"
└ @ PackageCompiler ~/Documents/GitHub/PackageCompiler.jl/src/PackageCompiler.jl:514
┌ Debug: running `/home/ian/Downloads/julia-c18909d655/bin/julia --color=yes --startup-file=no --pkgimages=no --output-ji /tmp/jl_fV3mNZ/corecompiler.ji -g0 -O0 /home/ian/Downloads/julia-c18909d655/share/julia/base/compiler/compiler.jl`
│   JULIA_CPU_TARGET = "generic;sandybridge,-xsaveopt,clone_all;haswell,-rdrnd,base(1)"
└ @ PackageCompiler ~/Documents/GitHub/PackageCompiler.jl/src/PackageCompiler.jl:231
⣄ [01m:19s] PackageCompiler: compiling base system image (incremental=false)┌ Debug: running `/home/ian/Downloads/julia-c18909d655/bin/julia --color=yes --startup-file=no --pkgimages=no --sysimage=/tmp/jl_fV3mNZ/corecompiler.ji -g1 -O0 --output-ji=/tmp/jl_fV3mNZ/sys.ji /tmp/jl_fV3mNZ/sysimage_packagecompiler_6c058678-a253-11ed-0e79-f99d04dfed7f.jl`
│   JULIA_CPU_TARGET = "generic;sandybridge,-xsaveopt,clone_all;haswell,-rdrnd,base(1)"
└ @ PackageCompiler ~/Documents/GitHub/PackageCompiler.jl/src/PackageCompiler.jl:250
✔ [01m:57s] PackageCompiler: compiling base system image (incremental=false)
┌ Debug: running precompilation execution script...
└ @ PackageCompiler ~/Documents/GitHub/PackageCompiler.jl/src/PackageCompiler.jl:309
┌ Debug: run_precompilation_script: running `/home/ian/Downloads/julia-c18909d655/bin/julia --color=yes --startup-file=no --pkgimages=no --sysimage=/tmp/jl_fV3mNZ/sys.ji --compile=all --trace-compile=/tmp/jl_packagecompiler_f9hxrN/jl_AZXmQl -e ''`
│   JULIA_LOAD_PATH = "/tmp/jl_14yokA/MyLib:@stdlib"
└ @ PackageCompiler ~/Documents/GitHub/PackageCompiler.jl/src/PackageCompiler.jl:287
┌ Debug: running `/home/ian/Downloads/julia-c18909d655/bin/julia --color=yes --startup-file=no --pkgimages=no -O3 --sysimage=/tmp/jl_fV3mNZ/sys.ji --project=/tmp/jl_14yokA/MyLib --output-o=/tmp/jl_S9EpA3Az6h.o /tmp/jl_Ez6T0d6xin`
│   JULIA_CPU_TARGET = "generic;sandybridge,-xsaveopt,clone_all;haswell,-rdrnd,base(1)"
└ @ PackageCompiler ~/Documents/GitHub/PackageCompiler.jl/src/PackageCompiler.jl:408
✔ [01m:15s] PackageCompiler: compiling nonincremental system image
┌ Debug: running `g++ -m64 -march=x86-64 -shared -L/home/ian/Downloads/julia-c18909d655/lib -L/home/ian/Downloads/julia-c18909d655/lib/julia -o /tmp/jl_ADTglJ/tmp_sys.so -Wl,--whole-archive /tmp/jl_S9EpA3Az6h.o -Wl,--no-whole-archive -Wl,-rpath-link,/home/ian/Downloads/julia-c18909d655/lib -Wl,-rpath-link,/home/ian/Downloads/julia-c18909d655/lib/julia -ljulia -ljulia-internal -fPIC -Wl,-soname,tmp_sys.so '-Wl,-rpath,$ORIGIN:$ORIGIN/julia'`
└ @ PackageCompiler ~/Documents/GitHub/PackageCompiler.jl/src/PackageCompiler.jl:193
┌ Debug: instantiating project at "/tmp/jl_14yokA/MyLib"
└ @ PackageCompiler ~/Documents/GitHub/PackageCompiler.jl/src/PackageCompiler.jl:514
┌ Debug: ensurecompiled: running `/home/ian/Downloads/julia-c18909d655/bin/julia --color=yes --startup-file=no --pkgimages=no --sysimage=/tmp/jl_ADTglJ/tmp_sys.so -e 'using Pkg; Pkg.precompile()'`
│   JULIA_LOAD_PATH = "/tmp/jl_14yokA/MyLib:@stdlib"
└ @ PackageCompiler ~/Documents/GitHub/PackageCompiler.jl/src/PackageCompiler.jl:274
Precompiling environment...
  1 dependency successfully precompiled in 2 seconds
┌ Debug: running precompilation execution script...
└ @ PackageCompiler ~/Documents/GitHub/PackageCompiler.jl/src/PackageCompiler.jl:309
┌ Debug: run_precompilation_script: running `/home/ian/Downloads/julia-c18909d655/bin/julia --color=yes --startup-file=no --pkgimages=no --sysimage=/tmp/jl_ADTglJ/tmp_sys.so --compile=all --trace-compile=/tmp/jl_packagecompiler_k44oZS/jl_ccPXFQ /home/ian/Documents/GitHub/PackageCompiler.jl/test/../examples/MyLib/build/generate_precompile.jl`
│   JULIA_LOAD_PATH = "/tmp/jl_14yokA/MyLib:@stdlib"
└ @ PackageCompiler ~/Documents/GitHub/PackageCompiler.jl/src/PackageCompiler.jl:287
[ Info: PackageCompiler: Executing /home/ian/Documents/GitHub/PackageCompiler.jl/examples/MyLib/build/generate_precompile.jl => /tmp/jl_packagecompiler_k44oZS/jl_ccPXFQ
Incremented count: 1 (Cint)
Incremented count: 2 (Cint)
Incremented count: 3 (Cint)
Incremented count: 4 (Cint)
Incremented count: 5 (Cint)
Incremented count: 6 (Cint)
Incremented count: 7 (Cint)
Incremented count: 8 (Cint)
Incremented count: 9 (Cint)
Incremented count: 10 (Cint)
[ Info: PackageCompiler: Done
┌ Debug: running `/home/ian/Downloads/julia-c18909d655/bin/julia --color=yes --startup-file=no --pkgimages=no -O3 --sysimage=/tmp/jl_ADTglJ/tmp_sys.so --project=/tmp/jl_14yokA/MyLib --output-o=/tmp/jl_UnihyPqF0p.o /tmp/jl_S1WRu98XoP`
│   JULIA_CPU_TARGET = "generic;sandybridge,-xsaveopt,clone_all;haswell,-rdrnd,base(1)"
└ @ PackageCompiler ~/Documents/GitHub/PackageCompiler.jl/src/PackageCompiler.jl:408
✔ [01m:03s] PackageCompiler: compiling incremental system image
┌ Debug: Compiling /home/ian/Documents/GitHub/PackageCompiler.jl/src/julia_init.c
└ @ PackageCompiler ~/Documents/GitHub/PackageCompiler.jl/src/PackageCompiler.jl:646
┌ Debug: running `gcc -c -O2 '-DJULIAC_PROGRAM_LIBNAME="libinc.so.1.0.0"' -DNEW_DEFINE_FAST_TLS_SYNTAX -m64 -std=gnu99 -I/home/ian/Downloads/julia-c18909d655/include/julia -fPIC -march=x86-64 -o /home/ian/Documents/GitHub/PackageCompiler.jl/src/julia_init.o /home/ian/Documents/GitHub/PackageCompiler.jl/src/julia_init.c`
└ @ PackageCompiler ~/Documents/GitHub/PackageCompiler.jl/src/PackageCompiler.jl:193
┌ Debug: running `g++ -m64 -march=x86-64 -shared -L/home/ian/Downloads/julia-c18909d655/lib -L/home/ian/Downloads/julia-c18909d655/lib/julia -o /tmp/jl_14yokA/MyLibCompiled/lib/libinc.so.1.0.0 -Wl,--whole-archive /tmp/jl_UnihyPqF0p.o /home/ian/Documents/GitHub/PackageCompiler.jl/src/julia_init.o -Wl,--no-whole-archive -Wl,-rpath-link,/home/ian/Downloads/julia-c18909d655/lib -Wl,-rpath-link,/home/ian/Downloads/julia-c18909d655/lib/julia -ljulia -ljulia-internal -fPIC -Wl,-soname,libinc.so.1 '-Wl,-rpath,$ORIGIN:$ORIGIN/julia'`
└ @ PackageCompiler ~/Documents/GitHub/PackageCompiler.jl/src/PackageCompiler.jl:193
┌ Debug: creating symlinks for libinc.so.1 and libinc.so
└ @ PackageCompiler ~/Documents/GitHub/PackageCompiler.jl/src/PackageCompiler.jl:978
┌ Debug: instantiating project at "/tmp/jl_O49Lfz"
└ @ PackageCompiler ~/Documents/GitHub/PackageCompiler.jl/src/PackageCompiler.jl:514
┌ Debug: running `/home/ian/Downloads/julia-c18909d655/bin/julia --color=yes --startup-file=no --pkgimages=no --output-ji /tmp/jl_635xlv/corecompiler.ji -g0 -O0 /home/ian/Downloads/julia-c18909d655/share/julia/base/compiler/compiler.jl`
│   JULIA_CPU_TARGET = "native"
└ @ PackageCompiler ~/Documents/GitHub/PackageCompiler.jl/src/PackageCompiler.jl:231
⠋ [01m:20s] PackageCompiler: compiling base system image (incremental=false)┌ Debug: running `/home/ian/Downloads/julia-c18909d655/bin/julia --color=yes --startup-file=no --pkgimages=no --sysimage=/tmp/jl_635xlv/corecompiler.ji -g1 -O0 --output-ji=/tmp/jl_635xlv/sys.ji /tmp/jl_635xlv/sysimage_packagecompiler_3ef18280-a254-11ed-3e18-a5dc865a410e.jl`
│   JULIA_CPU_TARGET = "native"
└ @ PackageCompiler ~/Documents/GitHub/PackageCompiler.jl/src/PackageCompiler.jl:250
✔ [01m:59s] PackageCompiler: compiling base system image (incremental=false)
┌ Debug: running precompilation execution script...
└ @ PackageCompiler ~/Documents/GitHub/PackageCompiler.jl/src/PackageCompiler.jl:309
┌ Debug: run_precompilation_script: running `/home/ian/Downloads/julia-c18909d655/bin/julia --color=yes --startup-file=no --pkgimages=no --sysimage=/tmp/jl_635xlv/sys.ji --compile=all --trace-compile=/tmp/jl_packagecompiler_4YNqLh/jl_koVRAZ -e ''`
│   JULIA_LOAD_PATH = "/tmp/jl_O49Lfz:@stdlib"
└ @ PackageCompiler ~/Documents/GitHub/PackageCompiler.jl/src/PackageCompiler.jl:287
┌ Debug: running `/home/ian/Downloads/julia-c18909d655/bin/julia --color=yes --startup-file=no --pkgimages=no -O3 --sysimage=/tmp/jl_635xlv/sys.ji --project=/tmp/jl_O49Lfz --output-o=/tmp/jl_OhW1enajiH.o /tmp/jl_CrKrGVa54r`
│   JULIA_CPU_TARGET = "native"
└ @ PackageCompiler ~/Documents/GitHub/PackageCompiler.jl/src/PackageCompiler.jl:408
✔ [01m:15s] PackageCompiler: compiling nonincremental system image
┌ Debug: running `g++ -m64 -march=x86-64 -shared -L/home/ian/Downloads/julia-c18909d655/lib -L/home/ian/Downloads/julia-c18909d655/lib/julia -o /tmp/jl_O49Lfz/empty.so -Wl,--whole-archive /tmp/jl_OhW1enajiH.o -Wl,--no-whole-archive -Wl,-rpath-link,/home/ian/Downloads/julia-c18909d655/lib -Wl,-rpath-link,/home/ian/Downloads/julia-c18909d655/lib/julia -ljulia -ljulia-internal -fPIC -Wl,-soname,empty.so '-Wl,-rpath,$ORIGIN:$ORIGIN/julia'`
└ @ PackageCompiler ~/Documents/GitHub/PackageCompiler.jl/src/PackageCompiler.jl:193
Test Summary:      | Pass  Total      Time
PackageCompiler.jl |   85     85  33m38.9s
     Testing PackageCompiler tests passed

image
@IanButterworth
Copy link
Sponsor Member Author

This is so weird. The precompile subprocesses are multithreading
image

just before this there were 5 of them each using ~300-400%

@IanButterworth
Copy link
Sponsor Member Author

IanButterworth commented Feb 2, 2023 •
edited

The issue is happening within

/home/ian/Downloads/julia-c18909d655/bin/julia --color=yes --startup-file=no --pkgimages=no --sysimage=/tmp/jl_l9FFXE/sys.ji -e 'using Pkg; Pkg.precompile()'

If I send a SIGUSR1 to one of the precompile processes while it's using >1000% I get

Precompiling environment...
  ✗ Example
  ✗ Zlib_jll
  9 dependencies successfully precompiled in 149 seconds

ERROR: The following 1 direct dependency failed to precompile:

Example [7876af07-990d-54b4-ab0e-23690620f79a]

Failed to precompile Example [7876af07-990d-54b4-ab0e-23690620f79a] to "/tmp/jl_scudK3/compiled/v1.10/Example/jl_1ZrjbG".

======================================================================================
Information request received. A stacktrace will print followed by a 1.0 second profile
======================================================================================

cmd: /home/ian/Downloads/julia-c18909d655/bin/julia 165538 running 16 of 16

signal (10): User defined signal 1
_jl_mutex_wait at /cache/build/default-amdci4-2/julialang/julia-master/src/threading.c:743
_jl_mutex_lock at /cache/build/default-amdci4-2/julialang/julia-master/src/threading.c:781
jl_mutex_lock at /cache/build/default-amdci4-2/julialang/julia-master/src/julia_locks.h:66 [inlined]
jl_generate_fptr_impl at /cache/build/default-amdci4-2/julialang/julia-master/src/jitlayers.cpp:411
jl_compile_method_internal at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2287 [inlined]
jl_compile_method_internal at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2205
_jl_invoke at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2683 [inlined]
ijl_apply_generic at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2873
jl_apply at /cache/build/default-amdci4-2/julialang/julia-master/src/julia.h:1880 [inlined]
jl_finish_task at /cache/build/default-amdci4-2/julialang/julia-master/src/task.c:320
jl_threadfun at /cache/build/default-amdci4-2/julialang/julia-master/src/partr.c:132
unknown function (ip: 0x7f851f890401)
unknown function (ip: 0x7f851f91f58f)
unknown function (ip: (nil))
_jl_mutex_wait at /cache/build/default-amdci4-2/julialang/julia-master/src/threading.c:753
_jl_mutex_lock at /cache/build/default-amdci4-2/julialang/julia-master/src/threading.c:781
jl_mutex_lock at /cache/build/default-amdci4-2/julialang/julia-master/src/julia_locks.h:66 [inlined]
jl_generate_fptr_impl at /cache/build/default-amdci4-2/julialang/julia-master/src/jitlayers.cpp:411
jl_compile_method_internal at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2287 [inlined]
jl_compile_method_internal at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2205
_jl_invoke at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2683 [inlined]
ijl_apply_generic at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2873
jl_apply at /cache/build/default-amdci4-2/julialang/julia-master/src/julia.h:1880 [inlined]
jl_finish_task at /cache/build/default-amdci4-2/julialang/julia-master/src/task.c:320
jl_threadfun at /cache/build/default-amdci4-2/julialang/julia-master/src/partr.c:132
unknown function (ip: 0x7f851f890401)
unknown function (ip: 0x7f851f91f58f)
unknown function (ip: (nil))
_jl_mutex_wait at /cache/build/default-amdci4-2/julialang/julia-master/src/threading.c:753
_jl_mutex_lock at /cache/build/default-amdci4-2/julialang/julia-master/src/threading.c:781
jl_mutex_lock at /cache/build/default-amdci4-2/julialang/julia-master/src/julia_locks.h:66 [inlined]
jl_generate_fptr_impl at /cache/build/default-amdci4-2/julialang/julia-master/src/jitlayers.cpp:411
jl_compile_method_internal at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2287 [inlined]
jl_compile_method_internal at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2205
_jl_invoke at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2683 [inlined]
ijl_apply_generic at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2873
jl_apply at /cache/build/default-amdci4-2/julialang/julia-master/src/julia.h:1880 [inlined]
jl_finish_task at /cache/build/default-amdci4-2/julialang/julia-master/src/task.c:320
jl_threadfun at /cache/build/default-amdci4-2/julialang/julia-master/src/partr.c:132
unknown function (ip: 0x7f851f890401)
unknown function (ip: 0x7f851f91f58f)
unknown function (ip: (nil))
_jl_mutex_wait at /cache/build/default-amdci4-2/julialang/julia-master/src/threading.c:753
_jl_mutex_lock at /cache/build/default-amdci4-2/julialang/julia-master/src/threading.c:781
jl_mutex_lock at /cache/build/default-amdci4-2/julialang/julia-master/src/julia_locks.h:66 [inlined]
jl_generate_fptr_impl at /cache/build/default-amdci4-2/julialang/julia-master/src/jitlayers.cpp:411
jl_compile_method_internal at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2287 [inlined]
jl_compile_method_internal at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2205
_jl_invoke at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2683 [inlined]
ijl_apply_generic at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2873
jl_apply at /cache/build/default-amdci4-2/julialang/julia-master/src/julia.h:1880 [inlined]
jl_finish_task at /cache/build/default-amdci4-2/julialang/julia-master/src/task.c:320
jl_threadfun at /cache/build/default-amdci4-2/julialang/julia-master/src/partr.c:132
unknown function (ip: 0x7f851f890401)
unknown function (ip: 0x7f851f91f58f)
unknown function (ip: (nil))
_jl_mutex_wait at /cache/build/default-amdci4-2/julialang/julia-master/src/threading.c:753
_jl_mutex_lock at /cache/build/default-amdci4-2/julialang/julia-master/src/threading.c:781
jl_mutex_lock at /cache/build/default-amdci4-2/julialang/julia-master/src/julia_locks.h:66 [inlined]
jl_generate_fptr_impl at /cache/build/default-amdci4-2/julialang/julia-master/src/jitlayers.cpp:411
jl_compile_method_internal at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2287 [inlined]
jl_compile_method_internal at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2205
_jl_invoke at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2683 [inlined]
ijl_apply_generic at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2873
jl_apply at /cache/build/default-amdci4-2/julialang/julia-master/src/julia.h:1880 [inlined]
jl_finish_task at /cache/build/default-amdci4-2/julialang/julia-master/src/task.c:320
jl_threadfun at /cache/build/default-amdci4-2/julialang/julia-master/src/partr.c:132
unknown function (ip: 0x7f851f890401)
unknown function (ip: 0x7f851f91f58f)
unknown function (ip: (nil))
_jl_mutex_wait at /cache/build/default-amdci4-2/julialang/julia-master/src/threading.c:753
_jl_mutex_lock at /cache/build/default-amdci4-2/julialang/julia-master/src/threading.c:781
jl_mutex_lock at /cache/build/default-amdci4-2/julialang/julia-master/src/julia_locks.h:66 [inlined]
jl_generate_fptr_impl at /cache/build/default-amdci4-2/julialang/julia-master/src/jitlayers.cpp:411
jl_compile_method_internal at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2287 [inlined]
jl_compile_method_internal at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2205
_jl_invoke at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2683 [inlined]
ijl_apply_generic at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2873
jl_apply at /cache/build/default-amdci4-2/julialang/julia-master/src/julia.h:1880 [inlined]
jl_finish_task at /cache/build/default-amdci4-2/julialang/julia-master/src/task.c:320
jl_threadfun at /cache/build/default-amdci4-2/julialang/julia-master/src/partr.c:132
unknown function (ip: 0x7f851f890401)
unknown function (ip: 0x7f851f91f58f)
unknown function (ip: (nil))
_jl_mutex_wait at /cache/build/default-amdci4-2/julialang/julia-master/src/threading.c:745
_jl_mutex_lock at /cache/build/default-amdci4-2/julialang/julia-master/src/threading.c:781
jl_mutex_lock at /cache/build/default-amdci4-2/julialang/julia-master/src/julia_locks.h:66 [inlined]
jl_generate_fptr_impl at /cache/build/default-amdci4-2/julialang/julia-master/src/jitlayers.cpp:411
jl_compile_method_internal at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2287 [inlined]
jl_compile_method_internal at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2205
_jl_invoke at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2683 [inlined]
ijl_apply_generic at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2873
jl_apply at /cache/build/default-amdci4-2/julialang/julia-master/src/julia.h:1880 [inlined]
jl_finish_task at /cache/build/default-amdci4-2/julialang/julia-master/src/task.c:320
jl_threadfun at /cache/build/default-amdci4-2/julialang/julia-master/src/partr.c:132
unknown function (ip: 0x7f851f890401)
unknown function (ip: 0x7f851f91f58f)
unknown function (ip: (nil))
_jl_mutex_wait at /cache/build/default-amdci4-2/julialang/julia-master/src/threading.c:753
_jl_mutex_lock at /cache/build/default-amdci4-2/julialang/julia-master/src/threading.c:781
jl_mutex_lock at /cache/build/default-amdci4-2/julialang/julia-master/src/julia_locks.h:66 [inlined]
jl_generate_fptr_impl at /cache/build/default-amdci4-2/julialang/julia-master/src/jitlayers.cpp:411
jl_compile_method_internal at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2287 [inlined]
jl_compile_method_internal at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2205
_jl_invoke at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2683 [inlined]
ijl_apply_generic at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2873
jl_apply at /cache/build/default-amdci4-2/julialang/julia-master/src/julia.h:1880 [inlined]
jl_finish_task at /cache/build/default-amdci4-2/julialang/julia-master/src/task.c:320
jl_threadfun at /cache/build/default-amdci4-2/julialang/julia-master/src/partr.c:132
unknown function (ip: 0x7f851f890401)
unknown function (ip: 0x7f851f91f58f)
unknown function (ip: (nil))
_jl_mutex_wait at /cache/build/default-amdci4-2/julialang/julia-master/src/threading.c:753
_jl_mutex_lock at /cache/build/default-amdci4-2/julialang/julia-master/src/threading.c:781
jl_mutex_lock at /cache/build/default-amdci4-2/julialang/julia-master/src/julia_locks.h:66 [inlined]
jl_generate_fptr_impl at /cache/build/default-amdci4-2/julialang/julia-master/src/jitlayers.cpp:411
jl_compile_method_internal at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2287 [inlined]
jl_compile_method_internal at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2205
_jl_invoke at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2683 [inlined]
ijl_apply_generic at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2873
jl_apply at /cache/build/default-amdci4-2/julialang/julia-master/src/julia.h:1880 [inlined]
jl_finish_task at /cache/build/default-amdci4-2/julialang/julia-master/src/task.c:320
jl_threadfun at /cache/build/default-amdci4-2/julialang/julia-master/src/partr.c:132
unknown function (ip: 0x7f851f890401)
unknown function (ip: 0x7f851f91f58f)
unknown function (ip: (nil))
unknown function (ip: 0x7f851f88c8b5)
__pthread_rwlock_wrlock at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)
uv_rwlock_wrlock at /workspace/srcdir/libuv/src/unix/thread.c:497
jl_profile_atomic<JITDebugInfoRegistry::registerJITObject(const llvm::object::ObjectFile&, std::function<long unsigned int(const llvm::StringRef&)>, std::function<void*(void*)>)::<lambda()> > at /cache/build/default-amdci4-2/julialang/julia-master/src/debuginfo.cpp:148 [inlined]
registerJITObject at /cache/build/default-amdci4-2/julialang/julia-master/src/debuginfo.cpp:375
jl_register_jit_object at /cache/build/default-amdci4-2/julialang/julia-master/src/debuginfo.cpp:395
registerRTDyldJITObject at /cache/build/default-amdci4-2/julialang/julia-master/src/jitlayers.cpp:934
_ZN4llvm3orc24RTDyldObjectLinkingLayer9onObjLoadERNS0_29MaterializationResponsibilityERKNS_6object10ObjectFileERNS_11RuntimeDyld13MemoryManagerERNS8_16LoadedObjectInfoESt3mapINS_9StringRefENS_18JITEvaluatedSymbolESt4lessISE_ESaISt4pairIKSE_SF_EEERSt3setISE_SH_SaISE_EE at /home/ian/Downloads/julia-c18909d655/bin/../lib/julia/libLLVM-14jl.so (unknown line)
_ZN4llvm6detail18UniqueFunctionBaseINS_5ErrorEJRKNS_6object10ObjectFileERNS_11RuntimeDyld16LoadedObjectInfoESt3mapINS_9StringRefENS_18JITEvaluatedSymbolESt4lessISB_ESaISt4pairIKSB_SC_EEEEE8CallImplIZNS_3orc24RTDyldObjectLinkingLayer4emitESt10unique_ptrINSM_29MaterializationResponsibilityESt14default_deleteISP_EESO_INS_12MemoryBufferESQ_IST_EEEUlS6_S9_SJ_E_EES2_PvS6_S9_RSJ_ at /home/ian/Downloads/julia-c18909d655/bin/../lib/julia/libLLVM-14jl.so (unknown line)
_ZN4llvm13jitLinkForORCENS_6object12OwningBinaryINS0_10ObjectFileEEERNS_11RuntimeDyld13MemoryManagerERNS_17JITSymbolResolverEbNS_15unique_functionIFNS_5ErrorERKS2_RNS4_16LoadedObjectInfoESt3mapINS_9StringRefENS_18JITEvaluatedSymbolESt4lessISG_ESaISt4pairIKSG_SH_EEEEEENS9_IFvS3_St10unique_ptrISD_St14default_deleteISD_EESA_EEE at /home/ian/Downloads/julia-c18909d655/bin/../lib/julia/libLLVM-14jl.so (unknown line)
_ZN4llvm3orc24RTDyldObjectLinkingLayer4emitESt10unique_ptrINS0_29MaterializationResponsibilityESt14default_deleteIS3_EES2_INS_12MemoryBufferES4_IS7_EE at /home/ian/Downloads/julia-c18909d655/bin/../lib/julia/libLLVM-14jl.so (unknown line)
emit at /cache/build/default-amdci4-2/julialang/julia-master/src/jitlayers.h:300
_ZN4llvm3orc14IRCompileLayer4emitESt10unique_ptrINS0_29MaterializationResponsibilityESt14default_deleteIS3_EENS0_16ThreadSafeModuleE at /home/ian/Downloads/julia-c18909d655/bin/../lib/julia/libLLVM-14jl.so (unknown line)
_ZN4llvm3orc16IRTransformLayer4emitESt10unique_ptrINS0_29MaterializationResponsibilityESt14default_deleteIS3_EENS0_16ThreadSafeModuleE at /home/ian/Downloads/julia-c18909d655/bin/../lib/julia/libLLVM-14jl.so (unknown line)
emit at /cache/build/default-amdci4-2/julialang/julia-master/src/jitlayers.cpp:619
_ZN4llvm3orc31BasicIRLayerMaterializationUnit11materializeESt10unique_ptrINS0_29MaterializationResponsibilityESt14default_deleteIS3_EE at /home/ian/Downloads/julia-c18909d655/bin/../lib/julia/libLLVM-14jl.so (unknown line)
_ZN4llvm3orc19MaterializationTask3runEv at /home/ian/Downloads/julia-c18909d655/bin/../lib/julia/libLLVM-14jl.so (unknown line)
_ZN4llvm6detail18UniqueFunctionBaseIvJSt10unique_ptrINS_3orc4TaskESt14default_deleteIS4_EEEE8CallImplIPFvS7_EEEvPvRS7_ at /home/ian/Downloads/julia-c18909d655/bin/../lib/julia/libLLVM-14jl.so (unknown line)
_ZN4llvm3orc16ExecutionSession22dispatchOutstandingMUsEv at /home/ian/Downloads/julia-c18909d655/bin/../lib/julia/libLLVM-14jl.so (unknown line)
_ZN4llvm3orc16ExecutionSession17OL_completeLookupESt10unique_ptrINS0_21InProgressLookupStateESt14default_deleteIS3_EESt10shared_ptrINS0_23AsynchronousSymbolQueryEESt8functionIFvRKNS_8DenseMapIPNS0_8JITDylibENS_8DenseSetINS0_15SymbolStringPtrENS_12DenseMapInfoISF_vEEEENSG_ISD_vEENS_6detail12DenseMapPairISD_SI_EEEEEE at /home/ian/Downloads/julia-c18909d655/bin/../lib/julia/libLLVM-14jl.so (unknown line)
_ZN4llvm3orc25InProgressFullLookupState8completeESt10unique_ptrINS0_21InProgressLookupStateESt14default_deleteIS3_EE at /home/ian/Downloads/julia-c18909d655/bin/../lib/julia/libLLVM-14jl.so (unknown line)
_ZN4llvm3orc16ExecutionSession19OL_applyQueryPhase1ESt10unique_ptrINS0_21InProgressLookupStateESt14default_deleteIS3_EENS_5ErrorE at /home/ian/Downloads/julia-c18909d655/bin/../lib/julia/libLLVM-14jl.so (unknown line)
_ZN4llvm3orc16ExecutionSession6lookupENS0_10LookupKindERKSt6vectorISt4pairIPNS0_8JITDylibENS0_19JITDylibLookupFlagsEESaIS8_EENS0_15SymbolLookupSetENS0_11SymbolStateENS_15unique_functionIFvNS_8ExpectedINS_8DenseMapINS0_15SymbolStringPtrENS_18JITEvaluatedSymbolENS_12DenseMapInfoISI_vEENS_6detail12DenseMapPairISI_SJ_EEEEEEEEESt8functionIFvRKNSH_IS6_NS_8DenseSetISI_SL_EENSK_IS6_vEENSN_IS6_SV_EEEEEE at /home/ian/Downloads/julia-c18909d655/bin/../lib/julia/libLLVM-14jl.so (unknown line)
_ZN4llvm3orc16ExecutionSession6lookupERKSt6vectorISt4pairIPNS0_8JITDylibENS0_19JITDylibLookupFlagsEESaIS7_EERKNS0_15SymbolLookupSetENS0_10LookupKindENS0_11SymbolStateESt8functionIFvRKNS_8DenseMapIS5_NS_8DenseSetINS0_15SymbolStringPtrENS_12DenseMapInfoISK_vEEEENSL_IS5_vEENS_6detail12DenseMapPairIS5_SN_EEEEEE at /home/ian/Downloads/julia-c18909d655/bin/../lib/julia/libLLVM-14jl.so (unknown line)
addModule at /cache/build/default-amdci4-2/julialang/julia-master/src/jitlayers.cpp:1401
jl_add_to_ee at /cache/build/default-amdci4-2/julialang/julia-master/src/jitlayers.cpp:1798
_jl_compile_codeinst at /cache/build/default-amdci4-2/julialang/julia-master/src/jitlayers.cpp:241
jl_generate_fptr_impl at /cache/build/default-amdci4-2/julialang/julia-master/src/jitlayers.cpp:447
jl_compile_method_internal at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2287 [inlined]
jl_compile_method_internal at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2205
_jl_invoke at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2683 [inlined]
ijl_apply_generic at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2873
typesubtract at ./compiler/typeutils.jl:154
_jl_invoke at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2691 [inlined]
ijl_apply_generic at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2873
typesubtract at ./compiler/typeutils.jl:160
unknown function (ip: 0x7f84bfa08d49)
unknown function (ip: 0x7f84bfa08d12)
isa_condition at ./compiler/abstractinterpretation.jl:1671 [inlined]
isa_condition at ./compiler/abstractinterpretation.jl:1657
unknown function (ip: 0x7f84bfa08c34)
_jl_invoke at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2691 [inlined]
ijl_apply_generic at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2873
abstract_call_builtin at ./compiler/abstractinterpretation.jl:1751
_jl_invoke at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2691 [inlined]
ijl_apply_generic at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2873
abstract_call_known at ./compiler/abstractinterpretation.jl:1979
_jl_invoke at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2691 [inlined]
ijl_apply_generic at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2873
abstract_call at ./compiler/abstractinterpretation.jl:2136
unknown function (ip: 0x7f84c40abb59)
unknown function (ip: 0x7f84c40ababb)
abstract_call at ./compiler/abstractinterpretation.jl:2110
unknown function (ip: 0x7f84c40ab88a)
_jl_invoke at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2691 [inlined]
ijl_apply_generic at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2873
abstract_eval_statement_expr at ./compiler/abstractinterpretation.jl:2282
_jl_invoke at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2691 [inlined]
ijl_apply_generic at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2873
abstract_eval_statement at ./compiler/abstractinterpretation.jl:2534
unknown function (ip: 0x7f84c409a999)
unknown function (ip: 0x7f84c409a93e)
abstract_eval_basic_statement at ./compiler/abstractinterpretation.jl:2825
unknown function (ip: 0x7f84c409a7d6)
_jl_invoke at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2691 [inlined]
ijl_apply_generic at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2873
typeinf_local at ./compiler/abstractinterpretation.jl:3001
_jl_invoke at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2691 [inlined]
ijl_apply_generic at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2873
typeinf_nocycle at ./compiler/abstractinterpretation.jl:3089
_jl_invoke at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2691 [inlined]
ijl_apply_generic at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2873
_typeinf at ./compiler/typeinfer.jl:244
_jl_invoke at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2691 [inlined]
ijl_apply_generic at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2873
typeinf at ./compiler/typeinfer.jl:215
_jl_invoke at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2691 [inlined]
ijl_apply_generic at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2873
typeinf_ext at ./compiler/typeinfer.jl:1050
unknown function (ip: 0x7f84bfbfee49)
unknown function (ip: 0x7f84bfbfe8dc)
typeinf_ext_toplevel at ./compiler/typeinfer.jl:1083
unknown function (ip: 0x7f84bfbfe7e6)
unknown function (ip: 0x7f84c405f5a9)
unknown function (ip: 0x7f84c405f57c)
typeinf_ext_toplevel at ./compiler/typeinfer.jl:1079
unknown function (ip: 0x7f84c405f239)
_jl_invoke at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2691 [inlined]
ijl_apply_generic at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2873
jl_apply at /cache/build/default-amdci4-2/julialang/julia-master/src/julia.h:1880 [inlined]
jl_type_infer at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:317
jl_generate_fptr_impl at /cache/build/default-amdci4-2/julialang/julia-master/src/jitlayers.cpp:431
jl_compile_method_internal at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2287 [inlined]
jl_compile_method_internal at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2205
_jl_invoke at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2683 [inlined]
ijl_invoke at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2698
unknown function (ip: 0x7f84bfbfee49)
unknown function (ip: 0x7f84bfbfe8dc)
typeinf_ext_toplevel at ./compiler/typeinfer.jl:1083
unknown function (ip: 0x7f84bfbfe7e6)
unknown function (ip: 0x7f84c405f5a9)
unknown function (ip: 0x7f84c405f57c)
typeinf_ext_toplevel at ./compiler/typeinfer.jl:1079
unknown function (ip: 0x7f84c405f239)
_jl_invoke at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2691 [inlined]
ijl_apply_generic at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2873
jl_apply at /cache/build/default-amdci4-2/julialang/julia-master/src/julia.h:1880 [inlined]
jl_type_infer at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:317
jl_generate_fptr_impl at /cache/build/default-amdci4-2/julialang/julia-master/src/jitlayers.cpp:431
jl_compile_method_internal at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2287 [inlined]
jl_compile_method_internal at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2205
_jl_invoke at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2683 [inlined]
ijl_invoke at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2698
unknown function (ip: 0x7f84c405f5c9)
unknown function (ip: 0x7f84c405f3df)
NativeInterpreter at ./compiler/types.jl:313 [inlined]
typeinf_ext_toplevel at ./compiler/typeinfer.jl:1079
unknown function (ip: 0x7f84c405f239)
_jl_invoke at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2691 [inlined]
ijl_apply_generic at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2873
jl_apply at /cache/build/default-amdci4-2/julialang/julia-master/src/julia.h:1880 [inlined]
jl_type_infer at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:317
jl_generate_fptr_impl at /cache/build/default-amdci4-2/julialang/julia-master/src/jitlayers.cpp:431
jl_compile_method_internal at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2287 [inlined]
jl_compile_method_internal at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2205
_jl_invoke at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2683 [inlined]
ijl_apply_generic at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2873
jl_apply at /cache/build/default-amdci4-2/julialang/julia-master/src/julia.h:1880 [inlined]
jl_finish_task at /cache/build/default-amdci4-2/julialang/julia-master/src/task.c:320
jl_threadfun at /cache/build/default-amdci4-2/julialang/julia-master/src/partr.c:132
unknown function (ip: 0x7f851f890401)
unknown function (ip: 0x7f851f91f58f)
unknown function (ip: (nil))
_jl_mutex_wait at /cache/build/default-amdci4-2/julialang/julia-master/src/threading.c:753
_jl_mutex_lock at /cache/build/default-amdci4-2/julialang/julia-master/src/threading.c:781
jl_mutex_lock at /cache/build/default-amdci4-2/julialang/julia-master/src/julia_locks.h:66 [inlined]
jl_generate_fptr_impl at /cache/build/default-amdci4-2/julialang/julia-master/src/jitlayers.cpp:411
jl_compile_method_internal at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2287 [inlined]
jl_compile_method_internal at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2205
_jl_invoke at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2683 [inlined]
ijl_apply_generic at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2873
jl_apply at /cache/build/default-amdci4-2/julialang/julia-master/src/julia.h:1880 [inlined]
jl_finish_task at /cache/build/default-amdci4-2/julialang/julia-master/src/task.c:320
jl_threadfun at /cache/build/default-amdci4-2/julialang/julia-master/src/partr.c:132
unknown function (ip: 0x7f851f890401)
unknown function (ip: 0x7f851f91f58f)
unknown function (ip: (nil))
_jl_mutex_wait at /cache/build/default-amdci4-2/julialang/julia-master/src/threading.c:753
_jl_mutex_lock at /cache/build/default-amdci4-2/julialang/julia-master/src/threading.c:781
jl_mutex_lock at /cache/build/default-amdci4-2/julialang/julia-master/src/julia_locks.h:66 [inlined]
jl_generate_fptr_impl at /cache/build/default-amdci4-2/julialang/julia-master/src/jitlayers.cpp:411
jl_compile_method_internal at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2287 [inlined]
jl_compile_method_internal at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2205
_jl_invoke at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2683 [inlined]
ijl_apply_generic at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2873
jl_apply at /cache/build/default-amdci4-2/julialang/julia-master/src/julia.h:1880 [inlined]
jl_finish_task at /cache/build/default-amdci4-2/julialang/julia-master/src/task.c:320
jl_threadfun at /cache/build/default-amdci4-2/julialang/julia-master/src/partr.c:132
unknown function (ip: 0x7f851f890401)
unknown function (ip: 0x7f851f91f58f)
unknown function (ip: (nil))
_jl_mutex_wait at /cache/build/default-amdci4-2/julialang/julia-master/src/threading.c:753
_jl_mutex_lock at /cache/build/default-amdci4-2/julialang/julia-master/src/threading.c:781
jl_mutex_lock at /cache/build/default-amdci4-2/julialang/julia-master/src/julia_locks.h:66 [inlined]
jl_generate_fptr_impl at /cache/build/default-amdci4-2/julialang/julia-master/src/jitlayers.cpp:411
jl_compile_method_internal at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2287 [inlined]
jl_compile_method_internal at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2205
_jl_invoke at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2683 [inlined]
ijl_apply_generic at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2873
jl_apply at /cache/build/default-amdci4-2/julialang/julia-master/src/julia.h:1880 [inlined]
jl_finish_task at /cache/build/default-amdci4-2/julialang/julia-master/src/task.c:320
jl_threadfun at /cache/build/default-amdci4-2/julialang/julia-master/src/partr.c:132
unknown function (ip: 0x7f851f890401)
unknown function (ip: 0x7f851f91f58f)
unknown function (ip: (nil))
_jl_mutex_wait at /cache/build/default-amdci4-2/julialang/julia-master/src/threading.c:753
_jl_mutex_lock at /cache/build/default-amdci4-2/julialang/julia-master/src/threading.c:781
jl_mutex_lock at /cache/build/default-amdci4-2/julialang/julia-master/src/julia_locks.h:66 [inlined]
jl_generate_fptr_impl at /cache/build/default-amdci4-2/julialang/julia-master/src/jitlayers.cpp:411
jl_compile_method_internal at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2287 [inlined]
jl_compile_method_internal at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2205
_jl_invoke at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2683 [inlined]
ijl_apply_generic at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2873
jl_apply at /cache/build/default-amdci4-2/julialang/julia-master/src/julia.h:1880 [inlined]
jl_finish_task at /cache/build/default-amdci4-2/julialang/julia-master/src/task.c:320
jl_threadfun at /cache/build/default-amdci4-2/julialang/julia-master/src/partr.c:132
unknown function (ip: 0x7f851f890401)
unknown function (ip: 0x7f851f91f58f)
unknown function (ip: (nil))
_jl_mutex_wait at /cache/build/default-amdci4-2/julialang/julia-master/src/threading.c:753
_jl_mutex_lock at /cache/build/default-amdci4-2/julialang/julia-master/src/threading.c:781
jl_mutex_lock at /cache/build/default-amdci4-2/julialang/julia-master/src/julia_locks.h:66 [inlined]
jl_generate_fptr_impl at /cache/build/default-amdci4-2/julialang/julia-master/src/jitlayers.cpp:411
jl_compile_method_internal at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2287 [inlined]
jl_compile_method_internal at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2205
_jl_invoke at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2683 [inlined]
ijl_apply_generic at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2873
jl_apply at /cache/build/default-amdci4-2/julialang/julia-master/src/julia.h:1880 [inlined]
jl_finish_task at /cache/build/default-amdci4-2/julialang/julia-master/src/task.c:320
jl_threadfun at /cache/build/default-amdci4-2/julialang/julia-master/src/partr.c:132
unknown function (ip: 0x7f851f890401)
unknown function (ip: 0x7f851f91f58f)
unknown function (ip: (nil))
_jl_mutex_wait at /cache/build/default-amdci4-2/julialang/julia-master/src/threading.c:743
_jl_mutex_lock at /cache/build/default-amdci4-2/julialang/julia-master/src/threading.c:781
jl_mutex_lock at /cache/build/default-amdci4-2/julialang/julia-master/src/julia_locks.h:66 [inlined]
jl_generate_fptr_impl at /cache/build/default-amdci4-2/julialang/julia-master/src/jitlayers.cpp:411
jl_compile_method_internal at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2287 [inlined]
jl_compile_method_internal at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2205
_jl_invoke at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2683 [inlined]
ijl_apply_generic at /cache/build/default-amdci4-2/julialang/julia-master/src/gf.c:2873
jl_apply at /cache/build/default-amdci4-2/julialang/julia-master/src/julia.h:1880 [inlined]
jl_module_run_initializer at /cache/build/default-amdci4-2/julialang/julia-master/src/toplevel.c:75
_finish_julia_init at /cache/build/default-amdci4-2/julialang/julia-master/src/init.c:868
julia_init at /cache/build/default-amdci4-2/julialang/julia-master/src/init.c:817
jl_repl_entrypoint at /cache/build/default-amdci4-2/julialang/julia-master/src/jlapi.c:711
main at /cache/build/default-amdci4-2/julialang/julia-master/cli/loader_exe.c:58
unknown function (ip: 0x7f851f82350f)
__libc_start_main at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)
unknown function (ip: 0x401098)
unknown function (ip: (nil))

==============================================================
Profile collected. A report will print at the next yield point
==============================================================


[165538] signal (11.1): Segmentation fault
in expression starting at none:0
Allocations: 3013 (Pool: 3003; Big: 10); GC: 0
Stacktrace:
 [1] pkgerror(msg::String)
   @ Pkg.Types ~/Downloads/julia-c18909d655/share/julia/stdlib/v1.10/Pkg/src/Types.jl:68
 [2] precompile(ctx::Pkg.Types.Context, pkgs::Vector{Pkg.Types.PackageSpec}; internal_call::Bool, strict::Bool, warn_loaded::Bool, already_instantiated::Bool, timing::Bool, kwargs::Base.Pairs{Symbol, Base.TTY, Tuple{Symbol}, NamedTuple{(:io,), Tuple{Base.TTY}}})
   @ Pkg.API ~/Downloads/julia-c18909d655/share/julia/stdlib/v1.10/Pkg/src/API.jl:1553
 [3] kwcall(::NamedTuple{(:io,), Tuple{Base.TTY}}, ::typeof(Pkg.API.precompile), ctx::Pkg.Types.Context, pkgs::Vector{Pkg.Types.PackageSpec})
   @ Pkg.API ~/Downloads/julia-c18909d655/share/julia/stdlib/v1.10/Pkg/src/API.jl:1112
 [4] precompile(pkgs::Vector{Pkg.Types.PackageSpec}; io::Base.TTY, kwargs::Base.Pairs{Symbol, Union{}, Tuple{}, NamedTuple{(), Tuple{}}})
   @ Pkg.API ~/Downloads/julia-c18909d655/share/julia/stdlib/v1.10/Pkg/src/API.jl:156
 [5] precompile(pkgs::Vector{Pkg.Types.PackageSpec})
   @ Pkg.API ~/Downloads/julia-c18909d655/share/julia/stdlib/v1.10/Pkg/src/API.jl:145
 [6] precompile(; name::Nothing, uuid::Nothing, version::Nothing, url::Nothing, rev::Nothing, path::Nothing, mode::Pkg.Types.PackageMode, subdir::Nothing, kwargs::Base.Pairs{Symbol, Union{}, Tuple{}, NamedTuple{(), Tuple{}}})
   @ Pkg.API ~/Downloads/julia-c18909d655/share/julia/stdlib/v1.10/Pkg/src/API.jl:171
 [7] precompile()
   @ Pkg.API ~/Downloads/julia-c18909d655/share/julia/stdlib/v1.10/Pkg/src/API.jl:162
 [8] top-level scope
   @ none:1
filter = false: Error During Test at /home/ian/Documents/GitHub/PackageCompiler.jl/test/runtests.jl:80

@IanButterworth
Copy link
Sponsor Member Author

Omitting the --sysimage=/tmp/jl_l9FFXE/sys.ji in ensurecompiled restores CPU usage back to normal.

I also see all cores light up in a single julia process during this too

 Debug: run_precompilation_script: running `/home/ian/Downloads/julia-c18909d655/bin/julia --color=yes --startup-file=no --pkgimages=no --sysimage=/tmp/jl_ai0jSY/sys.ji --compile=all --trace-compile=/tmp/jl_packagecompiler_kTWlbh/jl_IgAreA /home/ian/Documents/GitHub/PackageCompiler.jl/test/../examples/MyApp/precompile_app.jl

I think it's specific to processes with a .ji sysimage declared

This was referenced Feb 2, 2023
Closed
Closed
Open
Closed
@IanButterworth IanButterworth changed the title CPU maxes out on julia nightly during Pkg.precompile in incremental = false, filter = false testset, then errors but tests pass incremental = false mode causes Pkg.precompile to overload all threads when multithreading Feb 8, 2023
@IanButterworth IanButterworth mentioned this issue Feb 8, 2023
Merged
@sjkelly
Copy link
Collaborator

sjkelly commented Apr 3, 2024

Seems like this is fixed in JuliaLang/julia#48592?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

add warning about threading issue IanButterworth/PackageCompiler.jl
2 participants
@IanButterworth @sjkelly