Matthew Pickering pushed to branch wip/gbc-files at Glasgow Haskell Compiler / GHC

Commits:

• 290f8357
  by Matthew Pickering at 2025-09-29T11:50:38+01:00

  driver: Load bytecode static pointer entries during linking
  
  Previously the entries were loaded too eagerly, during upsweep, but we
  should delay loading them until we know that the relevant bytecode
  object is demanded.
  
  Towards #25230
  

• ec2e3643
  by Matthew Pickering at 2025-09-29T12:52:44+01:00

  loader: Unify loadDecls and loadModuleLinkables functions
  
  These two functions nearly did the same thing. I have refactored them so
  that `loadDecls` now calls `loadModuleLinkables`.
  
  Fixes #26459
  

• 3d2fdc22
  by Matthew Pickering at 2025-09-29T13:08:42+01:00

  testsuite: Use ghci_ways to set ways in PackedDataCon/UnboxedTuples/UnliftedDataTypeInterp tests
  
  These tests reimplemented the logic from `valid_way` in order to
  determine what ways to run. It's easier to use this combination of
  `only_ways` and `extra_ways` to only run in GHCi ways and always run in
  GHCi ways.
  

• 7b818199
  by Matthew Pickering at 2025-09-29T13:08:42+01:00

  Rename interpreterBackend to bytecodeBackend
  

• b6923147
  by Cheng Shao at 2025-09-29T13:08:42+01:00

  compiler: implement and test bytecode serialization logic
  

• 2fa6fb1c
  by Matthew Pickering at 2025-09-29T13:09:23+01:00

  Add support for generating bytecode objects
  
  This commit adds the `-fwrite-byte-code` option which makes GHC emit a
  `.gbc` file which contains a serialised representation of bytecode.
  
  The bytecode can be loaded by the compiler to avoid having to
  reinterpret a module when using the bytecode interpreter (for example,
  in GHCi).
  
  There are also the new options:
  
  * -gbcdir=<DIR>: Specify the directory to place the gbc files
  * -gbcsuf=<suffix>: Specify the suffix for gbc files
  
  The option `-fbyte-code-and-object-code` now implies
  `-fwrite-byte-code`.
  

• ff36bea7
  by Matthew Pickering at 2025-09-29T13:09:24+01:00

  Remove LazyBCOs
  

• 79400e0f
  by Matthew Pickering at 2025-09-29T13:09:24+01:00

  Print path to .gbc file if it's generated.
  

• acd34084
  by Matthew Pickering at 2025-09-29T13:09:24+01:00

  Normalised ghci output
  

• 5355a342
  by Matthew Pickering at 2025-09-29T13:09:24+01:00

  Fix loading of objects
  

• c2ca8e1a
  by Matthew Pickering at 2025-09-29T13:09:24+01:00

  Add performance test for consuming bytecode files
  

75 changed files:

• compiler/GHC.hs
• compiler/GHC/Builtin/PrimOps.hs
• compiler/GHC/ByteCode/Breakpoints.hs
• + compiler/GHC/ByteCode/Serialize.hs
• compiler/GHC/ByteCode/Types.hs
• compiler/GHC/Data/FlatBag.hs
• compiler/GHC/Data/SmallArray.hs
• compiler/GHC/Driver/Backend.hs
• compiler/GHC/Driver/Backend/Internal.hs
• compiler/GHC/Driver/Backpack.hs
• + compiler/GHC/Driver/ByteCode.hs
• compiler/GHC/Driver/Config/Finder.hs
• compiler/GHC/Driver/Downsweep.hs
• compiler/GHC/Driver/DynFlags.hs
• compiler/GHC/Driver/Flags.hs
• compiler/GHC/Driver/Main.hs
• compiler/GHC/Driver/Make.hs
• compiler/GHC/Driver/Pipeline.hs
• compiler/GHC/Driver/Pipeline/Execute.hs
• compiler/GHC/Driver/Session.hs
• compiler/GHC/HsToCore/Breakpoints.hs
• compiler/GHC/HsToCore/Usage.hs
• compiler/GHC/Iface/Tidy/StaticPtrTable.hs
• compiler/GHC/Linker/Deps.hs
• compiler/GHC/Linker/Loader.hs
• compiler/GHC/Linker/Types.hs
• compiler/GHC/Types/SptEntry.hs
• compiler/GHC/Types/Tickish.hs
• compiler/GHC/Unit/Finder.hs
• compiler/GHC/Unit/Finder/Types.hs
• compiler/GHC/Unit/Module/Graph.hs
• compiler/GHC/Unit/Module/Location.hs
• compiler/GHC/Unit/Module/ModSummary.hs
• compiler/GHC/Unit/Module/WholeCoreBindings.hs
• compiler/GHC/Utils/Binary.hs
• compiler/ghc.cabal.in
• docs/users_guide/phases.rst
• docs/users_guide/separate_compilation.rst
• ghc/Main.hs
• testsuite/driver/testglobals.py
• testsuite/driver/testlib.py
• testsuite/tests/count-deps/CountDepsAst.stdout
• testsuite/tests/count-deps/CountDepsParser.stdout
• testsuite/tests/driver/T5313.hs
• + testsuite/tests/driver/bytecode-object/A.hs
• + testsuite/tests/driver/bytecode-object/BytecodeForeign.c
• + testsuite/tests/driver/bytecode-object/BytecodeForeign.hs
• + testsuite/tests/driver/bytecode-object/BytecodeMain.hs
• + testsuite/tests/driver/bytecode-object/BytecodeTest.hs
• + testsuite/tests/driver/bytecode-object/Makefile
• + testsuite/tests/driver/bytecode-object/all.T
• + testsuite/tests/driver/bytecode-object/bytecode_object12.stderr
• + testsuite/tests/driver/bytecode-object/bytecode_object13.stdout
• + testsuite/tests/driver/bytecode-object/bytecode_object14.stdout
• + testsuite/tests/driver/bytecode-object/bytecode_object15.stdout
• + testsuite/tests/driver/bytecode-object/bytecode_object16.stdout
• + testsuite/tests/driver/bytecode-object/bytecode_object17.stdout
• + testsuite/tests/driver/bytecode-object/bytecode_object18.stdout
• + testsuite/tests/driver/bytecode-object/bytecode_object19.script
• + testsuite/tests/driver/bytecode-object/bytecode_object19.stdout
• + testsuite/tests/driver/bytecode-object/bytecode_object25.script
• + testsuite/tests/driver/bytecode-object/bytecode_object25.stdout
• + testsuite/tests/driver/bytecode-object/bytecode_object4.stdout
• + testsuite/tests/driver/bytecode-object/bytecode_object5.stdout
• + testsuite/tests/driver/bytecode-object/bytecode_object6.stdout
• testsuite/tests/ghc-api/T10052/T10052.hs
• testsuite/tests/ghc-api/T8639_api.hs
• testsuite/tests/ghc-api/apirecomp001/myghc.hs
• testsuite/tests/ghci/linking/dyn/T3372.hs
• testsuite/tests/ghci/should_run/PackedDataCon/packeddatacon.T
• testsuite/tests/ghci/should_run/UnboxedTuples/unboxedtuples.T
• testsuite/tests/ghci/should_run/UnliftedDataTypeInterp/unlifteddatatypeinterp.T
• testsuite/tests/perf/compiler/Makefile
• + testsuite/tests/perf/compiler/MultiLayerModulesDefsGhciWithBytecodeFiles.script
• testsuite/tests/perf/compiler/all.T

The diff was not included because it is too large.