Issues

• Error in distributed test

  priority-high
  ApolloResearch/rib#365 · Filter by author danbraunai-apollo opened on Apr 9, 2024

• create_hf_dataset optional argument model_n_ctx is not optional

  bugpriority-low
  ApolloResearch/rib#354 · Filter by author stefan-apollo opened on Mar 4, 2024

• naive_gradient_flow and basis_formula=svd should confict

  bugpriority-low
  ApolloResearch/rib#352 · Filter by author stefan-apollo opened on Feb 28, 2024

• Some tests fail on A100 (that do not fail on A6000)

  bugpriority-medium
  ApolloResearch/rib#339 · Filter by author stefan-apollo opened on Feb 21, 2024

• Existing outfiles (check_outfile_overwrite = False) is handled inconsistently

  enhancementpriority-medium
  ApolloResearch/rib#336 · Filter by author stefan-apollo opened on Feb 19, 2024
  

• load_interaction_rotations should return calc_Cs_time

  enhancementpriority-low
  ApolloResearch/rib#335 · Filter by author stefan-apollo opened on Feb 9, 2024

• Make RIB more memory efficient

  ApolloResearch/rib#324 · Filter by author nix-apollo opened on Feb 1, 2024

• Cache transformers datasets

  enhancementpriority-low
  ApolloResearch/rib#320 · Filter by author danbraunai-apollo opened on Jan 31, 2024
  1

• Negative variance iff edge ablations in Split LN

  bugpriority-high
  ApolloResearch/rib#318 · Filter by author stefan-apollo opened on Jan 31, 2024

• Test RIB on the test set rather than train set

  bugpriority-medium
  ApolloResearch/rib#314 · Filter by author stefan-apollo opened on Jan 29, 2024

• Implement token masking to exclude BOS token

  ApolloResearch/rib#313 · Filter by author LuciusApollo opened on Jan 29, 2024
  1

• Better way to specify node layers

  enhancementpriority-low
  ApolloResearch/rib#312 · Filter by author nix-apollo opened on Jan 29, 2024

• Fix VSCode black and venv mismatch

  bugpriority-low
  ApolloResearch/rib#311 · Filter by author danbraunai-apollo opened on Jan 26, 2024
  1

• Update our default kwarg values

  enhancementpriority-medium
  ApolloResearch/rib#310 · Filter by author stefan-apollo opened on Jan 26, 2024

• Add option to start integrals from the expected value

  enhancementpriority-medium
  ApolloResearch/rib#301 · Filter by author nix-apollo opened on Jan 23, 2024

• get_rib_acts is batch-size dependent (floating point error)

  bugpriority-low
  ApolloResearch/rib#295 · Filter by author stefan-apollo opened on Jan 22, 2024

• Ablations Schedules should return num_to_keep not num_to_ablate

  enhancementpriority-low
  ApolloResearch/rib#288 · Filter by author nix-apollo opened on Jan 18, 2024

• Update yaml files in repo

  documentationpriority-low
  ApolloResearch/rib#283 · Filter by author stefan-apollo opened on Jan 16, 2024
  1

• Return dictionaries of custom objects rather than lists

  enhancementpriority-low
  ApolloResearch/rib#282 · Filter by author danbraunai-apollo opened on Jan 16, 2024

• Stray edges in squared edge attribution / numerical issues with large Lambda[0] values

  bugpriority-high
  ApolloResearch/rib#276 · Filter by author stefan-apollo opened on Jan 11, 2024
  2

• PCA basis beats RIB in some Mod Add layers

  bugpriority-high
  ApolloResearch/rib#275 · Filter by author stefan-apollo opened on Jan 11, 2024
  2

• Pythia attention_scores mismatch (1e-5) when folding biases

  bugpriority-low
  ApolloResearch/rib#245 · Filter by author stefan-apollo opened on Dec 5, 2023

• Graphs not invariant under rotate_final_node_layer

  bugpriority-high
  ApolloResearch/rib#241 · Filter by author stefan-apollo opened on Dec 4, 2023

• Replace "scaler" and "interval_size" by general weights

  enhancementpriority-low
  ApolloResearch/rib#226 · Filter by author stefan-apollo opened on Nov 29, 2023

• Support new dataset field in loader, instead of old train field

  bugpriority-low
  ApolloResearch/rib#218 · Filter by author stefan-apollo opened on Nov 28, 2023
  1