GitHub - michaelkiper/MLE: Repo for implementing ML papers · GitHub

Name		Name	Last commit message	Last commit date
.ipynb_checkpoints		.ipynb_checkpoints
Activations		Activations
BayesianFlowNetwork		BayesianFlowNetwork
ConvNext		ConvNext
DoubleDescent		DoubleDescent
H3		H3
IlyaRecommended		IlyaRecommended
Initializations		Initializations
LRP		LRP
LossFunctions		LossFunctions
MoE		MoE
NeuralNetworkDiffusion		NeuralNetworkDiffusion
Normalizations		Normalizations
OpenAI_Papers		OpenAI_Papers
Optimizers		Optimizers
QuIP		QuIP
ResNet		ResNet
ToRead		ToRead
TransformerExplainability		TransformerExplainability
VAE		VAE
VisualTranformer		VisualTranformer
YOLO		YOLO
transformer		transformer
.gitignore		.gitignore
Adafactor.pdf		Adafactor.pdf
AlexNet.pdf		AlexNet.pdf
AlicesAdventureInDifferentialWonderland.pdf		AlicesAdventureInDifferentialWonderland.pdf
AnnotatedHistoryofAI.pdf		AnnotatedHistoryofAI.pdf
BERT.pdf		BERT.pdf
ByteLatentTransformer.pdf		ByteLatentTransformer.pdf
CNN_DL_Guide.pdf		CNN_DL_Guide.pdf
Chinchilla.pdf		Chinchilla.pdf
CitadelGpuStudy.pdf		CitadelGpuStudy.pdf
ComprehensiveGuideToExplainableAI.pdf		ComprehensiveGuideToExplainableAI.pdf
ContractiveAutoEncoder.pdf		ContractiveAutoEncoder.pdf
ConvergenceOnMuon.pdf		ConvergenceOnMuon.pdf
ConvergenceViaOverparameterization.pdf		ConvergenceViaOverparameterization.pdf
DeepSeek_R1.pdf		DeepSeek_R1.pdf
DeepseekJanus.pdf		DeepseekJanus.pdf
DieT.pdf		DieT.pdf
DifferentialTransformer.pdf		DifferentialTransformer.pdf
DiffusionModelsLearnLow-DimensionalDistributionsViaSubspaceClustering.pdf		DiffusionModelsLearnLow-DimensionalDistributionsViaSubspaceClustering.pdf
Dropout.pdf		Dropout.pdf
EfficientBackprop.pdf		EfficientBackprop.pdf
EigenvaluesOfTheHessian.pdf		EigenvaluesOfTheHessian.pdf
FisherInfoAndCramerRaoBound.pdf		FisherInfoAndCramerRaoBound.pdf
FisherInformationMeanField.pdf		FisherInformationMeanField.pdf
FullGrad.pdf		FullGrad.pdf
GFlowNetFoundations.pdf		GFlowNetFoundations.pdf
GSM-Symbolic.pdf		GSM-Symbolic.pdf
GShard.pdf		GShard.pdf
GeometricDeepLearnig.pdf		GeometricDeepLearnig.pdf
GeometryOfLightningSelfAttention.pdf		GeometryOfLightningSelfAttention.pdf
GradientInformationOptimization.pdf		GradientInformationOptimization.pdf
Grokking.pdf		Grokking.pdf
I-JEPA.pdf		I-JEPA.pdf
In-contextLearningandInductionHeads.pdf		In-contextLearningandInductionHeads.pdf
InitializationAndMomentum.pdf		InitializationAndMomentum.pdf
IntegratedGradients.pdf		IntegratedGradients.pdf
JordanKeller'sMuonBlog.pdf		JordanKeller'sMuonBlog.pdf
Kolmogorov–Arnold-Networks.pdf		Kolmogorov–Arnold-Networks.pdf
Kronecker-FactoredApproximateCurvature-Derivative.pdf		Kronecker-FactoredApproximateCurvature-Derivative.pdf
Kronecker-factoredApproximateCurvature.pdf		Kronecker-factoredApproximateCurvature.pdf
LLama3.pdf		LLama3.pdf
LanguageModelingIsCompression.pdf		LanguageModelingIsCompression.pdf
LargeBatchTraining.pdf		LargeBatchTraining.pdf
Layer-wiseAdaptiveRateScaling.pdf		Layer-wiseAdaptiveRateScaling.pdf
LearningInHighDimensionAlwaysAmountsToExtrapolation.pdf		LearningInHighDimensionAlwaysAmountsToExtrapolation.pdf
MADDPG.pdf		MADDPG.pdf
Mamba2.pdf		Mamba2.pdf
MambaByte.pdf		MambaByte.pdf
MathTransformer.pdf		MathTransformer.pdf
Mistral7B.pdf		Mistral7B.pdf
Mixtral8x7B.pdf		Mixtral8x7B.pdf
MuonForPretraining.pdf		MuonForPretraining.pdf
NaturalGradient.pdf		NaturalGradient.pdf
NaturalGradientMethod.pdf		NaturalGradientMethod.pdf
NaurosymbolicAI.pdf		NaurosymbolicAI.pdf
NeuralNetworksAreDecisionTrees.pdf		NeuralNetworksAreDecisionTrees.pdf
NeuralScalingLaw.pdf		NeuralScalingLaw.pdf
NeuralTangentKernel.pdf		NeuralTangentKernel.pdf
NotesOnKLDivergence.pdf		NotesOnKLDivergence.pdf
OldOptimizerNewNorm.pdf		OldOptimizerNewNorm.pdf
ProgramSynthesisViaMechanisticInterpretability.pdf		ProgramSynthesisViaMechanisticInterpretability.pdf
README.md		README.md
RLHF+MixtureOfJudges.pdf		RLHF+MixtureOfJudges.pdf
SGDModelsAreKernelMachines.pdf		SGDModelsAreKernelMachines.pdf
SaddlePointProblemInHighDimNonConvexOptimization.pdf		SaddlePointProblemInHighDimNonConvexOptimization.pdf
SearchingLatentProgramSpaces.pdf		SearchingLatentProgramSpaces.pdf
SpectralConditionForFeatureLearning.pdf		SpectralConditionForFeatureLearning.pdf
SpectralNormRegularization.pdf		SpectralNormRegularization.pdf
StreamingLLM.pdf		StreamingLLM.pdf
SurveryOfAttentionMechanisms.pdf		SurveryOfAttentionMechanisms.pdf
TemporalDifferenceLearning.pdf		TemporalDifferenceLearning.pdf
TfEntropyCollapse.pdf		TfEntropyCollapse.pdf
TheBoundaryOfNeuralNetworkTrainabilityIsFractal.pdf		TheBoundaryOfNeuralNetworkTrainabilityIsFractal.pdf
TheClockAndThePizza.pdf		TheClockAndThePizza.pdf
TheoryOfUsableInformationUnderComputationalConstraints.pdf		TheoryOfUsableInformationUnderComputationalConstraints.pdf
TranformersWithoutNormalization.pdf		TranformersWithoutNormalization.pdf
TransformerLanguageModelswithoutPositionalEncodingsStillLearnPositionalInformation .pdf		TransformerLanguageModelswithoutPositionalEncodingsStillLearnPositionalInformation .pdf

Repository files navigation

Good videos:

About

Repo for implementing ML papers

0 stars

1 watching

Report repository

Releases

Packages

Contributors

Languages