Notes
Rough notes I’ve taken on a variety of subjects. Some are complete, most not.
AI Papers
- Neural Machine Translation
- Attention is all you need
- BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
- GPT: The Evolution of GPT
- VQGAN-CLIP: Open Domain Image Generation and Editing with Natural Language Guidance
- Toolformer: Language Models Can Teach Themselves to Use Tools
- RLHF: Deep Reinforcement Learning from Human Preferences
Search
- ANN: Approximate nearest neighbours
- SPANN: Highly-efficient Billion-scale Approximate Nearest Neighbor Search
- HNSW: Hierarchical Navigable Small World
- Opensearch KNN: Using and performance of Opensearch KNN Plugin
Computer Science
- Observability: Fundamentals of Observability and OpenTelemetry
- Zero-Copy Reads, Apache Arrow and Flight: Basic notes on zero-copy reads, Apache Arrow and Apache Flight.
- Artificial Life: Some important people in Artificial Life research
- Ethereum Proof-of-stake: Understanding Ethereum’s shift from POW to POS
Books
- “Amusing Ourselves to Death” Public Discourse in the Age of Show Business by Neil Postman.
More
- Question
- Wordley Mappings: What they are and, why and how they get used.