52 Weeks of Cloud

What I Cannot Create, I Do Not Understand

Episode Summary

Feynman's famous blackboard contained two key insights that apply directly to learning AI: build to understand and master solved problems. At Pragmatic AI Labs, this translates to implementing core components (like token processors and embeddings) from scratch before using frameworks, and studying successful architectures to understand proven solutions. The approach emphasizes hands-on building over memorization, with students encouraged to break and rebuild systems while progressing from raw implementations to production frameworks across Python, Rust, SQL, Bash, and Zig.

Episode Notes

Feynman's Wisdom Applied to AI Learning

Background

• Feynman helped create atomic bomb and investigated Challenger disaster
• Challenger investigation revealed bureaucracy prioritized power over engineering solutions
• Two key phrases found on his blackboard at death:
  • "What I cannot create, I do not understand"
  • "Know how to solve every problem that has been solved"

Applied to Pragmatic AI Labs Courses

What I Cannot Create

• Build token processor before using Bedrock
• Implement basic embeddings before production models
• Write minimal GPU kernels before CUDA libraries
• Create raw model inference before frameworks
• Deploy manual servers before cloud services

Learning Solved Problems

• Study successful AI architectures
• Reimplement ML papers
• Analyze deployment patterns
• Master optimization techniques
• Learn security boundaries

Implementation Strategy

• Build core concepts from scratch
• Move to frameworks only after raw implementation
• Break systems intentionally to understand them
• Build instead of memorize
• Ex: Build S3 bucket/Lambda vs. memorizing for certification

Platform Support

• Interactive labs available
• Source code starter kits
• Multiple languages: Python, Rust, SQL, Bash, Zig
• Focus on first principles
• Community-driven learning approach

Key Takeaway

Focus on understanding through creation, leveraging proven solutions as foundation for innovation.