169: HyperLogLog

Episode description

Intro topic: Testing your car battery

News/Links:

• Tech Layoffs still going on
  • https://www.sfchronicle.com/tech/article/google-layoffs-california-companies-18465600.php 
• Real-time dreamy Cloudscapes with Volumetric Raymarching
  • https://blog.maximeheckel.com/posts/real-time-cloudscapes-with-volumetric-raymarching/
• Robot Rascals
  • https://en.wikipedia.org/wiki/Robot_Rascals 
• Meta Quest 3 
  • https://www.theverge.com/23906313/meta-quest-3-review-vr-mixed-reality-headset
    
    

Book of the Show

• Patrick:
  • HyperLogLog Paper
    • https://static.googleusercontent.com/media/research.google.com/en//pubs/archive/40671.pdf 
• Jason: 
  • Eureka! NVIDIA Research Breakthrough Puts New Spin on Robot Learning 
    • https://blogs.nvidia.com/blog/2023/10/20/eureka-robotics-research/ 

Patreon Plug https://www.patreon.com/programmingthrowdown?ty=h

Tool of the Show

• Patrick: 
  • Techtonica: https://store.steampowered.com/app/1457320/Techtonica/ 
• Jason:
  • ESP32 development board: https://amzn.to/3Qpmb20 
  • WEMOS

Topic: HyperLogLog

• Motivation
  • Cardinality Counting
• LinearCounting
  • Hash + expectation of collision based on how full
  • Bloom Filter
• LogLog
  • Use first N bits as bucket
  • Use max sequential 0s in each bucket
  • Average
• HyperLogLog
  • Handle empty buckets
  • Use correction factor like linear counting for low counts (number of empty buckets) and high counts
• Distributing
  • Transfer bucket counts