Programming Throwdown

172: Transformers and Large Language Models

Intro topic: Is WFH actually WFC?

News/Links:

• Falsehoods Junior Developers Believe about Becoming Senior
  • https://vadimkravcenko.com/shorts/falsehoods-junior-developers-believe-about-becoming-senior/
• Pure Pursuit
  • Tutorial with python code: https://wiki.purduesigbots.com/software/control-algorithms/basic-pure-pursuit 
  • Video example: https://www.youtube.com/watch?v=qYR7mmcwT2w 
• PID without a PHD
  • https://www.wescottdesign.com/articles/pid/pidWithoutAPhd.pdf
• Google releases Gemma
  • https://blog.google/technology/developers/gemma-open-models/
    
    

Book of the Show

• Patrick: The Eye of the World by Robert Jordan (Wheel of Time)
  • https://amzn.to/3uEhg6v
• Jason: How to Make a Video Game All By Yourself
  • https://amzn.to/3UZtP7b

Patreon Plug https://www.patreon.com/programmingthrowdown?ty=h

Tool of the Show

• Patrick: Stadia Controller Wifi to Bluetooth Unlock
  • https://stadia.google.com/controller/index_en_US.html
• Jason: FUSE and SSHFS
  • https://www.digitalocean.com/community/tutorials/how-to-use-sshfs-to-mount-remote-file-systems-over-ssh
    
    

Topic: Transformers and Large Language Models

• How neural networks store information
  • Latent variables
• Transformers
  • Encoders & Decoders
• Attention Layers
  • History
    • RNN
      • Vanishing Gradient Problem
    • LSTM
      • Short term (gradient explodes), Long term (gradient vanishes)
  • Differentiable algebra
  • Key-Query-Value
  • Self Attention
• Self-Supervised Learning & Forward Models
• Human Feedback
  • Reinforcement Learning from Human Feedback
  • Direct Policy Optimization (Pairwise Ranking)

Intro topic: Monitor setups

News/Links:

• BlueScuti, Willis, beats Tetris
  • https://www.youtube.com/watch?v=GuJ5UuknsHU
• PalWorld accused of being an AI Product
  • https://www.forbes.com/sites/paultassi/2024/01/22/palworld-accused-of-using-genai-with-no-evidence-so-far/?sh=26a9651b4239
• 4 Billion if-statements to determine if a number is even or odd
  • https://andreasjhkarlsson.github.io/jekyll/update/2023/12/27/4-billion-if-statements.html
• Seamless M4T
  • https://ai.meta.com/blog/seamless-m4t/
    
    

Book of the Show

• Patrick:
  • Foundation by Isaac Asimov
    • https://amzn.to/3SrmgnP
• Jason: 
  • Propaganda by Edward Bernays
    • https://amzn.to/47JUCXJ

Patreon Plug https://www.patreon.com/programmingthrowdown?ty=h

Tool of the Show

• Patrick: 
  • The Room Game
    • https://www.fireproofgames.com/games/the-room
• Jason:
  • Incredibuild
    • https://www.incredibuild.com/
      
      

Topic: Compilers and Interpreters (Request by Jessica W.)

• Machine Code
  • Architecture Specific
• Assembly
  • Single vs Two Pass Compiler
• High level Languages
  • Intermediate Representation
  • JVM ByteCode vs Machine Code for portability
• Scripting/Interpreters
• JIT
• Profile Guided Optimization
• Resources
  • https://www.craftinginterpreters.com/
  • https://nandgame.com/
  • Turing Complete

Predictions:
Jason 

• VR for Work
• Lowering AI training cost/ improved efficiency
• RISC-V takeoff

Patrick

• Ai claim of AGI
• Ai peer reviewer
• Ai Video Generator
• More space vehicles reaching orbit

Early career, finding role at FAANG, liaising vs shipping code. Startup?

3 part. 1. How and when current hype for AI will end? 2. Shape of the show 3. Upcoming in tech

What are essential programmer knowledge items?

CS Student, how to organize life and goals? What purpose life should serve?

What kind of programmer were you in college?

Happy Holidays!

Intro topic: Testing your car battery

News/Links:

• Tech Layoffs still going on
  • https://www.sfchronicle.com/tech/article/google-layoffs-california-companies-18465600.php 
• Real-time dreamy Cloudscapes with Volumetric Raymarching
  • https://blog.maximeheckel.com/posts/real-time-cloudscapes-with-volumetric-raymarching/
• Robot Rascals
  • https://en.wikipedia.org/wiki/Robot_Rascals 
• Meta Quest 3 
  • https://www.theverge.com/23906313/meta-quest-3-review-vr-mixed-reality-headset
    
    

Book of the Show

• Patrick:
  • HyperLogLog Paper
    • https://static.googleusercontent.com/media/research.google.com/en//pubs/archive/40671.pdf 
• Jason: 
  • Eureka! NVIDIA Research Breakthrough Puts New Spin on Robot Learning 
    • https://blogs.nvidia.com/blog/2023/10/20/eureka-robotics-research/ 

Patreon Plug https://www.patreon.com/programmingthrowdown?ty=h

Tool of the Show

• Patrick: 
  • Techtonica: https://store.steampowered.com/app/1457320/Techtonica/ 
• Jason:
  • ESP32 development board: https://amzn.to/3Qpmb20 
  • WEMOS

Topic: HyperLogLog

• Motivation
  • Cardinality Counting
• LinearCounting
  • Hash + expectation of collision based on how full
  • Bloom Filter
• LogLog
  • Use first N bits as bucket
  • Use max sequential 0s in each bucket
  • Average
• HyperLogLog
  • Handle empty buckets
  • Use correction factor like linear counting for low counts (number of empty buckets) and high counts
• Distributing
  • Transfer bucket counts

Intro topic: What are expectations on developers that have nothing to do with programming

News/Links:

• Pushing for a lower dev estimate is like negotiating weather with a Meteorologist
  • https://smartguess.is/blog/your-estimate-is-less-than-that/
• Announcing python in excel
  • https://techcommunity.microsoft.com/t5/excel-blog/announcing-python-in-excel-combining-the-power-of-python-and-the/ba-p/3893439
• 7 Habits of Highly Effective Software Engineers
  • https://makingsmallercircles.com/articles/7-habits-of-highly-effective-software-engineers/
• Raspberry pi 5 begins shipping
  • https://www.phoronix.com/news/Raspberry-Pi-5-Shipping
    
    

Book of the Show

• Patrick:
  • Harry Potter and the Sorcerer's Stone Illustrated Edition
    • https://amzn.to/3St3L35
• Jason: 
  • The Pete and Sebastian Show
    • https://podcasts.apple.com/us/podcast/the-pete-and-sebastian-show/id570256898

Patreon Plug https://www.patreon.com/programmingthrowdown?ty=h

Tool of the Show

• Patrick: 
  • Obsidian
    • obsidian.md
• Jason:
  • Ink by Inkle
    • https://github.com/inkle/ink
      
      

Topic: Godot

• What is a game engine?
  • Graphics, animation, particle effects
  • Tilemaps
  • Entity component systems
  • Physics
  • Sound
  • I/O
  • Input handling (touchscreen, joystick)
  • GDScript
• Why use a game engine?
  • Portability
  • Allow for testing individual components of the game
  • Libraries for ads, in-app-purchases
• Godot
  • Open source
  • Focused on 2-D but now many 3-D features
  • Great development environment
• AI Hero
  • Started in phaser (development rut)
  • Moved to Godot, rapid prototyping

Intro topic: Jogging Metrics

News/Links:

• Unholy LLM
  • https://huggingface.co/Undi95/Unholy-v1-12L-13B 
• The reverse red herring  
  • https://www.blameless.com/blog/the-reverse-red-herring
• The "ens–tification" of TikTok
  • https://www.wired.com/story/tiktok-platforms-cory-doctorow/ 
• Response letter to Godot is not the new Unity
  • https://sampruden.github.io/posts/godot-is-not-the-new-unity/
  • https://gist.github.com/reduz/cb05fe96079e46785f08a79ec3b0ef21
    
    

Book of the Show

• Patrick:
  • Math Games with Bad Drawings by Ben Orlin
  • https://amzn.to/48qlg9A
• Jason: 
  • The Invisible Hook: The Hidden Economics of Pirates
  • https://amzn.to/3LChBff

Patreon Plug https://www.patreon.com/programmingthrowdown?ty=h

Tool of the Show

• Patrick: 
  • Factorio (Desktop Game)
• Jason:
  • AI Hero (iOS and Android)

Topic: Desktop user interfaces

• What is a user interface?
• Web and Mobile UI toolkits
• Desktop options
  • Qt
    • Cross platform, custom UI elements
    • Qt creator, code generator
  • WxWidgets
    • Cross platform, uses native UI elements 
    • WxFormDesigner, code generation
    • Can look different on different operating systems
  • Electron
    • Local nodejs webserver
    • Html/JavaScript technology
    • Requires interprocess communication to use other languages  
  • Jupyter notebooks
    • Mathematica-like notebook 
    • Not for distribution 
  • Streamlit
    • Python to web compiler
  • Game Engines
    • Unity, Godot, Unreal
• Tips for building desktop UI
  • UI is slow (startup time, interaction time)
  • Separate the UI from the engine & business logic

- pganalyze: https://pganalyze.com/

- Weekly series "5mins of Postgres": https://www.youtube.com/channel/UCDV_1Dz2Ixgl1nT_3DUZVFw

- How Postgres chooses which index to use: https://pganalyze.com/blog/how-postgres-chooses-index

- CMU databases courses: https://db.cs.cmu.edu/courses/

- Postgres community: https://www.postgresql.org/community/

As well as social links:

- Mastodon: https://hachyderm.io/@lukas

- Twitter/X: @pganalyze, @LukasFittl

- GitHub: @pganalyze, @lfittl

- LinkedIn: https://www.linkedin.com/in/lfittl/ , https://www.linkedin.com/company/pganalyze/

Intro topic: Revisiting the power of Spreadsheets

News/Links:

• LK-99 Isn’t a Superconductor
  • https://www.nature.com/articles/d41586-023-02585-7
• Normalizing Flows
  • https://pyro.ai/examples/normalizing_flows_i.html
• How is llama.cpp possible?
  • https://finbarr.ca/how-is-llama-cpp-possible/
• Chat with open source large language models
  • https://chat.lmsys.org/
    
    

Book of the Show

• Patrick: Math with Bad Drawings by Ben Orlin
  • https://amzn.to/44dsgDz
• Jason: 
  • Overboard! https://play.google.com/store/apps/details?id=com.InkleLtd.Overboard Nhl=en_US&gl=US 

Patreon Plug https://www.patreon.com/programmingthrowdown?ty=h

Tool of the Show

• Patrick: 
  • ffmprovisr https://amiaopensource.github.io/ffmprovisr/
• Jason:
  • Pandas read_ods() read_excel()

Topic: Differential Equations

• Why should programmers learn about DiffEq
  • Law of Large Numbers
• What are differential equations?
  • When you know the rate of change
  • EigenVectors & EigenValues
  • What is Jacobian What is Jacobian? | The right way of thinking derivatives and integrals
    
    
• Special cases
  • Partial Differential Equations
  • Ordinary Differential Equations
• Why solvers are important
  • Numerical Stability at larger step sizes
  • Example: https://medium.com/@pukumarathe/eulers-method-and-runge-kutta-4th-order-method-in-python-b4a0068a8ebe 
• Fun Examples
  • Predator-Prey relationships in scipy
    • https://scientific-python.readthedocs.io/en/latest/notebooks_rst/3_Ordinary_Differential_Equations/02_Examples/Lotka_Volterra_model.html 
  • Physics Engines for games
    • https://youtu.be/52n2qKgwW_Q 
  • PageRank
    • https://arxiv.org/pdf/2001.08973.pdf 

Things to consider when choosing a database

• Speed & Latency
• Consistency, ACID Compliance
• Scalability
• Language support & Developer Experience
• Relational vs. Non-relational (SQL vs. NoSQL)
• Data types
• Security
• Database environment
  • Client vs Server access

Info on Kris & Harper:

• Website: harperdb.io
• Twitter: @harperdbio, @kriszyp
• Github: @HarperDB, @kriszyp

Episode 163 - Recursion

Intro topic: Electric Cars

News/Links:

• Snake Game in 101 Bytes in a QR Code
  • https://www.reddit.com/r/programming/comments/15ab4ct/my_qr_code_snake_game_is_now_only_101_bytes/
• Superconductor Rumors abound
  • https://arstechnica.com/science/2023/08/whats-going-on-with-the-reports-of-a-room-temperature-superconductor/
• OpenWorm
  • https://github.com/openworm/OpenWorm
• Creator of vim passes away
  • https://news.itsfoss.com/vim-creator-passed-away/
    
    

Book of the Show

• Patrick:
  • Little Book of Common Sense Investing by Jack Bogle https://amzn.to/43YqANR
• Jason: 
  • Mistborn Saga: https://amzn.to/3DJkUN8

Patreon Plug https://www.patreon.com/programmingthrowdown?ty=h

Tool of the Show

• Jason:
  • reMarkable https://remarkable.com/
• Patrick: 
  • Stellarium (iOS and Android)

Topic: Recursion

• What is it
  • Divide-And-Conquer
  • Fibonacci numbers
• How to (not) teach recursion
• Practical Applications
  • Graph operations
    • Tree retrieval, balancing
    • Graph Search
  • Spatial partitioning
• Pitfalls
  • Stack size
• How to solve problems with recursion
  • (1) Consider the base cases
  • (2) Build the recursive step
  • (3) Look for ways the recursion will not terminate and fix
  • (4) (rest are optional) Remove global contexts
  • (5) Add memoization
  • (6) Build solutions incrementally

In the latest episode of Programming Throwdown, we delve into the captivating world of interactive fiction. We explore: Wordnet, Inform, and how games in the past have been the forerunners of today’s NLP challenges.

00:00:22 Introductions

00:00:39 To hard mode or not to hard mode

00:08:58 No moats in Google

00:16:37 Stable Diffusion blows Jason’s mind

00:21:31 Putting beats together

00:23:38 GPT4All

00:27:44 White Sand

00:35:28 Fortuna

00:38:55 Patrick’s ‘dirty’ secret

00:47:20 Wordnet

00:53:56 Procedural generation

00:57:29 On tabletop RPGs

01:00:48 Inform

01:07:27 Farewells

Resources mentioned in this episode:

Join the Programming Throwdown Patreon community today: https://www.patreon.com/programmingthrowdown?ty=h

Subscribe to the podcast on Youtube: https://www.youtube.com/@programmingthrowdown4793

News/Links:

• Google: We have no moat and neither does OpenAI
  • https://www.semianalysis.com/p/google-we-have-no-moat-and-neither
• Stable Diffusion QR Codes
  • https://stable-diffusion-art.com/qr-code/ 
• Beginning to Make Music
  • https://learningmusic.ableton.com/
• GPT4All
  • https://gpt4all.io/index.html
• Wordnet:
  • https://wordnet.princeton.edu/
• Inform:
  • https://en.wikipedia.org/wiki/Inform

Book of the Show

• Patrick:
  • White Sand https://amzn.to/43CPMKA
• Jason: 
  • The Fortuna https://www.generativefiction.com/

Tool of the Show

• Jason:
  • Gatsby.js https://www.gatsbyjs.com/
• Patrick: 
  • Peglin https://store.steampowered.com/app/1296610/Peglin/ 

If you’ve enjoyed this episode, you can listen to more on Programming Throwdown’s website: https://www.programmingthrowdown.com/

Reach out to us via email: programmingthrowdown@gmail.com

You can also follow Programming Throwdown on 

Facebook | Apple Podcasts | Spotify | Player.FM | Youtube

Join the discussion on our Discord

Help support Programming Throwdown through our Patreon

MosaicML’s VP Of Engineering, Hagay Lupesko, joins us today to discuss generative AI!  We talk about how to use existing models as well as ways to finetune these models to a particular task or domain.

00:01:28 Introductions

00:02:09 Hagay’s circuitous career journey

00:08:25 Building software for large factories

00:17:30 The reality of new technologies

00:28:10 AWS

00:29:33 Pytorch’s leapfrog advantage

00:37:24 MosaicML’s mission

00:39:29 Generative AI

00:44:39 Giant data models

00:57:00 Data access tips

01:10:31 MPT-7B

01:27:01 Careers in Mosaic

01:31:46 Farewells

Resources mentioned in this episode:

Join the Programming Throwdown Patreon community today: https://www.patreon.com/programmingthrowdown?ty=h

Subscribe to the podcast on Youtube: https://www.youtube.com/@programmingthrowdown4793

Links:

• Hagay Lupesko:
  • Linkedin: https://www.linkedin.com/in/hagaylupesko/
  • Twitter: https://twitter.com/hagay_lupesko
  • Github: https://github.com/lupesko
• MosaicML:
  • Website: https://www.mosaicml.com/
  • Careers: https://www.mosaicml.com/careers
  • Twitter: https://twitter.com/MosaicML
  • Linkedin: https://www.linkedin.com/company/mosaicml/
• Others:
  • Amp It Up (Amazon): https://www.amazon.com/Amp-Unlocking-Hypergrowth-Expectations-Intensity/dp/1119836115
  • Hugging Face Hub: https://huggingface.co/

If you’ve enjoyed this episode, you can listen to more on Programming Throwdown’s website: https://www.programmingthrowdown.com/

Reach out to us via email: programmingthrowdown@gmail.com

You can also follow Programming Throwdown on 

Facebook | Apple Podcasts | Spotify | Player.FM | Youtube

Join the discussion on our Discord

Help support Programming Throwdown through our Patreon

Where are you now? It’s a question that may seem easy to answer on the surface, but in truth hides more complexity than people expect. In today’s episode, we tackle the latest on AI, creative endeavors, and more before diving into the meaty discussion of position localization.

00:01:13 Steam Deck
00:11:22 Summoning Salt on Mario
00:16:49 100k stars
00:24:26 ChatGPT spam call
00:25:31 Build Your Own DB (from scratch)
00:29:50 DuckDB
00:35:07 Jason has an idea
00:37:58 Fighting Fantasy Classics
00:41:52 Patrick’s bread
00:47:52 Support the show
00:53:54 Awkward CRM emails
00:56:07 Rill
01:00:29 Position localization in detail
01:17:15 Common filter
01:25:22 Simultaneous localization
01:28:59 Farewells

Resources mentioned in this episode:
Join the Programming Throwdown Patreon community today: https://www.patreon.com/programmingthrowdown?ty=h

Subscribe to the podcast on Youtube: https://www.youtube.com/@programmingthrowdown4793

News/Links:

• The History of Super Mario Bros 3 100% World Records (Summoning Salt)
  • https://www.youtube.com/watch?v=_EsFyogVvkw
• AutoGPT hits 100k stars
  • https://twitter.com/AlphaSignalAI/status/1649524105647906819
• Build Your Own Database from Scratch
  • https://build-your-own.org/database/
• Asking generative art AI to render mathematical theorems
  • https://twitter.com/TivadarDanka/status/1649721970886594561
• DuckDB:
  • https://duckdb.org/

Book of the Show:

• Jason: Fighting Fantasy Classics
  • https://play.google.com/store/apps/details?id=com.tinmangames.ffhub&hl=en_US&gl=US
  • https://apps.apple.com/us/app/fighting-fantasy-classics/id1261201650
• Patrick: Evolutions in Bread: Artisan Pan Breads and Dutch-Oven Loaves at Home
  • https://amzn.to/44kW4iE

Tool of the Show:

• Jason: Jinja 
  • https://jinja.palletsprojects.com/en/3.1.x/
• Patrick: Rill 
  • https://www.rilldata.com/

If you’ve enjoyed this episode, you can listen to more on Programming Throwdown’s website: https://www.programmingthrowdown.com/

Reach out to us via email: programmingthrowdown@gmail.com

You can also follow Programming Throwdown on 

Facebook | Apple Podcasts | Spotify | Player.FM | Youtube

Join the discussion on our Discord

Help support Programming Throwdown through our Patreon

GraphQL is one of the biggest API enablers in software development, but just how complicated can things be? Tanmai Gopal – Hasura’s CEO extraordinaire – talks with Jason and Patrick about how the secret sauce gets made. They dive deeply from how APIs function to having them managed in practice – among several other topic, making this a must-listen episode. 

00:01:19 Introductions

00:01:48 Tanmai’s late start in programming

00:05:48 Plinko

00:13:06 Coursera

00:23:28 The question of API development

00:30:30 API layer functionality

00:34:58 How Hasura leverages JSON

00:39:08 GraphQL

00:42:49 Worse than an API call

00:49:15 The potential REST minefield

00:53:41 JSON Web Tokens

01:11:34 Scaling writes

01:15:17 Careers with Hasura

01:22:35 Farewells

Resources mentioned in this episode:

Join the Programming Throwdown Patreon community today: https://www.patreon.com/programmingthrowdown?ty=h

Subscribe to the podcast on Youtube: https://www.youtube.com/@programmingthrowdown4793

Links:

•  Tanmai Gopal:
  •  Website: https://hasura.io/blog/@tanmaig/
  •  Linkedin: https://www.linkedin.com/in/tanmaig/
  •  Twitter: https://twitter.com/tanmaigo
  •  Github: https://github.com/coco98
•  Hasura:
  •  Website: https://hasura.io/
  •  Careers: https://hasura.io/careers/
  •  Twitter: https://twitter.com/HasuraHQ
  •  Github: https://github.com/hasura
  •  Linkedin: https://www.linkedin.com/company/hasura
•  Others:
  •  Good Strategy, Bad Strategy (Amazon): https://www.amazon.com/Good-Strategy-Bad-Strategy-audiobook/dp/B07R6XQ8YP
  •  Modern Application Development (IIT Madras, archived): https://archive.nptel.ac.in/courses/106/106/106106156/

If you’ve enjoyed this episode, you can listen to more on Programming Throwdown’s website: https://www.programmingthrowdown.com/

Reach out to us via email: programmingthrowdown@gmail.com

You can also follow Programming Throwdown on 

Facebook | Apple Podcasts | Spotify | Player.FM | Youtube

Join the discussion on our Discord

Help support Programming Throwdown through our Patreon

In today’s episode, Jason and Patrick dive deeply with JFrog’s Senior Solutions Engineer, Bill Manning. With the conversation tackling the depth and complexity of software supply chains, vulnerabilities and more, Bill deftly offers grounded advice to listeners old and new.

00:00:26 Introductions

00:00:40 Bill’s plethora of job titles

00:09:33 The excitement of learning a language

00:15:08 Mechanical keyboards

00:21:17 Bill’s advice on adapting

00:27:55 What a supply chain is

00:34:28 Castle analogies

00:40:55 Unpacking legalities

00:52:11 Log4J

00:54:41 What JFrog does

01:01:16 What can go wrong

01:08:08 Getting started in this space

01:14:15 Careers in JFrog

01:20:23 Farewells

Resources mentioned in this episode:

Join the Programming Throwdown Patreon community today: https://www.patreon.com/programmingthrowdown?ty=h

Subscribe to the podcast on Youtube: https://www.youtube.com/@programmingthrowdown4793

• Links:
  • Bill Manning:
    • Website: https://about.me/billmanning
    • Linkedin: https://www.linkedin.com/in/williammanning/
    • Twitter: https://twitter.com/williammanning
  • JFrog:
    • Website: https://jfrog.com/
    • Careers: https://join.jfrog.com/
    • Artifactory: https://jfrog.com/artifactory/
    • Linkedin: https://www.linkedin.com/company/jfrog-ltd/
  • Others:
    • Liquid Software: https://liquidsoftware.com/
    • SolarWinds hack incident: https://www.wired.com/story/the-untold-story-of-solarwinds-the-boldest-supply-chain-hack-ever/
    • Transitive dependencies: https://en.wikipedia.org/wiki/Transitive_dependency

More Throwdown? Check out this prior episode:

• 153: ChatGPT: https://www.programmingthrowdown.com/2023/03/153-chatgpt.html

If you’ve enjoyed this episode, you can listen to more on Programming Throwdown’s website: https://www.programmingthrowdown.com/

Reach out to us via email: programmingthrowdown@gmail.com

You can also follow Programming Throwdown on 

Facebook | Apple Podcasts | Spotify | Player.FM | Youtube

Join the discussion on our Discord

Help support Programming Throwdown through our Patreon 

There’s more than what meets the eye when it comes to Kubernetes, and Craig Box – ARMO’s VP of Open Source & Community –is one of several who have seen its many twists and turns since its inception. He talks with Jason and Patrick about Kubernetes’ origins in pop culture, utility in the modern workflow, and possible future in today’s episode. 

00:01:31 Introductions

00:03:39 Craig’s early internet speed experience

00:07:46 An adventure towards Google

00:16:55 Project Seven

00:21:17 Mesos

00:26:42 The origin of Kubernetes

00:28:36 DS9’s influence on naming conventions

00:37:49 Getting more results with the same resources

00:47:13 IPv4

00:53:44 Craig’s thoughts on learning Kubernetes

01:06:59 Kubescape

01:18:12 Working at ARMO

01:23:16 Programming Throwdown on Youtube

01:23:55 Farewells

Resources mentioned in this episode:

Join the Programming Throwdown Patreon community today: https://www.patreon.com/programmingthrowdown?ty=h

Subscribe to the podcast on Youtube: https://www.youtube.com/@programmingthrowdown4793

• Links:
  • Craig Box:
    • Substack: https://substack.com/profile/107796914-craig-box
    • Github: https://github.com/craigbox
    • Linkedin: https://www.linkedin.com/in/crbnz/
    • Twitter: https://twitter.com/craigbox
  • ARMO:
    • Website: https://www.armosec.io/
    • Linkedin: https://www.linkedin.com/company/armosec/
  • Others:
    • The Project Seven origin story: https://cloud.google.com/blog/products/containers-kubernetes/from-google-to-the-world-the-kubernetes-origin-story
    • 7 of 9 on Memory Alpha: https://memory-alpha.fandom.com/wiki/Seven_of_Nine

More Throwdown? Check out this prior episode:

• E135: Kubernetes with Aran Khanna: https://www.programmingthrowdown.com/2022/06/135-kubernetes-with-aran-khanna.html

If you’ve enjoyed this episode, you can listen to more on Programming Throwdown’s website: https://www.programmingthrowdown.com/

Reach out to us via email: programmingthrowdown@gmail.com

You can also follow Programming Throwdown on 

Facebook | Apple Podcasts | Spotify | Player.FM | Youtube

Join the discussion on our Discord

Help support Programming Throwdown through our Patreon

Should AI research be paused? How far ahead have deepfakes come? Join Patrick and Jason as they tackle their answers to these timely questions – plus an in-depth discussion on Perl in practice – with today’s episode of Programming Throwdown. 

Resources mentioned in this episode:

Join the Programming Throwdown Patreon community today: https://www.patreon.com/programmingthrowdown?ty=h

News/Links:

• GPT4All & Stanford Alpaca
  • https://github.com/nomic-ai/gpt4all
• Giant AI Experiments 6 month pause open letter
  • https://futureoflife.org/open-letter/pause-giant-ai-experiments/
• Will Smith Eating Spaghetti generated video
  • https://www.vice.com/en/article/xgw8ek/ai-will-smith-eating-spaghetti-hill-haunt-you-for-the-rest-of-your-life
• Robust image compression implementation from a NASA paper
  • https://github.com/TheRealOrange/icer_compression
• Dig This Vegas
  • https://digthisvegas.com/
• XKCD:
  • https://xkcd.com/208/
• AI Open Letter:
  • https://futureoflife.org/open-letter/pause-giant-ai-experiments/
• Godbolt:
  • https://godbolt.org/

Book of the Show:

• Jason: It Doesn’t Have To Be Crazy At Work
  • https://amzn.to/40PFgxH
• Patrick: Prince of Fools by Mark Lawrence
  • https://amzn.to/3lWVEO9

Tool of the Show:

• Jason: 
  • ReMarkable 2: https://remarkable.com/store/remarkable-2
• Patrick: 
  • Slay the Spire: https://store.steampowered.com/app/646570/Slay_the_Spire/

If you’ve enjoyed this episode, you can listen to more on Programming Throwdown’s website: https://www.programmingthrowdown.com/

Reach out to us via email: programmingthrowdown@gmail.com

You can also follow Programming Throwdown on 

Facebook | Apple Podcasts | Spotify | Player.FM 

Join the discussion on our Discord

Help support Programming Throwdown through our Patreon

When it comes to untangling the complexities of what lies ahead for search engines in this age of AI, few are as deeply versed in the subject as You.com Engineer Saahil Jain. Jason and Patrick talk with him in this episode about what search even is, what challenges lie ahead, and where the shift in paradigms can be found.

00:01:16 Introductions

00:02:06 How physics led Saahil to programming

00:07:20 Getting started at Microsoft

00:13:39 Analyzing human text input

00:22:22 The exciting paradigm shift in search

00:29:02 Rationales for direction

00:33:40 Image generation models

00:39:55 Knowledge bases

00:45:12 FIFA

00:49:29 Understanding the query’s intent

00:51:18 Expectations

00:55:38 A need to stay connected to authority repositories

01:03:45 About working at You

01:08:18 Farewells

Resources mentioned in this episode:

Join the Programming Throwdown Patreon community today: https://www.patreon.com/programmingthrowdown?ty=h

Links:

• Saahil Jain:
  • Website: http://saahiljain.me/
  • Email: saahil @ you.com
  • Github: https://github.com/saahil9jain/
  • Linkedin: https://www.linkedin.com/in/saahiljain/
  • Twitter: https://twitter.com/saahil9jain
  • RadGraph: https://arxiv.org/abs/2106.14463
  • VisualCheXbert: https://arxiv.org/abs/2102.11467 
• You.Com:
  • Website: https://you.com/
  • Twitter: https://twitter.com/YouSearchEngine
  • Discord: https://discord.gg/f9jRFH5gHP 
• Others:
  • On Thorium: https://www.youtube.com/watch?v=ElulEJruhRQ

More Throwdown? Check out these prior episodes:

• E143: The Evolution of Search with Marcus Eagan: https://www.programmingthrowdown.com/2022/09/143-evolution-of-search-with-marcus.html
• E94: Search at Etsy: https://www.programmingthrowdown.com/2019/10/episode-94-search-at-etsy.html

If you’ve enjoyed this episode, you can listen to more on Programming Throwdown’s website: https://www.programmingthrowdown.com/

Reach out to us via email: programmingthrowdown@gmail.com

You can also follow Programming Throwdown on 

Facebook | Apple Podcasts | Spotify | Player.FM 

Join the discussion on our Discord

Help support Programming Throwdown through our Patreon

A second Jason joins this episode of Programming Throwdown! Jason McDonald – Python evangelist, author, and more – talks to Patrick and Jason about his experience with the programming language, how his disability helped and hindered his software career, and where its strengths and weaknesses lie. 

00:01:05 Introductions

00:02:27 Jason’s pivotal Doctor Who regeneration

00:04:49 The power of dialog boxes

00:10:10 Python’s power

00:12:37 How disability discrimination can look

00:17:40 Making vs playing games

00:23:47 Jason’s POV on intention

00:28:04 Why Jason stayed with Python

00:40:11 Every language’s Thing

00:49:42 Duck typing

00:52:48 Global Interpreter Lock (GIL)

01:14:16 Dependencies

01:34:08 Finding Jason online

01:35:20 Farewells

Resources mentioned in this episode:

Join the Programming Throwdown Patreon community today: https://www.patreon.com/join/programmingthrowdown

Links:

• Jason C. McDonald:
  • Mastodon.Cloud: https://mastodon.cloud/@codemouse92
  • Website: https://codemouse92.com/
  • Github: https://github.com/CodeMouse92
  • BugHunters Café @ iTunes: https://podcasts.apple.com/us/podcast/the-bug-hunters-caf%C3%A9/id1556496590
• Rural Sourcing:
  • Website: https://www.ruralsourcing.com/
  • Linkedin: https://www.linkedin.com/company/rural-sourcing/
• Book Recommendations:
  • Dead Simple Python (Jason C. McDonald): https://www.amazon.com/Dead-Simple-Python-Idiomatic-Programmers/dp/1718500920
  • Kill It With Fire (Marianne Bellotti): https://www.amazon.com/Kill-Fire-Manage-Computer-Systems/dp/1718501188
  • Dreaming In Code (Scott Rosenberg): https://www.amazon.com/Dreaming-Code-Programmers-Transcendent-Software/dp/1400082471
• Others:
  • Monty Python (troupe): https://en.wikipedia.org/wiki/Monty_Python
  • Monty Python (TV Show): https://en.wikipedia.org/wiki/Monty_Python%27s_Flying_Circus

More Python? Check out these prior episodes:

• E52: Scientific Python: https://www.programmingthrowdown.com/2016/03/episode-52-scientific-python.html
• E139: Scientific Python with Guido Imperiale: https://www.programmingthrowdown.com/2022/07/139-scientific-python-with-guido.html

If you’ve enjoyed this episode, you can listen to more on Programming Throwdown’s website: https://www.programmingthrowdown.com/

Reach out to us via email: programmingthrowdown@gmail.com

You can also follow Programming Throwdown on 

Facebook | Apple Podcasts | Spotify | Player.FM 

Join the discussion on our Discord

Help support Programming Throwdown through our Patreon

ChatGPT has made a mark on the world as we know it, but that’s only the tip of the AI iceberg. Join us as we discuss how the field of artificial intelligence is growing – including some developments that might not be on your radar!

00:00:23 Introductions

00:02:01 Jason’s attic adventure

00:06:09 Comparing saws

00:10:57 Patrick’s surprisingly useful thing

00:12:21 SpaceX

00:17:31 Human motion diffusion model

00:20:47 37Signals

00:29:30 Polars

00:35:37 Books of the Show

00:46:11 Neon

00:50:33 Patrick’s player search

00:53:47 ChatGPT

01:17:12 The threat to Google

01:28:06 Jason and Patrick’s future prognostications

01:32:13 Farewells

Resources mentioned in this episode:

Join the Programming Throwdown Patreon community today:  https://www.patreon.com/programmingthrowdown?ty=h

News/Links:

• SpaceX Starship Static Test Fire Planned
  • https://www.cnet.com/science/space/spacex-prepping-for-first-full-test-fire-of-its-mega-starship-rocket/
• Human Motion Diffusion Model
  • https://guytevet.github.io/mdm-page/
• 37Signals Leaving the Cloud and Details Cloud Costs
  • https://twitter.com/dhh/status/1613508201953038337
• Polars: DataFrames in Rust
  • https://docs.rs/polars/latest/polars/index.html

Book of the Show:

• Jason: Build by Tony Fadell
  • https://amzn.to/3wpLnLW
• Patrick: Age of Myth by Michael Sullivan (Riyria)
  • https://amzn.to/3HlEsJ5

Tool of the Show:

• Jason: 
  • Neon: Serverless Postgres: https://neon.tech/
• Patrick: 
  • 7 Billion Humans (Steam): https://store.steampowered.com/app/792100/7_Billion_Humans/

If you’ve enjoyed this episode, you can listen to more on Programming Throwdown’s website: https://www.programmingthrowdown.com/

Reach out to us via email: programmingthrowdown@gmail.com

You can also follow Programming Throwdown on 

Facebook | Apple Podcasts | Spotify | Player.FM 

Join the discussion on our Discord

Help support Programming Throwdown through our Patreon