¶ Intro
Hello, friends, and welcome back to your weekly Linux doc show. My name is Chris.
My name is Wes.
And my name is Brent.
Hello, gentlemen. Well, coming up on the show this week, it's easier than ever to build your own custom live rescue environment. So we're going to take a look at some of our favorite tools and some new ones we came across, then recover some real data and also go over how to build your own. Then we'll round it out with some great boosts and picks and a lot more. So before we get to all of that, let's say time appropriate greetings to our virtual lug. Hello, Mumble Room.
Hey, Chris, hey, Wes, and hello, Brent. And good morning.
And good morning to all of you. And shout out to everybody in our Matrix chat room, too, that everybody joins us. It's a Tuesday on a Sunday, and we have a lot of fun. We've been going now for about 45 minutes or so just to kind of warm up, you know? That's the secret to a good show is you don't just come in cold.
Certainly not.
And we do our warming up live. We also make it available for our members. Also, good morning to our friends over at Defined Networking. Go to defined.net slash unplugged. If you're building network infrastructure, you got to think about the long game here. Manage Nebula is a decentralized VPN built on the open source Nebula platform for people who want speed, resilience, and most importantly, real ownership of the stack that you depend on.
Nebula was originally built to securely connect Slack's global infrastructure, and it still reflects all kinds of that scale-first design today, with optional self-hosted lighthouse nodes for extra control so you manage the
¶ Housekeeping
resilience and the source of truth. I use it, you know, just to host backups between two hosts, and companies like Rivian use it for securing their entire global fleet of cars. The range there is incredible. Get started, 100 hosts for free, no credit card required. Go to defined.net slash unplugged. Check it out. Support the premier sponsor of the show. We appreciate them very much. Defined.net slash unplugged.
Well, next weekend is LinuxFest Northwest. Starts, as you're listening to this, just five days away, which is probably physically less time than Brent has to get here. How about that?
I think I was doing the math, and it puts you roughly at eight-hour days?
No, my math says 10-hour days.
Really?
Yeah, yeah.
I did a little look up here before the show, because, like, someone should calculate this, and I figured I should probably do that. 3,745 kilometers, which in miles is, well, the same. 36 hours, Googs claims.
36 hours Google time, which means probably about 42, 43 hours van time.
Yeah, yeah, yeah. Still possible.
Yeah, yeah.
Just a little time.
I hope everything's in great shape. I would go over everything.
Oh, yeah. I've been charging the battery for the last day because I left it, you know, I left my little tracking cell phone plugged in, and it totally killed the battery all the way down to zero. So starting off.
So road ready is what you're saying.
Road ready. Road ready.
I mean, the opportunity here for a betting pool, you know, does he make it on Saturday? Does he make it after the live show on Sunday? That's good odds. You know, good odds. We'll see. We'll see. But we do have ourselves on the schedule. At least Wes and I will be there. Probably, Brent.
If you want to boost in between now and then, we can kind of see how folks did in that episode.
Yeah, you can make your prediction, and then the sats also go to his gas to get him here. So, you know, it's a win-win.
You should also boost in which part of the van is going to fall apart halfway throughout the continent and see if we win. No, you don't like that. Does that stress you out? Oh, sorry.
Why are you putting that out there? What are you thinking? What are you doing?
Don't put that out there. I'd like a heads up before I get there.
You've got like 45 hours of solid. You have more than the average work week of driving ahead of you and you're putting that out there. You realize you're going to do more than a week's worth of work of driving.
It's going to be fun. You want to join me? You can fly out here. We'll do it together.
Let's do it. If I didn't have other shows, I would. I love you. Also want to just keep putting it out there the BSD challenge for episode six hundred and sixty six, we're still collecting your ideas on how to make that great I think we'll technically probably kick it off in 665 and do the completion in 666 don't you think that's the way to do it we need a little time to yeah and then that's the canonical episode of the actual challenge and the results will be 666 so that's our plan we'd
love your ideas and we'd love you to do it with us too we covered it more in last week's episode in detail and I think the mission will be to try to have all the details pretty solid for you, in probably next episode or so the tricky thing about that is it's Linux Fest so that might not happen but by 6.65 for.
Sure I'll be talking PSD at Linux Fest what's that just kidding it's a welcoming Unix like environment.
Yeah that's true that's true,
¶ Bill O'Reilly Linux
well we were taking a look recently because we have had some system outages, different reasons, different stories, which we'll share later in the show. And so it was a great opportunity to just poke our heads up and see what new tools are out there to build a rescue session on Linux. And there are new tools, some that are coming just around the corner that aren't out yet that we'll tell you about. And they are extremely handy because it makes it possible to extend these things
in ways that wasn't originally possible with these. So before we get there, I wanted to talk about how the Windows side does this for a second, because this time around, I spent some time trying out what is considered the best rescue live session for Windows. It's Heron's Boot CD, and it uses that Windows PE tool to customize it.
And guys, it's great. If you are a Windows user listening to this, or if you are maybe at work in a Windows universe, and you need a rescue environment that is Windows-based, Heron's Boot CD is really good. It's a very customized version of Windows 11. It's the best implementation of Windows 11 I've ever seen because it looks like Windows 2000. It's like all classically themed and everything. Basic standard start menu.
But it's real Windows 11.
Yeah.
That's so great.
Yeah.
Yeah.
I know. I know. It is. It has a plethora of tools, anti-malware and anti-virus, which is something you need on these. Lots of different backup and data recovery tools, hard drive management tools, partitioning tools of various kinds. Hardware analyzers to try to test your hardware or just give you a report. Password recovery, specifically stuff that's designed for earlier and now newer versions of Windows NT, both. I mean, I was telling the boys, it's like it's a kitchen sink.
It's really a kitchen sink of utilities. But in the Windows world, that's kind of what you want because you don't have a go-to package manager. You might maybe you don't have a driver for the network card. So in the Windows world, I think it is really nice to just have all this stuff pre-installed. It makes it one of the bigger live CDs we're going to talk about because it comes in at like 3.2 gigabytes.
Still, that's not bad considering Windows.
And just about every freaking recovery tool that runs on Windows is pre-installed on this thing. And it's well organized.
This is what I've heard about. I just never quite intersected with it in my Windows admin-ing days.
And it's, you know, snarky Linux user here. I'm like, oh, Windows is going to do a live CD. Oh, that's going to be rich. That's the attitude I went in. So I'm sitting, I got my notes up, and I'm like, oh, I'm going to roast this. And I'm like, the first couple of times I couldn't get it to boot. And then I swapped a couple of my VM options, came right up after that.
I mean, it takes a little bit because it has to do some sort of pre-boot hardware detection thing i don't know quite how they're doing and then once windows loads, it has to run some pre-loaded modification stuff to set up the networking all that but it does it all very quickly relatively and it was immediately a great experience so if i were in this ecosystem and i was more comfortable in windows to try to recover data this is absolutely a way
to go and i'll put a link to this in the show notes i ended up spending a lot more time with this than i expected just because i liked it so much um now i.
Wonder if it could be in a nice environment just to have as a quick way to get a windows thing running can you just could you just boot it up in a vm or something if you just needed to do something quick to test on windows.
Yeah i wonder uh i think the limiting factor and i'm not is it like a.
Pe environment is.
It yes okay yes and i and i don't know i don't think you could i don't know if you could sign into a microsoft account like so i don't know if you could install things from the store so.
You might be yeah Yeah, limited in what you could actually get running on there.
But just straight up trying Windows. Yeah, it works for that. It was good.
Or maybe you needed to run a quick random Windows binaries that didn't run a line or something. Not a giant. I'm not saying install Office on there or anything, but just...
Or, you know, maybe you just need a quick Windows VM, right? Yeah. You don't want to... Because you don't have to go through the whole install.
Which is so much fun.
Yeah. All right, now, we have to give honorable mention to the classic. One of the OGs in this space, formerly known as System Rescue CD, now just goes by System Rescue. It's kind of the definitive Linux rescue toolkit out there. Bootable. You go in there, it's got just about every tool you could possibly imagine. A minimal GUI environment if you want it. Data recovery tools. Now clocking in at 1.2 gigabytes.
Not bad.
And I'm going to try to make my case later in the show, but I'm just going to present this now as we get into more.
I don't even know if you can find a smaller than 2 gig USB drive out there.
Well, that's a fair point. That's a fair point. The next one we're going to talk about would still fit on a CD. But before I get off System Rescue CD, they have so much stuff pre-installed. I think these distributions should consider also adding open code to these environments. And I know that's going to sound weird, but I'll try to make my case later in the show. I think they should consider adding open code as a recovery tool.
And I think it matters a lot. We'll come back to that because first I want to talk about Phenix.
I will say, are you going to mention that, you know, System Rescue recently added support for our favorite file system?
ZFS?
Well, I think it does have ZFS support already. But no, BcacheFS.
Whoa.
Oh, that's great.
Just recently, end of last month, they got the kernel up to long-term supported Linux 6.18.20 and the BcacheFS tools and kernel module to version 1.37.3. So, yeah, there's also a bunch of stuff like there's YQ now.
Others okay you got me beat there but phoenix is great if a you're debian first and b you want something that could actually still fit on a cd rom so phoenix clocks in at 577 megabytes it's based on debian i forget whichever one runs linux 616 with some updated packages from that and this also ships now, Fenix as of 2.5.1 is the first version to release a OCI container image.
Ooh, nice.
And I'm wondering what you could use that for. It feels like there's something you could use that for. I'm not quite sure what. But could be useful. And it's Debian-based, CLI-focused, so that's really where they go out with a number of comprehensive repair tools, and they've done things like recently they've turned on ZRAM compression, they've enabled SSH remote access, and other things to kind of make it useful.
I suppose one version might be if you just booted any old random ISO that had internet access, you could pull down that container and then mount in whatever actual disk you were trying to do recovery on, and you'd have all of its tools.
Yeah, that would be very useful. Sort of an on-demand rescue environment. So that's Fenix, F-I-N-N-I-X. Link to that in the show notes. Before we get into what we ran into recently, I want to talk about how this is going to get so easy to create your own in just probably about a year, maybe less. This has been in the works for a while, but Fedora 45 plans to enable persistent overlays when you flash Fedora to a USB stick.
Now our buddy neil has been working on this in fedora since 2024 and his original code he started on this since 2020 so that's how long this feature has been in the works, and the idea is is that when you flash fedora to a thumb drive you leave some unallocated space on that sucker and then by default when fedora 45 boots there'll be a boot menu entry selected by default, by default, that will just initialize that new partition and mount a writable overlay to it.
Now you have a persistent storage to install packages, tools like OpenCode or DD Rescue, whatever it might be that you need.
Or a way even just for some of the stuff those tools write to dot files in your home dir or whatever you could have.
And you take that thumb drive with you and that stuff persists. And the next machine you go to, it has that. It has your SSH key set up perhaps. Maybe it has your, you know, whatever you need to be logged into, logged in, your password manager, whatever it is. It's got it. Super neat. And all you have to do is just leave a little unallocated space on the disc and Fedora 45 will just take care of the rest. And that is going to be such an unlock for building your own custom disc.
And it's not there yet because it requires some upstream work in Drakkut and some other things.
It does make sense, though, talking about sizes of USB drives. Like, if all you're doing is DDing this thing on there, there probably is some space at the end of that that isn't actually being used.
Yeah, when do you not? Right? Like, even a 16 gig, really. I mean, these images are, what, four or five gigs sometimes? Yeah.
You touched a bit on the, I don't know, the complexity, the things needed to get across the line, and I just like the text here and the change.
Since we introduced live media in Fedora Linux 7, the actual mechanism in which the live environment sets itself up has been complex and intricately tied to the method in which we produce the media using kickstarts the nature of the implementation of those scripts means that they are hard to understand and debug which has caused problems in the past whenever we've needed to update them so hopefully this kind of change would
also set to modern you know not only would you get some better features but like better more maintainable plumbing too.
I think we could talk about this when it lands but it's also a great example of I guess on the surface, it seems like a seemingly simple feature. And yet it's been in the works for years and years because of just the upstream cooperation it takes. And it's a great example of a small feature that just takes persistence to get actually shipping. But when 45 lands, 44 is next. So the next release after 44, when that lands, this will just,
in theory, be a default feature. And you just create your own live environments just by using it. I mean, that is going to be massive for just everyone out there. So that will probably be one of the ways you could just make your own with very little fuss. What we're going to talk about is not that. First, I want to thank our members for making this episode possible.
I mean, quite truly making it possible. You can support the show by going to linuxunplugged.com slash membership or support the whole network and get access to all the features for all the shows at jupyter.party. When you become a member, you get access to the bootleg version, clocking in about an hour right now. Or you can get yourself the ad-free version, which still has all of Editor Drew's nice touches and is a little bit tighter.
So if you've got a little shorter schedule, it's perfect for that and you don't have to hear these segments over and over again. or you can just support the
¶ Brent's Bespoke Bail Out
show on autopilot and just do the right thing knowing that this show is made for the community and possible because of the community. And we really do support and appreciate your support and really try to do right by you because of it because you are our number one client. You are the number one customer. Thank you so much. And if you haven't done it yet, it could be a great time with LinuxFest coming up. You can show up and say, hey, I just became a member. Shake a hand.
We'll give you a virtual beer at least because we can't afford to buy everybody a beer. But the sentiment will be like we got you a beer, right? Yeah let's go with that yeah.
Sure sure sure, Well, I decided to do it not that way. Why would you do it the standard way when you could do it the non-standard way? Really, this whole rescue USB drive has been a progression for me in supporting family members mostly. Years ago, when I set up my parents and brothers and other family members on Linux, I thought some stuff occasionally goes wrong.
Sometimes hardware sometimes you know they're traveling and you get run over you know your laptop gets run over by a dump truck or something like that and i always wanted some way to be able to help family members from a distance if their computer goes down because i felt responsible if i'm going to switch you to a new operating system that i tout as you know better then i want to have some way to help you if it's not better um so i have always convinced uh everyone I moved to Linux to always,
always, always, always, always carry a live USB drive that's dedicated with Linux on it so that something goes wrong, you can boot into that thing and I can help you. Now that has been very useful. And I have to say, people have followed that advice quite nicely because they typically forget the USB drive in their laptop bag. And then like a year and a half later, I'm like, Hey, do you have that USB drive? Like, Oh, do I look for that somewhere?
And yeah, it's in your bag somewhere. You just got to find it. And sure enough, it saves the day. But the hardest part I always had was that these were just live drives. And so they were always vanilla. So whenever I was booting it up to try to help someone, I was like, okay, I need to now spend the next 15, 20 minutes guiding you through connecting it to the internet, getting me SSHSS or some kind of remote access, maybe through something like a Rust desk. So that process I wanted to eliminate.
And I started working on that recently where.
I iterated this concept and instead of having a live drive on a usb just installed linux to the usb yes that is a terrible idea most of the time but with a rescue drive you're only booting this thing up well hopefully you're never booting it up but if you need to you're going to boot it up once or twice maybe a year right so drive longevity with having a whole operating system running off of just the flash drive is a bad idea generally but in this particular case i thought that's
maybe an okay compromise talk.
To me a little bit about before you go further because.
I actually.
Just did the same thing for my process i thought why am i using these custom why not why don't why don't i just install to a thumb drive and then have something i can install tools to and whatnot did you like download a distro installer and run through the installer and point it at the thumb drive or did you.
Like do an image.
And flash it what was your process for that bit right there.
Well in this iteration i just installed directly to the flash drive so just treated that like any old install nothing special just said hey please install you know please install Linux to this flash drive. And then I did a couple things like connected it to the Wi-Fi network that they use most of the time and logged into my mesh VPN and things like that. So that at least I had a couple of default tools available.
And so then it was really just another Linux system on a flash drive that you could plug into any computer and it would boot up and have a couple, you know, pre-setup configurations just to make the process easier.
How was the performance?
Well, you know fine in a rescue situation but you know you're running off a flash drive so that's not great and what i ran into was it works great until you feel like you need to update that drive yeah so yeah yeah so i made one you know for my mother which she carried and forgot about which is perfect and then i was like hey i'm around like maybe i can update your flash drive to something more modern considering it's a year
and a half old and we should have some modern linux on there and i went what.
A good son what.
You know i know i'm thinking ahead and then the update process was oh yeah painful because it's been a year and a half so you're replacing every single package on that thing and that is the exact thing flash drives are terrible at is the random, you know, rights to all over the place, it took forever to the point where I thought, I need to iterate this idea again, because this is not working for me. So while I was waiting for it to update, I was like, there's got to be a better way.
So turns out, of course there is. So my next iteration, which I'm always looking for advice, you help me make this better. But the next iteration just worked on that idea and did a bit of a hybrid. So I used Nix OS because Nix OS is It's really great for building your own custom versions of something. So I already have a Nix OS configuration for my mother's laptop. But then I was like, well, I just want to give her exactly what she's used to, but trim that down to just the essentials.
And then let's do some other crazy stuff. Like maybe we could just boot the entire thing to RAM because I don't think we need to be using the flash drive at all. Right. Just use it to hold the information and transfer that somewhere more useful when you're booting up the system. So sure enough, that is extremely easy to do. And the other way that helps is her current laptop only has one. It's like a really super slim, low budget laptop.
She freaking loves that thing because it doesn't weigh anything, but it only has one USB A port. So if you're plugging in a live USB drive, perfectly fine. But if you want to do anything like plug in a backup hard drive or something like that you can't so moving the entire system to ram means you can pull that live drive out and the system still runs perfectly fine so that is a big plus as well and other nice things like um.
Not installing to the drive but creating an image instead using the nix os installer iso so you can use installation cd base dot nix module which is exactly what the nix os installer uses and there's just pile on top a few of your custom configurations so i just somehow managed to craft my own Nix OS, not the installer, but a specialized Nix OS live boot environment with my own customizations that automatically logs into my mesh VPN. It has recovery tools on there that I like.
It even, you know, boots up fish on the terminal by default for me.
And it has custom.
Extensions in Firefox and takes out a bunch of plasma stuff that I don't need by default on a rescue disc and it's fantastic.
Nicely done this is very very similar to what i did based off my desktop for my recovery process i was like i just could take most of what is my desktop strip out some of the ancillary desktop applications and flat packs and then i have all the tooling i need i have all my keys let's go like it actually worked really really well but i did not do your copy to ram idea which i think oh you gotta take that one yeah yeah.
Wasn't that easy that's one thing i haven't done either i mean i've done it in the past with other isos but not in the combo.
With this.
Particular setup yeah i've used this trick for years actually um ubuntu certainly has a kernel option just called to ram.
That you.
Can use so at boot even if you're just on any live iso at boot you can just, change the kernel parameters before you boot and add to RAM, and it'll do that for you. So that I've used specific. I learned that specifically for my mother's laptop because it had this one USB problem I had to get around. So that was, that was a really nice trick. In NixOS, it's slightly different called copy to RAM, but, but it is a trick that the Linux kernel has been able to do for a very long time.
So it's a, it's a nice little thing to keep in, your hat.
It is really nice in a rescue environment to have things like your preferred desktop environment, to have the ButterFS tools, or to have Firefox, all these things that you kind of need to really get a system up and going. It's nice to just have that.
Yeah, so you don't have to spend a bunch of time every reboot reinstalling it.
Yeah, exactly. So now you have something you can keep, but how do you keep it up to date? That seems to be the next level of this would be something that would auto update somehow. Like my thinking has been, what if instead of a thumb drive, next time I install a system, the first thing I do is I install a rescue system in a little partition.
Yeah, that's something I've done before and liked a lot.
And then I install the rest of the system as a separate install. And then maybe there's a once a week reboot into the rescue environment that updates the rescue environment. And if the update is successful, then reboots back into the main environment. That's the bit I'm.
You could probably set up a setup where you like flashed it instead if you wanted to. If you isolated the stuff you wanted to keep.
That's a great idea. You build it, update it on the host system, and then you just flash the update.
Yeah, which could also maybe work if you were still doing a USB drive too. Again, you'd want to make sure you separate it out with partitions or some mechanism for the data you wanted to keep.
And just leave the drive plugged in. And then you could just update it that way too.
I believe Pop! OS implemented this kind of feature when they first came out and users loved it.
One thing i would argue although i most of the reason i was trying to trim down this image as much as possible is that flashing to any usb drive is just slow and painful and you should only ever do if you really need to um but i it also saves for the use case where if you're on the move and you lose a laptop it gets stolen you drop it in the water or something like that Maybe you still have a USB drive and you can install on a new machine you get, you know,
at Best Buy or something just on the go. If you have a partition, obviously you can't do that. If you, you know, your entire laptop gets stolen or you left at a coffee shop or something. But you can easily have both solutions, I think. Yeah.
Sure. Well, that's, it's funny that you and I kind of both went down the same path, but you had success. You did recover pretty much all the data that you set out to recover with, uh, when you were working on a separate issue. So tell me a little bit about that because I think you told the members, but I don't know if you told the audience that you were doing like two weeks of drive recovery spelunking too. Just give us a, like the quick recap on that.
Yeah. When you love your family, uh, you do crazy things for them.
The things you do for your brother.
Ah so when your trend brother says hey i got some old you know hard usb hard drives i've been backing up to for years now all of a sudden today they don't seem to you know be behaving like they used to so i thought okay i'll i'll spend you know an hour helping him recover some data off some old hard drives that he's been backing up to that i think i probably suggested that he do that years ago and uh, Well, I was able to successfully use OpenCode to help me just like test my assumptions
on how I was going to approach recovering data. Luckily, I was able to do it from a distance and I had a server already built there that I should have moved all those backups to years ago.
Okay. So you had a remote box.
I did have a remote box with plenty of storage in it. Just sitting there waiting.
Okay. I got you. That's handy.
It is super handy and then like you had made.
You had made some assumptions about how you're going to recover the data and then you you're like hey i'm going to run it past the machine see what the machine says.
Yeah so he was getting a couple read errors so i thought okay one way to do is just you know use our sync to pull a bunch of data off but i'm going to run into read errors obviously i could log those and then investigate later but then you know there's smarter people on the internet who've done it probably better than i have so it turns out dd rescue is a fantastic tool that's perfectly built for this use case i'd heard of it forever never used it before i always planned
hey next time i want to do this i'm going to use dd rescue but i'm not familiar with it so, having a little i have to say having a little open code wrapper around some of these like, bulletproof tested tools for data recovery is so nice because i could just think about the big picture. And then the implementation detail about which flags you need to use for a tool that you haven't used before, I didn't need to think about.
So I could just worry about, are we keeping the data as safe as possible and where to put it, how to treat it, what is an acceptable level of risk while doing the recovery? And then the implementation was just taken care of by the computer, which is a really nice way to do it.
So it was sort of pulling the strings on DD Rescue for you.
Exactly. So I could say, okay, let's use DD Rescue, but. Treat the drive really kindly. It's a USB drive. It heats up. So let's reduce the bandwidth that the rescue is going to happen so that we don't heat this thing up. And then of course, when I told my brother, I was making good progress. He was like, Oh, well I found, you know, four other USB hard drives in my closet. Would you pull the data off those two? So, uh, I said, yes, cause I love my brother.
And, um, but that meant I could get open code to help me just write some scripts to so that i could just check in every couple hours and say okay well pull all the data off all of the drives but do it sequentially and uh there's different file systems on here so use check tools for the different file systems in line before you do the recoveries and while you're doing the recovery reduce the bandwidth for all the drives because because they're all usb drives but uh
you know so don't saturate the usb either because i don't want the usb bus to like fail for some reason four hours into the recovery of all these things so it was nice to be able to put like safe parameters around both the hardware and the data on disk and the software to just do this as a gentle recovery from a distance like i'm literally thousands of miles away and also to get a bunch of really sweet looking reports about how the rescue went and all that stuff so yeah great experience and.
You got the you got almost all the data right you got like with with.
Yeah i got 99.889 percent of the data, You know, that's not so bad.
Not so bad.
And a happy brother, I'm sure.
Yeah, I'll still have to break to him that one of his files isn't working.
Well, when you do that, what you do is you go over to like DriveSavers and you just get them the cost to do data rescue from DriveSavers and then be like, but I did it for free. I just didn't get this file. You know, like that's not so bad.
Buy me dinner sometime.
Yeah. Now, Wes, I know you've been messing around with a few things kind of adjacent to this area as well recently. And we have some cool tools linked in the show notes. What from that batch do you want to talk about?
Yeah, well, I will just say that it is kind of delightful how easy NixOS makes it to make your own, where you can build an actual ISO or have just a system that you can flash on with an IMG file or just be able to mount or whatever. I was just looking, because I need to update mine based on your two's brilliant ideas, because I tried this, I don't know.
A year and a half ago two years ago yeah but it's under a hundred lines of code because there are just these modules as brent was talking about that you can import and then the rest is just as much like you can go all the way to having like a most of a full desktop or you can have a minimal system that just you know presents a cli that shows up on your mesh or whatever.
But i was kind of musing on like you know what is what would you want in terms of like an installed system on your host or on a usb drive there's also now you know we live mostly in like an efi world maybe you want to have legacy compatibility, maybe you don't. It kind of depends on the fleet you're trying to support and all that. And we live in like a world of UKIs and other things where maybe you could have just a single file that you drop on your EFI partition that you boot into.
And I was kind of looking around to see what people were doing. And we've used Ventoy in the past, but, you know, it has its quirks and issues and skepticism, rightfully so.
And there's like a lot of baggage and history with Ventoy. And I was interested to see that there was sort of a new project i hadn't heard of called aegis boot that i think plays a similar role that you guys might find interesting okay it's a tool that creates usb rescue sticks capable of booting any linux iso while keeping uefi secure boot fully enforcing unlike alternatives like bento umi multi-boot usb they're required disabling it or enrolling custom keys aegis
boot leverages the same signed boot chain that distributions already use. So it uses the Microsoft signed shim that a lot of distros are using, and then it's using a canonical signed grub and their kernel, and then it boots a Ratatouille Rust Rescue Tui. And it has some custom code to go hunt around. So it's a two-partition setup, kind of like how Ventoy does, right? It's got its system code and the EFI stuff that it boots into.
And then it's got an ISO area you can dump these files onto, and it mounts and scans the ISO files to find the Linux kernels and the parameters for them.
And?
And then, because this is a project I'm highlighting, it presents them to you. It checks them out to see if they're signed and you can actually boot them or not.
Yes.
And then when it goes to boot them, because you're already running Linux, it uses kexec.
Oh, yeah.
There it is. Aegis boot. So this is potentially a Ventoy replacement, maybe a little more modern.
Yeah, it's a single Rust EXE you can download. They have some different profiles if you want it to pre-download a bunch of ISOs onto the drive. It's all in one sort of flashing tool that's available as part of it it has nix os windows arch linux fedora all kinds of support very cool.
Well leave it to west to find the most modern tool using the most uh i don't know interesting and fun tooling under the hood chris i feel like we gotta catch up again this week on the tooling that wets is using i know like well.
I want like a hybrid of yours.
And west's.
Setup well i think.
You can get.
That because you could you could make the USB with this Aegis tool, but then put your custom NixOS or whatever ISO on there, and then it would just boot it.
The only thing you boys aren't considering, and it's a project we talked about a long time ago, so fair enough that it's easy to forget these things. We've talked about so many of these. But do you remember, I think it was netboot. I'm going to it right now, XYZ?
Oh, yes. Netbooting was another thing I wanted to mention as part of this, although it's a different whether or not you want to rely on the network.
Right. But if you've got a machine that supports network booting, which is like all of them, you can run netboot and I actually do have netboot.xyz running in a container on my network you do have to have DHCP and all of that giving out it's a little bit to set up because you have to have DHCP that can give out like the TFTP server information and the information to boot off of the IPIXI server, But if you have the ability to set that, then you can have a network boot system
for all your systems on your LAN and just choose the network option and they will discover this and boot the ISO image you have queued up.
Also another one where if you didn't, depending on your firmware, you can also drop like a UEFI thing that does the Pixie as well.
Yeah. So I was wondering, I mean, could you have Aegis in there too? Like there's a whole, like I'm just thinking with NetBoot, there's a whole angle to this that could take this to the next level where you wouldn't even need a custom partition. Or a thumb drive if you're just working on your LAN. And that, to me, that could be a real unlock. If anybody out there has that setup, send it in.
You can almost imagine you're Pixie to Aegis, but then it's Linux, so it can sort of mount the Samba share of your ISOs, and then it kegs X into one of them.
Oh, that's glorious. That's glorious.
I was just wondering how modern Aegis actually was, since I called it modern. And it looks like the project is very active with the last commit eight minutes ago. So Wes is right on the most modern activity here.
I've tried it all of once last night, so I just found it. Tester beware.
Yeah, it looks old. I mean, it looks new. It does look new, but it looks very promising. It's a good find, Wes.
¶ Shout-Outs
We have several ballers this week, but at the top of the list, Greg the Lawyer sent in three boosts with a total of 122,345 sets.
Wow. Thank you, Greg.
I started listening a couple of years ago when I got back into Linux after a long break. I was very pleased to discover the world of home labbing and to see how far Linux had truly come. My first distro back in the day was Slackware. When I returned, I tried Debian and Fedora and then landed on Arch for quite a while. Thanks to you guys, I'm now on that Nix OS train. I'm just getting started, but I really like Nix. Everything about it is so intentional.
Everything I add is documented because, well, it has to be.
That's true. I do love that. It's great for people that are very, very implicit about how their system must be set up to every detail. And it's also great for people that cannot remember at all how their system is set up.
You wouldn't know anyone like that.
No, I wouldn't. No, I wouldn't. Oh, man. Thank you, Greg. Appreciate that very much.
Yeah, Greg, I have the full, it kind of got cut off. I have the full one and Greg links to the next OS config repo that he has. So we can include that.
Thank you, Greg. Appreciate that. All right. Our next baller is optic gray and he came in with 88,888 sats. That's great. Forgeo sounds like a great GitHub alternative, but why not use GitLab locally hosted?
That's another good option for sure. GitLab's like a little more enterprise-y in feel and sort of setup and components and stuff. Totally doable to self-host, but Forgeo is just a really easy sort of like turn on one Nix OS service, and it runs like a mostly single sort of systemd thing.
And the front end's a lot like what you would expect if you were just coming over from GitHub as well, which is nice.
I have used GitLab a lot, so that part would be fine. I like GitLab.
Well, there's a lot of free software projects that we use that are just on GitLab. So it's definitely a great option.
Yeah, and there's a lot of, you know, there's more forges than that too to consider. That was just one that I knew had functionality that I liked and was easy to get going.
Also just shipped an update after our episode.
That's true.
So a new version is out.
Well, the DudaBinds comes in with 77,777 cents. Hey it's been a while i wanted to boost so many times but i didn't have the time we understand, for the stage four bsd challenge i say you test how gaming works you pick a game that's supposedly supported in bsd and you get points for managing to install and play all right i'll try to participate i have a dell xbs and an x260 lying around nice and then for what it's worth, I like the AI content So.
The dude I'm writing this down right now Level 4 Chris frantically writing Taking notes Thank you sir that's good.
Where'd you get the fountain pen?
It is dipped with the blood of my enemies Adversaries 20 Upgrade, Adversary 17 comes in with 20,001 sats He says I think the other host name was Alex or something like that Oh, okay, I'm reading them out of order, I see. There used to be a podcast about self-hosting that was really done well for many years. There was an episode about a self-hosted Code Forges, and other ones mentioned DC roasting us, like Git T that automatically mirrors to GitHub.
I think one of the hosts had a name like yours. There might have been another one in there, something like Alex. Oh my gosh. Atversaries 20, roasting me.
Does send in a good link to episode 129 of self-hosted Forged Alliance.
There you go. talk about some get tea in there sounds good.
Spooky set come comes in with 10 000 sats, live boost woohoo.
Hey thank you for the live boost this.
Was from uh last week.
That's awesome it's always nice getting those live thank you set come goofy.
Ambitions boosted in one two three four five sets, Hello, Chris, Wes, and Brent. I'm a Jupyter Party member, and I primarily listen to your show to get insight into new open source tools that will be useful for me. I'm currently listening to 661 for the second time, and I just wanted to say, keep up the good work. I really appreciate your content on OpenAI Agents and NixOS. Yes.
Goofy, thank you for both the membership support and the feedback on that.
Mm-hmm.
Thank you very much. Appreciate that. JQube3 came in with 16,482 sats. I really enjoyed this episode and would love even more in-depth coverage like it. I enjoyed all your AI coverage. I know it can't all be AI all the time, nor should it be. I think you guys are doing an excellent job. Keep it up. No, thanks. Great. You know, and we are, like the last two episodes, it's come up, but it's not the topic of the show. Thank you for the feedback, everybody. That's good signal.
It'd be interesting to see what the vibe is at LinuxFest Northwest. Wouldn't that be interesting? See if people are talking about it.
Podbun bussin with the road ducks. Maybe the chapters could be more granular and include specific topics such as AI or Nix for the people that complain about too much of either. I don't mind the topics, but some of the nerdy stuff does go over my head.
Shout out to Editor Drew's excellent chapter titles and always really great. You could see a fun project where there's like a GitHub post or maybe a 4GO of our chapters JSON that could get iterated on by the community. Oh, totally. You could go in there and publish it and update it because it's just a JSON file. That's the beauty of the cloud chapters.
I would also say if the nerdier stuff goes over your head now, it's still sinking in somewhere. And if you pay attention, that nerdier stuff, you will understand more and more and more of it. That's just the beauty of hanging out with a bunch of nerds. Well, Daja boosted in 6,969 Satoshis. Oh, does anyone else have that problem of the boost audio clips slipping into your everyday vernacular? Well, I've accidentally dropped, they're doing a lot with mayo these days.
And that is a tasty burger in several conversations without even thinking about it. I just called my coworker a rich lobster. I guess it's just a sign of how integrated JB is into my life.
I love it.
Well, it happens to us.
That is another boost here. One thing that gets lost in the license conversation is that, as it currently stands, LLMs are just large license launderers. One of the great things about copyleft FOSS is that you know that all derivations will continue to benefit humanity by also being FOSS. But as it is now, we lose all freedoms as soon as someone makes a proprietary derivation using an agent.
Roll over and take it because they're going to violate your code and the freedoms of your users anyway isn't a very good stance. And neither is put up a bunch of useless walls that also violate your user freedoms. It just feels silly that the two leading arguments on the subject break FOSS ethos in different ways. I think if we can get both sides to come to an agreement on an interface that lets AI access the code and also respect the license, we could get the best of both worlds.
Even if it's just a setting that you can give to your agent to include or exclude source material that is compatible with the license of your project or something similar. If you're also writing GPL, go ham. If you're writing proprietary, then you can consciously make the choice on whether or not to abide by that license.
That's another benefit to something like that would be that folks at companies that block copyleft dependencies can actually enjoy all the fun AI stuff we have without worrying of getting in trouble. Of course, that's all really easy to say than to do.
It is easy to say, like you could see just it could be a markdown file or HTML file or a dot file that just says, you know, don't train. It could be very simple. But I wanted to maybe reframe this a little bit, because I think maybe that's where you're getting hung up and having a hard time squaring it. And I think when you can't really square it, maybe that's an opportunity to see if you got the math right.
And Wes, I'd like to know your input on this. But I think there is a broader question that has to be answered before this particular situation can be sorted out. And that broader question is, what is code laundering? Is an open source developer that goes to Stack Exchange that gets inspired by a post on Stack Exchange and writes a similar equivalent version of that in their own code, was that code laundering?
And if that is the equivalent of what an LLM, is it code laundering when the LLM does it based on your request? Because it's not Google or Anthropic that's asking the machine to do that. It's the user prompting the machine to do that. But the user would also be going to Stack Exchange and just aping what's on Stack Exchange or an example they find on GitHub. And we don't consider that code laundering. We just consider that to be standard
practice, how you develop software. I'm curious to know what you think on that nuance.
Yeah, I mean, there's just a lot of nuance to go around because there's different questions. There's the training time question and how that works and what code was used there and the statistical nature and how you think that the system works and the actual outcomes of all of that, right? And then there is now this question of agents in practice and what if you have one agent that sort of reads the code and outputs a spec that is an arguable
clean room sort of thing and then you have someone else do the coding. Does that work?
That's a whole thing. There's just all kinds.
And so there's just a lot of, I do think Daj is right that we have not really maybe got to the part where a lot of the norms and expectations have adjusted. And we need to keep having these conversations because there are a lot of nuances and sort of things to discuss. So I appreciate the thoughtful response.
It's almost like if we locked in something now, it would probably be too premature. The thing continues to move forward while we're figuring it out.
It sure does.
Yeah, that is it right there. Great boost. Thank you, sir. Gene Bean comes in with a row of ducks. I've had a basic Forgeo instance on Nix for a while, and I've had it offing via PocketID, and I'm pretty happy with that.
Seems like a nice setup. PocketID is a cool little sort of minimal OIDC provider for auth stuff, but it just uses passkey, so it's super simple.
I'll take Arctic, too. ArcticSpender comes in with another row of ducks. For the love of all that is holy. You guys, enough about AI. I work in IT and I'm sick and tired of every vendor talking about their AI offering. You can't spell failure without AI. I stopped listening about halfway through this one. Please don't give me a safe haven where I don't have to hear about the joys of you know what. You know, it was interesting. I was having a conversation with the wife last
night. And she finds some of these tools useful for her small business. At the same time, absolutely hates that the vendor software she's using is shoving it into like. She has a field for like filling out patient chart notes and they've literally put an ai wizard in every field oh of the text field which now occludes all of the text you can fit in there so she can't read all the text in there and none of it's useful.
It's extra javascript that's just kind of.
Floating around there's like tons of hipaa concerns that they haven't properly explained to her so she's not comfortable with that yeah of course right and it's like so she is both like boy it's really useful as a small business owner for some of these things and boy I really hate this, so I get it Artic I get it thank you for that feedback appreciate that hey Mr.
20's back yeah this is a duplicate boost but we still got the SATs so we appreciate it 10,250 thank.
You adversaries you are great.
But then Woodland Geeks comes in with a row of ducks and an opportunity for you Chris though I think you've already talked about this on the launch maybe oh it was a pre-show, members you get the good stuff I wanted to share this link. I'm sure you guys are on top of this, and probably will show up in the week's episode, but head to share. You can see many different sides of what is going on here. Chris Rant opportunity.
Talking about mythos.
Yes, and it's a link to a Forbes article, What is GLaD mythos and why Anthropic won't let anyone use it?
Mm-hmm. Yeah. Yeah, yeah.
Well, there's a dude here trying stuff and succeeded in sending a row of ducks. First agents, now private GitHub replacements. Y'all are reading my mind. I'm currently starting my home lab from scratch over again on a new computer. And I see infrastructure as code and AI are my two primary focuses. It's great to hear y'all's input on that. Please keep it up.
Dude, that is such a fun time. you know when you're rebuilding like with everything you've learned yes it's a lot of work and for me it would be a crushing overwhelming amount of work but it's so fun when you actually like it's like how i dream of i would never do this but i dream of building my own rv taking everything i've learned and just building the ultimate rv you know that would.
Be a real.
Please keep us posted i'd love to know how that goes and glad to hear we're helpful we'll keep trying to do so and if you screw something up now you know how you can rescue it, Magnolia Mayhem came in with 2,000 sats and says boost thank you Mayhem appreciate you.
Tom Otto comes in with 5,000 sats, I love the episode 666 demonic challenge plan. One idea for a challenge would be to run Linux binaries or even a Linux container. I think Brent in particular might enjoy NetBSD on some dumpster hardware. They can run on remarkably small machines.
He knows your taste.
I think.
He does know your taste. You do like those dumpster machines. That's a great one. I think I feel like maybe not hard enough because they have the Linux compatibility layer, which gives you a lot.
You do have to set that up.
You do and that could be the challenge also what i find and this is just me coming in with my preconceptions and bias eyes but what i find is the bsd guys love to talk about stuff working great oh that's a solved problem and then you go to use it and you realize it's about a 20 or 30 solution that they're fine with but if you're used to something on linux is inadequate maybe it'll be like that stay tuned to find out.
Boost in now complete noobs did boost in with a row of ducks. It's just a link to a website here, v4call.com. v4call.com, Complete Noobs Project. It says, this is a .0.1 concept phase. Use at your own risk. Wes, what did you figure out here?
Well, I found an info page. v4call is a decentralized video voice and text platform built on the Hive blockchain. Users set their own rates for receiving calls and messages. Callers pay with Hive's stablecoin or custom tokens.
So it's, okay, video and voice. All right, on Hive. Interesting okay there you go v4v call our v4call.com well i do need to come up with some sort of call system for the launch you know because i'm paying for a hosted solution out of my paypal account but my paypal account's been frozen because i used it how dare you i know so yeah.
That's the mistake really.
Yeah that's what i get that's what i get so now i have to go through like a 20 point identification process i'm not even kidding i think it's like 17 different documents and like several questionnaires uh to get access to my account so that way i can pay the bill to use the thing to use the call service so yeah i probably should work on that but you know next week's linux fest so thank you everybody who boosted in and makes the show
possible also sends us the signal on the episode you really have no idea how much it really means to us it really is something and also thank you everybody who streams sats as you listen 18 of you did it collectively you stacked 58,035 sats that ain't too bad y'all that ain't too bad when you combine it together, though, with our boosters. We really have a good one this week. Very grateful. We stacked, 444,740 sats!
Wow.
Yes. Fountain FM makes it really easy to boost these days with Fiat or SATs. And of course, there's a lot of options if you go the self-hosted AlbiHub route. Newpodcastapps.com will get you started on that. And you send in a boost over 2,000 SATs and we will read it on a future episode. And it means a lot. Your split goes to myself, to Mr. Payne, to Brentley, to Editor Drew, and to the podcast developer. And a little bit goes to the Index as well. So it supports the whole ecosystem.
All of that is in the RSS feed, open to you in the public. You can view it. You can audit it. You can see if that ever changes. That's just a little bit of how we do this.
¶ Picks
So before we go, we got a smattering of picks this week. I found a GUI to clean out metadata from various files. You know, there's so many things that get just embedded in documents, PDFs, images, especially. And Metadata Cleaner is what it says right there on the tin. It is a GTK GUI to go through and identify the metadata in a picture file, a text file, a video file, whatever it might be, and then help you strip that metadata out before you share it. And it is available on Flathub.
And it's pretty lean, pretty mean, not much else to it. Very simple UI.
Speaking of GitLab, it seems to be primarily hosted over there.
Yes, and it is GPL3. So that is just called simply metadata cleaner. But Wes, you've been messing around with something a little different.
Yeah, well, I also kind of had this need. I mean, I have had for a while, but just decided to solve it a new way for whatever reason. So I searched around Nix packages as one does and i found mat2 which is just a convenient little cli metadata removal tool you.
Just pointed out a file kind of a thing.
Yeah i put a little sort of demo here in the doc um you can just run it right from nix packages with nix run if you want but uh yeah you just kind of tell it what file you want you could pass dash s just to show the metadata so here's like a um an example from my phone you can see a bunch of details that i probably don't need other people knowing necessarily great for your own archival stuff perhaps right and then all you do is you run it with no arguments by default
it just makes a new it adds like base name dot cleaned so you get like okay image dot clean so you know that.
One's safe that's the one you share.
Yeah so it doesn't touch the existing files it just makes a bunch of new files in there it's easy to automate with something like x args or parallel or you know those kinds of tools so it's clean simple easy to use i.
Do like the idea of just it's on the command line run it real quick don't.
Wrap it in a script if you want and you know so you just do it on regular files you intake things through yeah.
Of course, with these days, you could probably still get a lot of information just from the stuff that's in the photo, depending on where you take it. But it's good at least clean that up, right? Now, this next one's making some news. So we want to take a quick look at it for you and mention it because it's one of these quintessential macOS apps that's actually come to Linux this week. And it's called Little Snitch.
And you might be familiar with it. Every time an application on your computer opens up a network connection… It just does so in the background without you knowing, which is fine, right? But wouldn't it be kind of interesting to have insight on what's opening up, what applications are doing what, and kind of how much data you're using? Linux didn't have this with Little Snitch until they released it. There used to be a Mac-only app. Now it's available.
You can see exactly what applications are talking to what servers. You can block the ones you don't want talking to those servers. You can keep an eye on historical data and the amount of traffic volume over time. The connection view has a lot of interesting things on there. Current and past network activity by application. shows you what's being blocked by your rules and block lists and tracks data volumes and traffic history. This will run on any Linux distribution with kernel 612 or above.
It's not quite equivalent to the macOS version. It is missing a few things, mostly because of the limitations, for better or for worse, I think for better, of what eBPF will allow some of the tooling to get access to.
And yes, it is powered by eBPF.
That's right. So you actually got it working there on your machine.
Yeah. It is like the license situation. There's a bunch of open source parts, but some of it is still proprietary. I think maybe ported over from the...
View and shareable, but proprietary. And so it's like the backend stuff is free. The only thing that's, I think, proprietary is maybe some of the GUI stuff, but it's viewable and shareable.
So there you go. But they provide precompiled binaries you can just download for Linux. So I was able to download those and not too much work, a little patch elf, got them running on NixOS. So I made a, well, had OpenCode help me make a basic little slake for that on my GitHub. So it was easy enough to run. So that means it'll definitely run on most standard Linux distributions quite easily, I think. You run it. It comes with a systemd service already with, like,
nice, exactly the permissions it actually needs. Or you can just run it with sudo if you want to test it out. Because it needs some of the, like, you know, sysadmin, or not full sysadmin, but needs some of the network admin permissions to be able to hook things in and all that. And then it runs a daemon in the background. So you pop it up as a web UI,
port 3031. and you can see i put a picture in the dock they're kind of clean looking modern ui with a nice feels responsive drill down breaks down a lot of the different traffic there it, I automatically detected the stuff I was pulling down from Nix as I was building something in the background while I was trying it out. So that was fun to see.
Huh. That is kind of nice when you're doing a system update or something and you just kind of want to watch. Like I'll often use bottom for this. I love bottom. But this is more specifically network level, which is great. Did you try blocking anything?
No, not yet. I am curious to try that though.
Hmm. It is neat to see one of these quintessential Mac apps land on Linux. Even if it's not fully the same. With all of these Mac users switching over, it's great timing.
It really is. And I mean, kind of a long time coming. There'd been other open source sort of like attempts at this kinds of software that we've even talked about on the show. But I do wonder what it says that now was the time that it moved.
Me too. All right. Who snuck in PCAPDroid? Who snuck that in here?
Oh, I snuck in a little bonus pick on the same topic as Little Snitch that I found recently for Android.
So this is a privacy friendly of course open source of course but it's an android app that lets you also do similar things track analyze and block the connections made by other apps on your android device and you can dump the traffic inspect the http decrypt some of the tls traffic if you want all sorts of stuff i use this to just well you kind of get curious what's your cell phone really doing in the back and especially my cell phone i'd.
Really like to know what my cell phone's up to yeah.
It is every single time you do this on any device you it is mind-boggling and very enlightening so i recommend you pick up pc ap droid just run it for like an hour and see what the heck's going on on that device of yours pcap.
Droid and we will have a link to that in the show notes that's a nice find gentlemen so now we'll.
Have more info uh not only on our desktops but on our mobile.
Devices we're cleaning up your metadata and protecting your network this week while also rescuing your data. It's a very utility-focused episode, I guess.
Or we're having a lot of problems behind this week.
We've got to play it off. We've got to play it off. No, this wasn't that at all. We're getting very, very excited about LinuxFest Northwest. It is next weekend.
¶ Outro
What?
Yeah. So you will get the full report from the Pacific Northwest's largest community-run Linux event and one of the OGs going for... Something like 25, 26 years now. I don't know. I don't know how long I've been going. It's been a long time.
It doesn't feel real yet, but it's going to be great.
I have been going to LinuxFest Northwest since I've been in high school. And I'm a little out of high school now. So that's how long I've been going. Woo! The first time I went, I went with a high school teacher of mine. That's wonderful. Yeah.
Let's keep it going.
I mean, there's a reason I keep going every year, right? You don't go for 26, 27 years unless maybe 28. I don't know. I don't know what it is. You don't go for that long unless it's really something special. So I hope to see you there. Lfnw.org if you want more details. We'll put a link in the show notes too. And of course, you can always make it a Tuesday on a Sunday. Wherever you are, you can join us live 10 a.m. Pacific, 1 p.m.
Eastern. We may be somewhere around there a little bit because we have a live. We've got to do a lot of setup and all of that. But jblive.fm or jblive.tv will be where you can catch it if you can't make it physically to LinuxFest Northwest. Now, Wes, before we go, we should tell people about some of the cool advanced features we have around the show, because it's not just audio.
Yeah, that's right. We take advantage of the podcast 2.0 namespace. In particular, that gets those mighty fine cloud chapters we mentioned earlier on. Dynamic JSON delivered to you just when you need it. And if you want more information, check out our VTT files. Those are also found in the feed under the podcast transcript tag.
It is neat, too, to see more of these, particularly these ones we just mentioned, getting picked up by more and more vendors and whatnot, including even Apple Podcasts, which is amazing now. So if your podcast client doesn't have support for this, you should message the developer and let them know that they've been beaten by Apple.
It's all standard stuff, right? VTT, SRT files. There's lots of open source libraries folks can bring in to help make use of this stuff.
And the other one that hasn't seen as much traction, but it is an app like Fountain and Podverse and Cast-O-Matic, of course, is live stream support. We are live every single Sunday. There's not a lot of podcasts that do that anymore. JBLive.tv and FM is also where you can listen to it. And we have links to just about darn near everything we've talked about. We try to catch it all, and we put that over at linuxunplugged.com slash 663.
We also sneak an alternate enclosure into the feed these days, so just go crep around for that.
There might be a video version in there for you with visuals of what we talk about and stuff. You never know. We are so much looking forward to seeing you, so we hope to see you at LinuxFest Northwest. But if we don't, friends, we'll catch you right back here in the feed like we always do next Tuesday, as in Sunday. Thank you.
