You're good. Hello everyone and welcome to the 13th wait wait you need to ask me if I'm ready I I have something in mind. I thought I mean I mean Chad GPT just got me crazy So hang on, hang on stop stop everything. I just wanted to say that I was born ready and now So I need to start again. Okay. Oh my ready I was born ready
Okay, okay, and action. Chad GPT got me crazy. Okay, so action. All right. Talk. Talk. Yeah, I wonder We did wonder what we're going to talk about today Okay, so today we are going to talk about I'm gonna do have an idea what you're going to talk because I said I'll do three times No, no actually no Okay, so I'll ask Chad GPT and he'll tell me what we're going to talk about today Said Chad GPT Okay, all right. Okay. Chad GPT is then. Okay. I'm with you
Yeah, all right. Okay, so Today we're going to talk about Chad GPT and of course Email the first question that comes up to my mind to you is What's the first thing that comes up to your mind when I say JGPT? So the first thing is a chatbot But obviously I'm really prepared and yesterday I Was listening to a podcast You know the draw rug and experience
No, no biggest podcast in the world. I think The last episode is with an engineer called Lex Friedman Lex Friedman was there a lot of times is a brain scientist and I think I'm not messing it up Super interesting conversation and they've started covering Chad GPT and
Chad GPT is everywhere. I mean we're recording an episode over that I can't stand seeing people on LinkedIn posting I asked Jack GPT that and it gave me this and the jokes and everything you get you can't ignore it It's like with COVID In the past two years. So to me it's a chatbot and I think that that's what it is basically they want to cover a little bit of what it really is
Yes, so the next thing would be so what is the Chad GPT? You know So I mean under the hood it's essentially well not like any other chatbot But it's a neural network trained on large language models So it's capable of having a conversation with a human being
I don't know if it's the point of passing it's your interest or not. That's actually interesting to check It's been around for a few years like it's been around for four years and it kind of upgraded I think from Chad GPT one two three and I think Chad GPT is based on GPT three point five or something like that So that's the recent version and it's capable of doing a lot of more things not only having a conversation But actually explain stuff to you
I can of course manage a conversation with a human being and respond even to kind of emotions But I think what we care about is its ability is to write code, right?
basically it can generate code Pretty much with whatever you want I mean you'll probably tell me in a second But I've used it to create a Kubernetes manifest and to write some kind of Python scripts to extract things from Amazon APIs and I've used it to create scripts covering CI pipelines and lots of other stuff Okay, so just add about what it's based before we even say that so it's also based on instruct GPT
Don't know if you're aware of it. So they're like there's a library which is called library with models and everything Which is called instruct GPT where where you need to instruct the bot to do stuff for you and search for you and everything And the difference between Chad GPT is that Humans, you know AI trainers actually use the instruct GPT talked with it a lot So they also asked the questions and answered You know they answers and then this is the way
Yeah, and this is the way they got the chat, but They also said you know in the docs of ChGPT That it's a bit biased because some of the AI trainers thought that it might be better to give Comprehensive answers and sometimes like you know, it's Like giving you the longest answer, you know, as you go to Stack Overflow the longest answer is Like it doesn't mean it's the best answer sometimes just want to see it like a three lines of Just and yeah, yeah, give me the gist of it exactly so
It's a bit biased and they are aware of it and actually they're looking for You know how to mitigate risks So well, I can't even say a list, but let's say a bad content So in case somebody says ask like how can I create a bomb? So they want to make sure that the chat bot is not replying with an answer because it can so people are trying to create Asking you have to create a lot of bottle
And it wouldn't answer so you can kind of hack around it. You can kind of ask Leading questions to the point that it kind of gives away the information because it has information But it doesn't want to give it away Yeah, yeah, yeah, right So it's they also said in the models that that you can ask like the same question in a bit You know, rephrase it a bit just like you said and maybe you will get an answer
Maybe for a lot of cocktail which sounds nice sounds tasty even though it's not meant for drinking. Okay Okay, so this is like we covered a bit the basics of chat GPT. How it is working You know a bit of what's behind the scenes, but there's a lot more and we're we I don't think we want to get inside What's what's under the hood, but I want to talk about our experiences as DevOps engineers with Chag GPT, so let's start with you because I lazy DevOps engineers with chat GPT lazy DevOps
Okay, so your turn now. What was your experience? I won't say even this week because you know we used used it for a few weeks So yeah, give me some some of your stuff there's some of the things that happened to you with chat GPT All right, I think the most The one that I actually tried to use and I'll explain in a minute why I'm saying tried and not actually used is Sometimes we miss some kind of systems, right? I wanted to extract
What was it? I wanted to list my entire set of Lambda functions and I have many of them And I wanted to know how much memory each one is actually has actually used in its last run and Have it compared to the you know memory that was provision. I wanted to know how much is it actually utilizing?
Whether I'm on 70% 10% maybe I'm allocating too much as the dry Sarah And I didn't have a system in place which would that we touch on that in a minute But I went to chat GPT and I asked it to write a Python code that talks to AWS API and Extracts those metrics and it did it and it did it pretty nicely and I tried to run it and it wouldn't run and I figured that in a lot of places Where it it had the code but some places It didn't know how to extract things for example
It just assumed that you can get the metrics of the of the actual consumed memory of a Lambda function from any
Whatever kind of event. So it made up an endpoint Yeah, yeah, the place where you want maybe there is another place where I'm getting it is usually the last line of the log And it says how much can memory consumed For the last run and chat GPT just this is assumed There's a new endpoint and just try to communicate with it and said yeah, that's what it is And it did everything else perfectly right it it fetched the Lambda functions it queried their events
It queried the metrics it even listed them at the end, you know with a Descending order. It was perfect But the actual extraction of the event was just completely made up So I had to debug it and and this lives me with two questions one Whether it took longer to debug in fix from
Actually writing the thing myself. I don't know I guess it would be quicker with chat GPT, but it's not definite and the other is I'm thinking it depends right yeah The other is what I keep noticing is with wherever I want to approach chat GPT As far as code goes not the other things which will Will cover It means that I have a kind of a lack in one of my systems I'm missing something if I'm asking it to query my lambdas and the memory usage
I'm not visible to that so it's okay that I've grabbed it with a script But it says that I don't have a dashboard or a monitoring system in place to do that for me So it kind of points of an issue But sometimes you also want quick and dirty So I'm okay with what you wanted like you had a need
Yeah, you don't have a dashboard. You had a need. You wanted to get the utilization of your lambdas You don't want to hide the code you tell chat GPT write me the code But it didn't work so well So you had to use your DevOps and programming skills to upgrade the code
Yeah, so it's not like you can be a DevOps engineer just because you know how to use chat GPT. I guess I'm not well not at this point But it's so good that you know, it's such a small tweak I mean it will get better their date you talked about the reinforcement model how people they used human modelers to Target label it
Like improve it rank the system. So it's it has a reinforced learning mechanism And it keeps learning from our questions and answers It I mean it has the world largest data set which is all the people in the world are just using it like right now I'm pretty not an expert, but it seems like the next version is going to be like mind-blowing if that wasn't mind-blowing
Then the next one is going to do our work. I was thinking yesterday as of this day They they got like 100 million users and they got more users than Facebook and Instagram like faster I mean not more users, but they got to the 100 million users faster than Facebook and Instagram and you're like what? Think about us the decision we make daily for example in the context of a Kubernetes cluster Hmm, this is using too much memory. Maybe I need to scale this. Maybe I need to scale that
Maybe I need to move that pod here. This node is all they need to operate It's all super easy decision if you ask Chad JPT today now It'll tell you exactly what to do So all you have to do is like pack this thing in an operator and you never have to touch Kubernetes again Right and goes for I think most areas of AWS I'm not saying you are going to lose your job pretty soon Maybe you are I okay, okay, so now now now first of all, I want you to you said about the Turing test
So I'm not sure everyone in the audience knows what's the Turing test So just say a few words about what the Turing test because it's interesting. Okay, so what's the Turing test on? Okay, Alan Turing was the founder of computer science. I think he's the one who broke the anigma in the second word war The Apple logo is based on the Apple that the British government made Alan the British I think the British government made Alan Turing it because it was gay
I think I'm probably messing the story up completely. What was it? That's related in any case father of computer science But the first computer I think In any case that Turing test would be it's a test he made up to decide whether the Thing that is conversing with is a bot or a human being and passing it during test meaning that it's so good That you can have a conversation with it and it you will never detect that it's not a real human being
So what do you feel okay? So now that you said what's doing test? What do you feel with when you converse with Chagibity do you feel that it passes the Turing test or not? I haven't tested it. I'm mainly asking it to write code and explain what team access You know, so I I don't go to the depth of understanding whether it has feelings or it can I don't think I listen to the podcast yesterday. So I can that question was asked
By Jorog and to Lex Friedman and he said no, wow, it's not there yet. It's very close It's not there yet, but for sure it'll pass soon enough So that's where it stands. Okay, so so I'll give my point of view now Okay, so why do you like why the range of examples for us? I'll give you like I'll give you just one example
You talked about that how how Chagibity made up an end point. So okay, I'll give just a crazy example. Okay I asked I wanted to run, you know a graphical user interface On in a GitHub action So a GitHub action that will execute the code that requires a graphical user interface because the application that I wanted to execute Required a graphical user interface. Okay on a Windows machine. It's a must. All right, so it's related to some AI stuff
Never really, you know, don't really matter. So I wrote down to Chagibity I want to run a GitHub action on a Windows machine and with the graphical user interface And it said sure you can just do Choco install XVFD. Do you know what's XVFD or X FVD something like that? Do you know this application? I mean, I know Choco, but are these the same flags as Charlie? No, no, no, I'm not going to package manager, but exactly Choco is the package manager for Windows. So first I would like oh my god
It's gone. I'm just going to install something and it's gonna work. Yeah, good And then it said install XVFD or X FVD something like that, which is a Virtual like this is an application that allows you to run graphical user interface on bear with me a Linux machine. Okay. Okay
So far, I'm like, what is this application? So I'm reading and I don't see any relationship between XVFD And and you know Windows and I'm like, but Chagibity said Choco install this one So I'm going to Choco going to look at the you know package manager See the list and there's no such package for Windows
Then I'm like wait hang on. So it told me that I can just do Choco and you see by the way I got a full YAML, you know a full GitHub actions YAML of Choco install XVFD the commands everything and that and then you can just run your application and voila And I was like wow, I mean, I'm not needed anymore, you know because he gave the whole YAML And then I realized the application doesn't even really exist for Windows
Okay, so that's like that's the first thing that happened to me. Okay with that any any comments about it Oh, well anything especially want to say about it. It's exactly what I felt You know, it's it's like you know how when you walk in India and you ask a question They won't tell you no. They would make up a story of where something is So it feels like exactly the same. You ask Choco it is something you wouldn't tell you
I don't know you would just make up something. Maybe he knows it more like nine times out of them He knows the answer on the 10th time. He'll just throw out something or or And I also want to touch that Yeah, he'll wrap it with the information, but it'll just inject stuff that don't exist Okay, so exactly and I also want to touch that point to talk about the the essence of existence
Maybe it will be a topic. Okay, so the second thing that happened to me Also, maybe it's a essence of existence So I wanted to delete a database a post-class database Okay, so I connected to AWS LDS and I have a post-class database in AWS LDS so far so good But if you want to drop a database you must
Disconnect all connections before dropping the database. Okay, you you can't have active connections So I did You know, I go over the bit found some stack overflow on cells and I'm like wait before I do that Let's ask Chad GPT. How do I delete a database with I also say PG admin?
You know PG admin the graphical user interface to control post-class. Okay So Chad GPT said listen just right click on a database Click delete In you'll have a checkbox of forced deleted database click yes, and that's it I'm like, oh my god. Cool. When I click delete I didn't see the checkbox, but maybe I didn't notice but Chad GPT said so let's check it Okay, going doing delete there's no checkbox. I click on delete It says cannot delete database because of active connections
Okay, and the post-class version was like um, it's important because it was 14. Okay, post-class version database version Then I'm like wait wait wait wait what's the version of my PG admin Okay, so I upgraded my PG admin version Okay, not the post-class the PG admin the client version and then when I clicked right click and delete We I didn't see a checkbox, but the database really dropped So my conclusion also was that okay, so Chad GPT
He was accurate for a certain version, but it didn't tell me from version of post-gless version number blah blah and PG admin version blah blah you can do this and that I had to figure it out on my own, you know so Also very frustrating exactly, but well, I think we need to keep in mind the The data that it's trained on because it has I guess the entire Wikipedia on it probably AWS stocks obviously Stack overflow and things like that not all the enters the answers are exact
The ones that you're looking for people make mistakes and at the end of the day It's a bot based on people's information So it probably consumes the mistakes as well as the good answers So it I think it hits or it likely to hit a good answer, but it's not good enough It's not yet there just like you mentioned But what I think we need to I mean that the current approach at least to how I see it is I'm using Chad GPT as a shortcut
The exact same question I asked Chad GPT. I can go looking Google I can find the stack overflow or the or the first answer grab what I see there Copy paste the code use that maybe copy paste the answer use that maybe just read a blog post Okay, so I'm using it as a shortcut. It brings the information to me It does the search for me. It picks the right answer what it thinks are the right answer and it brings them to me But the more interesting thing is
Let's say you want to learn a new thing. I wanted to I thought about learning next Yes, because I wanted to get a little bit into front and which is somewhere like an area I feel like lacking and I was just googling what it is what are what are the things and then I thought wait There's now an AI writer in notion. I use notion and that's based on the open AI Chad GPT So I just slash AI writer and I'm asking it. Can you write a blog post explaining?
what What it is in two paragraphs make it quick easy to understand with all the basics that I need and that's it All the information is there and you're covering everything you need to know So I know what next yes is how to get started Whether it's good or bad, but the internet things and it brings stuff to me
It's that good to the point. I could literally copy paste that prepare a blog post post it on medium and get Like so many maybe even one thing going with that hang on with it So what I feel now about what you say is that for theoretical stuff It can give you a very good
Information about theoretical stuff. So maybe write a blog post write a post or digest You know something from the internet and give you a good answer about it You're a short answer a gist or whatever But as you can see when we talk about the real technical stuff or I actually need to delete it at a base
It's it's off. I mean it's still off Okay, right But so have you have used it also for an so some more theoretical things Maybe you have another example for another theoretical thing next JS any other thing maybe I didn't
Yeah yesterday. I wanted to I mean I love t-mucks I use it every day I mentioned in the beginning and I wanted to prepare some kind of a blog post So I asked it to write things to bring up ideas And it wrote them so well I'm thinking why the hell am I working so hard explaining that in my own words when chat GPT does it for me And you're not stealing from everyone anyone it just generated it like on the spot
Right, so there are tools now to detect whether you used an open AI mechanism or whether that's a bots Road to writing the blog post or whether that's a human being which is okay I get it, but soon enough. We won't need that at all There's no point in blog posts anymore because chat GPT can do it for you It can change the style it can change the level of complexity the level of competent
That it makes jokes because I like to write jokes in my blog post. I like to tell it when they're happy That's from the podcast yesterday not only it can write jokes
It can write jokes in a certain style. You can tell it quite a lucyk style or a Joe Rogan style or a Jim Jeffery's style And it'll actually do it because it has so much information gathered in it that it can it has a language model So the style is basically based on the data that it Consumed if that makes sense and they said I don't understand all that well But yesterday in the podcast they said that it was amazing
They just asked it to write a simple joke about something with the style of a certain comedian that they both know and it was amazing So I would okay, so let's move on to the point Well, how do we think that we can improve chat GPT? You know, let's brainstorm a bit both of us I can say for my end Like I'll share my search experience in Google Okay, and I want you also to share your I think it would be the same But I want you to share yours and maybe tweak mine
So when I search for something, you know in Google. I just I make sure let's say I want to delete a database from post for AWS post list whatever I write down AWS post-guess 14 Drop false database something like that. Then I get to maybe stack overflow Instacoverflow looking for the answer with the most votes probably or maybe the recent one because maybe it's better than the one with the most of the votes or the accepted one or whatever and Because I see human people, you know, humans feedback
I know if it worked or not now. This is very lacking like I miss it in chat GPT because As you said, it just guesses Something and if it would tell me that listen. I'm sure like it's like 79% I'm sure that the API endpoint of AWS exists or not or something like that. I would be more comfortable using it But when something answers you with so much confidence and you're like listen It knows everything. So let's just do what it does. It says I'm like
Where's the feedback human feedback? So what's your experience like how would you tweak it maybe the search experience? So how would you make chat GPT better? So for now, I think the only answer that I can think of is refine the questions Exactly what you said. You said it makes up stuff like that's what was my feeling just as well So don't leave room for questions. Do ask it things that it knows for sure. You were asking about an RDS day
Whatever drop a database from a certain version. If you'd go simpler like wrap the things with your knowledge But the thing maybe you're running an SQL query of how to drop a table ask your GPT please write an SQL query of Dropped table XYZ. No, that's pretty simple. You can do the same with Google But I wanted to do it with BG admin also. I was like very very specific
I want to drop a database with BG admin. So I was specific not with SQL, but with the client You were but I didn't expecting it to be very specific on a very specific application Sometimes it works for me yesterday in t-max it works perfectly Probably because t-max has the man pages and Linux for years now on the internet So it's all over you're asking a very specific version which is very specific document Maybe it's not part of the data that chat GPT has so the narrower you go
I mean the the narrower the information that it needs to provide an answer goes The less likely you'd get an exact answer the wider it is like write an SQL query That fetches this from that table make it I don't know efficient enough because the data set is decent that try to Congest it into a few lines and I don't know send the result in a Descending order something like that like writing in your own words something that's pretty easy to To consume and provide an answer for I think that's good
You're making me work. You heard my Google search. I didn't write down. I didn't write. Yes. How do I drop? Dala blah blah blah I wrote down You know very common keywords and I knew that the combination of those keywords will give me the popular stack of a flow
And so so now you're making me work. I don't want to work You know, that's not my size funds is going so good because any Person I heard talking about chat GPT in the future of engineers says that will probably find being our self Transitioning from being the engineers that do the work to the engineers that operate Either chat GPT or any kind of AI to do the work for us So we'll just turn into operators. So yes, you still need to work
You need to be exact with your wording. You need to be more specific with what you're asking and you need to keep in mind What kind of information it has and what it's good for and what it's not good for so If that makes any sense, you can today be a chat GPT operator and have it help you But to the extent of what it can do and it can't do anything not just yet
I don't so to me. I don't feel confident enough to use it. So every time I get an answer from chat GPT I go and verify it on Google to get some human Human response human review human feedback something like that because I don't trust it You know, it sounds bad, you know, I have a trust relationship with chat GPT But at least now, I don't trust it. Are you trust everyone's feeling to be honest?
And not completely not in the sense of writing the code and just letting it run not exactly Exactly, it gives you code and you you actually will review it like line to line and I'm not like I'm copy-pasting Everything from Stack Overflow, but I'm more confident when I see maybe 300 likes or votes to an answer. I'm like It's probably okay, you know Yeah, so so feedback is important So feedback is important. What else would you improve in chat GPT?
Maybe if you have any other thing except from getting feedback Feedback and reassurance, you know, I would say give me how sure you are when you answer And give me maybe if you have feedback from humans about the answer that you answered that would be good You know, it's I'm going back to So I'm going back to the point that I just mentioned refine your answers or refine your questions rather For example, I wanted to write a YouTube title Okay, and I saw a great tip
YouTube titles are your way into viewers. So in order to write a good title It needs to be dramatic. It needs to have like strong wording. It you can probably write Learn how to do DevOps or you can say Mind-blowing tutorial for his readers like 10xbe a 10x engineer with this tutorial, right? So you can have this so if you go to chat GPT and ask it This is my title. It's how to be a DevOps engineer
Please give me 20 examples of the same thing. Keep it lower than 50 characters. Make the wording dramatic and I don't know use two words in capital letters to make it even more more I don't know Pulley to the eyes like pulling the viewers Okay, and that's it. It will provide 20 Pretty much amazing results for you to use and then you can just go through them pick one
Maybe you want to refine that again and just use one of the picks use that. It's the The input and run it again, but it does that amazing so you can provide you know what I'm wondering now You said provide me 20, right? So now I'm thinking what if it doesn't have 20 and it has in database. Let's say 10 So you as a human would be fine if it gave you 10, but it might tell you listen I don't have I'm not sure what it will answer. I'm just guessing the answer
It might tell you listen. I don't have 20 sorry You know what I mean, but you as a human would be like so give me your 10 You know what I mean Yes, that's the thing It's a language mode what I asked was use dramatic wording with the same thing So you can basically use the same template do this colon tata tata tata dramatic word, right? So as long as it have an additional dramatic words it'll work to to some extent and that
19th and 21s what I mean it was so far off. I didn't use them. So the word in that makes sense all the time Okay, but you know it keeps going as long as you give it Run so so let's say maybe after the 10th Title you were like what is he talking about?
I don't think like that not really not really you know what that's a thought experiment or a real experiment rather do any listener Go ahead and do that use pick something give it an input tell him rewrite this with either dramatic wording And so something else make something out of this give me 20 give me 200 examples see what it does
I would try to challenge it to infinity all the time. I think I would say give me the maximum number of sentences You can about x y z and there it will be like That's a good way to do the blacklist of open AI Yeah, give me like yeah, how many I don't know can can chuck noise slam Uh, you know a revolving door, you know something like that and then it will get crazy, you know So a friend of mine
I think it's him he asked it the ultimate question of whether God can you know produce a stone that he can even lift himself So see his answers and he can answer that about Islam and Judaism and Christianity and Buddhism Just try playing Yeah, okay, we will we will still because we are running out of time and we already talked about our experiences I'll just ask if you have a special experience or tool or technology that you want to share about email I Actually do So yeah, I go you know how
It's funny to say, but you know How sales for a skilled hiroku play itly they bought hiroku and killed its freteer Which know the beloved developer product of all times I'm kidding not of all time. There is amazing. I think A digital ocean or some many many blog posts are based on hiroku being free You know what I mean? So many blog posts are like deprecated in legacy because of what you just not not anymore
In any case, I found an alternative haven't tried it yet though. It's called flight control flight control dot dev So that's the cool thing. I've sold I saw this week and I a free cloud provider It should be free to an extent like hiroku has it has a freteer. Yeah Mm-hmm. That's okay. So flight control dot dev It will be in the description. Hey, what did you see this week? Actually the chat GPT experiences where I told you about the
Yeah, yeah the postgres database and I don't know. I also had this I think we'll touch it maybe in some other session But I had to create like a very complicated automation where I had to install or maybe create a windows service
That will listen to stuff, but it will take too much time to expand. So we'll talk about it next time. Maybe All right Okay, so hoping Chad GPT won't delete this video and you know Getting scared, you know the machines are taking over us So thank you everyone and Chad GPT and Chad GPT And see you next time for letting us put this video up in the air See you Namaste