How'd you like to listen to dot net rocks with no ads? Easy? Become a patron for just five dollars a month. You get access to a private RSS feed where all the shows have no ads. Twenty dollars a month, we'll get you that and a special dot NetRocks patron mug. Sign up now at Patreon dot dot NetRocks dot com. Welcome back to dot net rocks. We're from Build.
Yeah, Richard, I like being a build Well, Seattle, it's raining. Welcome to my neck of the woods.
Right, I'm Carl Franklin. That's Richard Campbell, and it's gonna be a good show. This is the first show that we published from the list of shows that we're doing.
It well, got us to be busy.
Yes, however, this is the second show we recorded. Okay, so the keynote uh Hawk that we do with Scott Hunters next week. Yeah, yeah, all right, it's a couple hours ago, a couple hours ago, a lot of good stuff. Ken Exner is here. We're gonna be talking to him in just a minute. But first let's roll the music for better know a framework.
Man, what do you got?
Well? I haven't seen this one before. But it's trending on githubs. This is public dash APIs GitHub. It's the public API repository, manually curated by community members like you and folks working at API Layer. It's an extensive list of public APIs for many domains you can use for your own products. Consider it a treasure trove of api is well managed by the community over the years. That's cool, you know, so putting on my career criminal advice hat.
If you want to do a denial of service attack to test out your new tools, pick one of these APIs and let it rip.
Jeezus, that's dark. It's a very dark way to think about it.
But yeah, I know, of course, you know you want to test out your your new harness for calling APIs and see if they were There's some really good stuff here. Locate and identify website visitors by IP address. That's a fun one market stack, free, easy to use rest API interface delivering worldwide stock market data and Jason format because you know CNN doesn't work well enough. Weather Stack retrieve incedant accurate weather information, numb verify, global phone number validation,
look up Jason API and Fixer. A simple and lightweight API for current and historical foreign exchange rates, some good stuff, and there's more to it, of course, but that's it awesome. That's what I got. Who's talking to us today, Richard grab.
Your comment of the show ten sixteen seven, which is a while ago. Let's tart twenty fourteen. We were talking about to edemar a bit about different search strategies and technologies, and one of the comments in the show came from Sean mccartall, who was talking about how he pitched a last search to his organization. And admittedly he's twenty fourteen, so think about the challenges back then, right, But he said, only after the second time I had to tell my
boss I don't know why it broke. We don't have enough information I sought out to solve the problem. Yeah, so this is this is an EMEN type thinking, he said, And the problem this is an architecture that spans SharePoint, SAP, some Tomcat hosted solutions, so a little jab in there, along with a bunch of good dot net projects in too, and he worked with Python and power Show forty threw a Lodge staff receiver into a LASTI search cluster, which
was the easiest part to set up. And then after by another week doing some tweaks and configurations, he was able to do an analysis of workflows through all of those different products in twenty fourteen. That's twenty fourteen. I mean today the tools are all different. You'd be in the cloud and doing that, but no, he was cracking it the hard way now. So now I appreciate that it's just a realization, like a last search bit in our lives a long time. Things are obviously different now.
And as Sean, thank you so much for your comment, and a copy of music Coby is on its way to you. And if you'd like a copy of music Koba, I write a comment on the website at dot net rocks dot com or on the facebooks we've published every show there, and if you comment there and never real on the show, we'll send you copy of music Goby.
Music to Code by of course, the music that helps you focus, still going strong, twenty two tracks. You can get it at music toocodebuy dot net. You can get the collection in MP three wave or a flack format. Before we interview our guests and introduce him, let's talk about nineteen fifty two yep so significant events, because this is show nineteen fifty two kind of have been been
doing this. What happened in that year significant events including the death of King George the sixth and the ascension of his daughter Elizabeth to the throne of the United Kingdom. The US successfully tested the first hydrogen bomb. Dwight D. Eisenhower was elected President of the United States, defeating Adale Stevenson. The Korean War continue with the US launching bombing attacks
in Greece and Turkey joint NATO. Other key events include the beginning of the Mau Mau rebellion in Kenya and the Great Smog of London caused by industrial pollution and high pressure weather. The Great Smog not to be confused with the Great Stink. Do you remember that? I mean I don't remember it, but I remember hearing about it. Sewage backed up in the Thames. It was horrible.
Related to the presidential election nineteen fifty two, was one of the UNIVAC computers, which again these were all bespoke machines of the time, right, actually did the computational estimations to say that Eisenhower's going to win. So it's one of the first times the computer predicted the win based on poll.
Okay, so you know how many times did the computer not predict the win though?
Well before that?
Zero? Oh yeah, okay, yeah, right, okay, shall we get on with our show. Let's talk to Ken Xner. I'll introduce him here. Ken is chief product Officer, head of products and engineering for Elastic. Maybe you've heard of it.
Welcome Ken, Hey Carl, good to be here.
Hey Richard, thanks, good to have you. Yeah, thank you.
You mentioned uh Elastic search US in twenty fourteen. We actually just celebrated our fifteenth anniversary of.
The lasted search, so twenty ten.
Yeah, Elastic Search fifteen years as a couple of months ago.
That's fantastic.
H And it's a it's gone on to be downloaded four point six billion times.
Wait billion with a B, billion with a B, which.
Makes it I think one of the most popular open source projects of all time.
Yeah, no, without doubt, And I mean it comes up regularly. It's just one of the tools we've count on for fast search solving certain certain scopes of problems. Right, see the smart casing tool. Now, you guys have got a new relationship in Azure. You're just you're becoming a service like well, how you guy, what do you guys are up to?
But we've we've.
Been Our partnership with Azure has been fantastic. So over the last few years, Azure has been integrating US almost like a first party service within Azure, so you can go into the navigation and select US as part of the experience with an Azure So if you wanted to launch your own Elastic Search, you can do it very simply from within the Azure console. So yeah, it's been fantastic.
Yeah, and you guys been in cloud for ages.
We started going back to the cloud, started going to cloud about six seven years ago, where we first started letting customers spin up a VM, have US automatically installed, have US patching and maintaining their cluster. We've recently actually introduced a new serverless offering that is kind of a fully managed experience that you can think of it as
SaaS like. So it is a SaaS like experience for using Elastic Search, which means that customers can use US an open source, they can get a self managed license, they can have a hosted version in cloud, and they can have this new serverless offering which is kind of a SaaS like experience.
So am I just paying by transaction at that point?
Yeah, you're just paying for data. So if you're if you're using US as like a logging solution, you're just paying for data in and data retained.
That's it.
That's fair.
And it scales to zero and it's uh yeah, it's a magical.
It doesn't cost you anything. You don't move any data around it exactly nice. You're if you're running a VM, you're paying for it. That's right, no way around that.
But yeah, it's it's been a challenge being able to deliver elastic search all these different ways that you know, it's hard to maintain software that many different ways, but it's what customers need.
So how does it fit into Azure's new AI focus that you probably, yeah, are the focus this I did.
The drinking game I decided on was not to say we need to take a drink, we say copa certainly not say drinks, we say AI, you'll be drunk when you say Windows.
Yeah.
I think I only had to take three drinks then.
Yeah. Well, I think it's really a question of how is search, you know, playing a role in the I right boom, And I think one of the things that you know, when generative the I first happened, everyone's kind of wondering what's the future of search, and people were saying, oh, you know, Google is dead, and I think one of.
The things that you even said, SAS is dead.
He said that last year.
Yeah.
Yeah, yeah, I'm saying for him to say, I think it seems unlikely, maybe a little premature, maybe a little we'll get into agentic architectures in the augentic future soon, but yeah, I.
Think SaaS is still here. But yeah, what we realized is that search had a huge role to play in AI because if you're building generative AI applications, you need to ground it on, you know, your own data so that you're not just basing on public information.
And constantly changing.
It's constantly changing. And if you, you know, want to make sure that you know the permissions reflect the user, you need to make sure that you know that whatever you're grounding on understands the user's permission to data.
You're not going to build a model for every permission level. That doesn't seem practical.
You know, fine tune or build a model for every single possible combination combination of permissions.
Yeah, yeah, it seems like a way, good way to waste a lot of space.
What else shouldn't you do let's talk about that.
Well maybe in video would like that feature, but.
Don't stick a fork at a toaster. That's a good one, I think.
Okay, then we have two.
Yeah, so search has this new found life in the age of generative AI. Wheople are using us to help build applications and doing retrieval mechanisms, and that's been sort of the source of our partnership with Azure, as well as helping them be a search engine or retrieval engine that helps their customers, our customers build these generative applications on top of their private data.
Right, Yeah, that's great. Well, I mean we saw the we just saw the keynote a couple hours ago, and we'll get into more of that next week with Scott. But what did you take away from it?
Well, one of the things in Scott's keynote he mentioned sort of the move towards conversational search, and this is one that we think is big within Elastic and we've seen the evolution of search. You know, started off as lexical search or text basse search, and then six seven years ago and moved to semantic search, where people started to expect their search box to understand natural language and
respond to questions. And then I think with generative AI it became sort of an evolution further towards RAG where people wanted to build these applications. I think now it's moving towards conversational search, where you're expecting your search box to have a conversation with you and respond in natural language and carry the context and carry context, have memory be personalized. And I think one of the things that we've been working with Microsoft on is how do you
build these conversational search experiences across the web. I'm excited about that.
Yeah, yeah, and again it's just it's part of the infrastructure. You just want you just expect that to work and to be fast, to be fast.
Yeah, you know, that's one of the things that elastic search is known for is blazing speed. I'm always you can you start typing keywords in a search box and auto completes. You expect that. So now combine that with like conversational search, you can.
Get over the speed of l about the typing in the box, yeah, yeah, if I have to finish typing and hit a box, so annoying. That's a broken search tool.
Yeah, so many of our listeners may not know about vector databases in general. Can you kind of give us an idea of how that changes the game sure data standard relationship.
Yah. So when we became a semantic search engine, we had to become a vector database as well. And this is back around twenty seventeen we started supporting the ability to store and query dence spectors.
It was cool before it was cool, five years before.
Before it was cool.
I don't know anything about that. It's like first podcast ever.
I'm there's some debate about it, but I'm gonna still argue that we were one of, if not the first vector database out there because we had to support it for product search like image search, and for semantic search.
So I kind of know what vectors are because I took high school physics. But tell us the.
Basic idea is, you're trying to plot vettings or vectors in sort of a multiensal space, and you're trying to look for similarities between vectors in this multidimensional space. So you're you're basically taking text or you're taking images, and you're you're vectorizing it, which is turning it into these, uh, these embeddings, these numbers that can be plotted in vector space,
and then that allows you to find similar terms. So when you're doing something like semantic search, you're trying to use uh vector sort of this vector search to look for similar terms. So if I if I say glass and cup, I understand that those are similar terms, right, because they're they're close in this vectorized space.
Uh.
Same thing with images, same thing with video. Anything that can be vectorized and turned and turned into vector embeddings. Uh. So we started supporting the ability to store these dense vectors and query dence vectors and elastic search, and then five years later generative AI happened and we were like, wow, we have a vector database. That's pretty cool.
Yeah.
Right, and that kind of thing that language tookeganization just lends itself so well to vectorization.
That's right. Well, that's what makes possible, right like chat GPT, you type in a phrase or a question, the response, every single word is based on the probability of what is the next word based on the vector values.
That's right. Right, And well, so there's there's a couple of ways that vectors are used. One is inside the models themselves, but a vector database specifically is used for helping ground an l l M. So like an LM doesn't actually use a vector database, but it uses vectors
in how it's how it stores the information models. But for a vector database, it's it's trying to get the l M to ground itself on third party data so that you know, if it's not been trained on a product catalog, for example, you can expose it to a product catalog, or if you needed to use some information that it has not been specifically trained on, you can ground it on that. And a vector database is one technique for helping produce highly similar, highly effective search results
that help ground that LLLM. We actually found that the best techniques are actually not just using vector databases. You know, I'm a we're a vector database, and I'm gonna say the best techniques are not just using the best techniques are actually using combinations of technologies. Hybrid search. We're using combinations of lexical search UH and uh en vector search, or you're using sort of graph traversal together with vector search where you're you're modeling information and we're seeing the
relationship between entities. But we support all these things. We support a combination of geospatial search together with vector search. So yeah, there's also other techniques like reranking. So once you all the reason.
You're talk about runing multiple searches and in those different forms and then somehow munging it together, so you're not repeating yourself to get a results at that's.
Right, or you're you're running post process like you might pull a bunch of results and then run reranking after the fact, right, and that get further refines the results. And then what you're doing is you're passing the right inform to an LM so that it can say, okay, you're using it. You're passing into the context window and saying this is the information you should build your response on.
And all this happens blazing really really fast, and then the LM now has some information in its context window that it can use to to provide an accurate result.
So here's a scenario. Let's say I'm building an agent, and the agent I'm giving access to my database. On one side, I've got a SEQL server with a bunch of relational data in it. On the other side, I have a las to search vector database, and I give it access to both of those things. Is it going to be able to find things in the last to elast to search faster than it would in my relational data if they were both, if it was both trained on both data.
We would be It depends if so I'm assuming this scenario that we have a connector to that database and we can run into it will be faster.
Okay, so yeah, so why would I want to use the relational database? And my this is this is actually why one of the first that's why you're here, I get it. I see, actually one of the first.
It's the end of databasetase we know it.
One of the first use cases for elastic search was actually database offloading because it was the search function was creating contention in the database, so offloaded it to elastic search and we were blazing fast. Helped speed up the database at the same time.
You know, most people what they do is they have one database for their product data or whatever, and then they have another one that's optimized for searching. That's right, right, So the one optimized for searching doesn't have all the the joins and everything that's crazy about data.
Relational database cercually and we're not I don't want to be mean to relational databases, but they were from a time when DISPAS was at a premium, and so don't striplicate data, right, Like, that's why we organize data that way. It was space efficient. It's not particularly important now. Admittedly, now we have an infrastructure around it where we have so many querying tools and other bits and pieces that just work against it. That that's your instinct, and all
our rms tend to point to. Okay, some ways are just in place from the momentum of what's been built on the facto standard, and they're highly integrated, like they have their advantages, but there are more ways to store data and we do. The trick is, you know, deciding on a source of truth and trying to keep everything, every copy in sync.
So a last search on Azure is kind of like the place to be. I think now that we've been talking about this, if you're going to be building you know, copilot and agents in Azure Foundry, I guess.
And we've actually integrated with AI Foundry. We're one of three launch partners. So if you're using AI Foundry, you can use us as a grounding engine as a way to build generative AI applications using our vector database. We've also been integrated with semantic kernel from the very beginning. Right, we first started supporting semantic kernel by offering vector search.
Recently we actually extended that to do hybrid search. So what I was talking about before, being able to combine different search techniques, right, we're the first offering to do that.
Now, you know, we've been given SQL server a lot of crap here. But if somebody is listening and say, yeah, you know that rings, I think I'm going to try this. How easy is it to move our relational databases from let's say SQL azure to elastic search.
How easy it would it be to change the search to be using out using US as a search engine and plugging into.
Or data or just moving all the data, moving all the search. Is that something that you want to necessarily do?
Most people wouldn't use US as sort of a database alternative database. They would use US if they're using a relational database. They might use US as to offload search functions, so they would use it that way. But people do use US to store logs and other time series data as a primary data store. Sure you wouldn't store that.
In a relational database, so not real data.
It's not relational data. But people do, people do. I would not, I would not use this as an alternative to a relational data store. But I would absolutely use US as a time series database. I would absolutely use US as a vector datase. I would absolutely use US as a database offloading tool for SQL and other words speeding.
Yeah, that's right. Yeah, and so it has it has access to your SEQL server. It can figure out how to optimize those queries things that you would do in a store procedure where you're getting multiple data sets from multiple tables and things like that. That's the kind of stuff where you would be in a lasts.
Those are the kind of workloads that are perfect for us, Like we will help speed that up, take the take the workload off of SQL server so that they can handle the rest of its work without contention.
So I can also see the data, like I want to search the incoming data. I think you constantly current data, so I don't want to keep reprocessing models to include it. So I'm using these search mechanisms that data is coming into my relational database, then probably I have an asynchronous call from that calling out of it. And reorganizing it into the vector database.
Yeah, so there would be the connector would would basically be indexing a as is coming in, say, creating an index so that it can handle those queries and do that without bothering the primary database.
Right, yeah, yeah, so is that actually a hook I put into a lastic search into elastica just saying hey, watch this database when yous come in politic exactly now, I mean, because it's relation to database, I tend to decompose data, right, I've broken this order down into rows and columns and stuff. I don't imagine that's how you want to start in a vector database. You kind of in a.
Vectora less to search, everything is sort of document based. Everything's turned into a document. Uh but uh but yeah, we'd be able to map that back to the rows and tables in a in.
A in a Right. So I mean I started off with the whole order. Should I just stole the whole order in in elastic and then decompose it into rows and columns? Like, what's the right flow there?
Right? If you're do you have any actual to help me?
I'm not sure I think you you know, if you just use our connectors it'll handle this for you and you'll have to think about it. It doesn't like we have four hundred different connectors that have been built up over the years for all kinds of different data stores for everything from Snowflake to SQL server to you know other and it handles all of that for sure. And then these days everything is kind of getting replaced by mcps or we're starting to build mcps of board into that as well.
Yeah, the AI equation of this is flipping huge.
And we'll talk about that a little bit more when we come back, and also next week with Scott Hunter. We're going to take a break right now, though we'll be back after these very important messages. Don't go away. You know, dot net six has officially reached the end of support and now is the time to upgrade. Dot Net eight is well supported on a w S. Learn more at aws dot Amazon dot com, slash dot net.
And we're back. It's dot net Rocks. I'm Carl Franklin Campbell and we're talking to Ken Exner from Elastic about elasti search and some really important information that we just discovered about you know, what it, what it is, where it fits in, and what it doesn't do. Uh, and how it fits in with with Azure, especially about how you can make searches stinky fast rights stinky fast?
Is that I'm not That's good.
No, that's really good.
So fast you can smell the burn and rubber.
That makes it better. I like that, all right?
So how do you get started with jam ai with elastic and Azure and the Elastic AI ecosystem through Azure Foundry AI Foundry.
Well, I guess if you're if you're uh using AI foundry or using semantic Kernel, we're there, Like if you're if you're choosing to use that, like if you're using semantic kernel as a way to build uh generative A applications into whatever you're doing. Uh, we are integrated there so you can use us as a vector of database within that.
It's just a feature. It's just a feature to.
Turn on, so you can go and like, can you pick which vector database you want? There's a drop down, there's a couple options there. We're one of those two.
It's great.
Uh. And then the same thing for AI Foundry. We're integrated into AI Foundry into your workflow so you don't have to think about it, so you can basically, uh, you know, start using AI foundry select us as a vector database.
Uh.
With our integration into Azure, it's automatically set up for you, so you don't have to think about any permissions anything. It's all integrated with the Azure as your client.
I hate to derail you, but this is the first time AI Foundry has been used on dot net rocks. I just learned about it today. Ah, so people probably won't know what this is.
It's you can think of it as the new studio for all things AI.
It's like the.
Azure AI portal section for AI.
Right, Yeah, it's yeah. There there were lots of lots of studios, lots of different tools for building AI applications within the Microsoft ecosystem, AI Studio, Open AI Studio, a bunch of them that kind of got co pilots do Copilot Studio, that's right. So, uh, the UH AI Foundry is sort of the the new integrated version of that. It gives dot net developers one place to go to if they're building these AI applications.
All right, so that's where you go on Azure if you want to get started, I guess you know, if you want to start building agents and and all of that.
So when you toggle the integration, is it how is it deploying elastic that point or are you using the server list version? Like, what's what's the actual impact?
You can if you've set it up already, you're just picking your pointing to a pointing to an existing cluster or an existing project.
In the serverless version, that might be your VM, or.
If you're wanting to create it from scratch, you can do that as well. Okay, so it's a seamless integration, which which is pretty amazing for you know, being a third party product. We're always pushing for these tight integrations and we've gotten that with Azure.
Now people like a checkbox and things just happen. It's just I'm putting my administrator's hat on. It's like the dev check that box and a VM appeared. In my world, I'd be more emotional about that. Where if it's the serverles offering, where it's just now we're just going to get a new bill. That's the cfo's problem. I don't mind that at all.
That's right.
So is it like do you get to pick the deploy mode or is it automatically.
The server This one is not enabled yet. Yeah, the servers, I mean.
We're talking the day you announced it, so that's fair.
But the the hosted version of our cloud offering is there, you can.
You can r so you could be hosted by you.
Yeah, we'll be.
Going ga with our server list offering in the coming weeks and then at that point you'd be able to just select that project as well.
And is that running in your infrastructure? Is it an Azure?
It's on Azure? Okay?
Yeah, yeah, it's all on Azure.
So can you give us an idea of how much it costs, I mean relative to other Azure resources?
Maybe, well if you're so. There's three different project types. There's the traditional search one, which you would handle use for typical search or vector search workloads. There's the observability one, which is sort of built around observability capabilities like log
analytics and metrics. And then there's a security one because one of the things that happened along the way is people thread hunters started to use us as a security analytics platform, so we created entire product packaging of Elastic for security workloads. So for threat hunters, Wow, if you're using the observability or the security project, type. It's basically we just charge for the data going in and the data retained. If you're not using any data, you don't
get charged to anything as simple as that. For the search one we charge. We call it a VCU. It's a virtual compute unit, and it scales to near zero. There's always a little bit of charge because we have to keep some cashes warm to handle any kind of incoming query. But it's like less than twenty bucks a month at the start, so pretty, you know, scales down to near zero.
That's really cool. Yeah, good to know. All right, So just a selfish question. Maybe the other listeners are thinking this too. All right, I'm committed to using Elasti search. I've got a relational database that has on my Goo in it. I got a lot of store procedures, and I got some views and stuff. How do I take all that t SQL in a big store procedure that returns multiple record sets from multiple places and turn that into a lab to search. Is there a language I do?
Is there a good migration into it? Yeah? Well, I'm I'm hoping we can build something with l MS that could do that.
Migra.
Yeah I do too, actually.
Because I don't want to do it.
It's so the there is. So we actually have our own uh sort of query language. It's called e s q O and it's a piped query language. So we use pipes and you can very power, very very linux very powers. Yeah, so you use pipes to pass uh, since you one query into another and it's a way of combining and uh, it's a very powerful query language.
We introduced joins recently. Uh, so it can do a lot of the things that you can with with the traditional sequel language, but that's becoming our default language to that thing, and at least for analytical workloads. So if youre using this for search, you would just use the search API, but for analytical workloads, uh, you'd use this new query language.
So these conversions seem like a perfect job for an AI.
H oh yeah, yeah, so like this is this is actually something we do right now. People might use other solutions like Spunk, they have their own query language. People have used l o ms to the conversion of one query language into another. They're surprisingly accurate. So yeah, there's no reason. You know, once we get to sort of the functionality parody that you need for for SQL, that you couldn't.
Just use an l O And when'd you say your language is called.
Again e SQL query language.
Yeah, all right, so there's a good time kids to go out and learn the SQL, at least a little bit to know what you're going to be doing next year or maybe in a few months, who knows, or this afternoon or this afternoon really ambitious.
Generally, my experience when you're moving to non relational databases is you're calling APIs. It's basically just a coding exercise. You're different kind of data fetch and start, start effects and things like that. It's a different way thinking about it. And part of that to me is you're now handling the data differently like the query. The old query doesn't make sense if the data is stored in a different way. There there are no joins or not joins the way you're thinking of them.
No, it's not a join like it is a relation creating a join on sort of a no sequel data sert where we use it's a document based data system. Was challenging. How do you do that?
Yeah?
Uh yeah, it's a different way of interacting with data. It's a document based orientation.
Yeah, so you know the document the experience you've had to working with document databases is the right sort of approach to organizing things like I would be hesitant to just move a relational database to a vector database or area a document store of any kind just because the data is organized differently.
Which organized differently you're going to augment it with ectory base.
But now I like this idea of yeah, my order is still decomposed in the relational database. We have all the reporting and so f on that, but I also keep a copy and in the document start that's the entire order, and still got all those elements senate that are searchable and findable and so forth. That's right, but when you find any element of it, you find the whole thing.
So would you just call Kim Trip and Paul Randall and say, hey, optimize my indexes?
Pretty sure?
No, No, get kind of retired. Actually yeah, there's that, but I mean optimize the indexes. I mean, that's that's kind of where people go when they have search problem performance on SQL server. Yeah, well, in the.
Lastic search, that's completely everything is indexed. You don't you don't you don't pick you know what you want to index. Everything is index so that's not the.
End, and the next you're created on the fly?
Are they created as you're ingesting? Yeah, so it's all automatically created for you.
Any good document database, that's right. Yeah.
So, and I find it interesting to have the sort of three species there, like this security makes sense, that's a special thing. But the observability and this is the This is why I pulled that comment from the listener, was that guy was doing observability before it was a product.
Yeah.
So the interesting thing about search, One of the things that we've learned over the years is that search which is kind of everywhere, Like people start using search to build applications. It's not just about Initially when plastic search came out, it was about adding search to a website or adding it to a product search. That's right, So you know, you see what e commerce sites starting to integrate US. But people started building applications on top of US.
They started building like matchmaking sites, or signal intelligence systems or fraud detection systems. It became sort of a platform for building things. But one of the most popular was people using US as a log analytics solution, right, using US to store and query logs. So rather than you know, do and doing grap They would use us as a solution, ship blogs to us and then run run fast queries on it. From there, people said, hey, if I'm going to use you for logs, can I use you for metrics?
Can I use you for tracing? Can I use you for other things? Right, we started providing a complete observability platform.
And then that's the whole thing. Is like part of the challenge of doing this is all the different sources. So the fact that you have a place to drop all those sources routinely, so it's already in one spot and it's.
All in one one data story.
Yeah, and a quick one that can do a joint between those different rest laces when you need to.
Well, this is actually one of the one of the things I love to show about ESQL is being able to do a query across metrics and logs and traces and kind of blows people's minds, like, I'm going to do a query that joins data and creates this, show me all the all the hosts that have you know, ninety percent CPU and that have had a log in failure over the last hour, and that have had and you can combine different types of queries across different signal types, and it's kind of magical.
And it's powerful.
So I know that our listeners probably know more about Azure than they do about Elastic, and your audience probably knows more about Elastic than about Azure. Is there? Is that a fair statement?
I think that's fair.
Yeah, that's fair. Yeah, And so what can we tell these people about Azure if there if this is a new concept, do you know? I guess I have a customer right now that's all on prem and was picking my brain about moving to Azure, you know, and my response was, well, why aren't you there? Now?
You know?
It's like, because there's an inherent fear. This is my this is my word, it's the word of the week. Yeah, there's a fear by people that I think they don't trust moving their data somewhere else where they can't keep a watch on it. And my my response is, all right, so you have how many guys in your I T department? Two? Three? Okay?
Do they all sleep at the same time? Yeah? Okay, So you know, in Azure, you've got hundreds probably of people all around the world that are watching over your data while you sleep, while you're awake, and who do you trust more Joe in It, who's a sleep eight hours of the day, or you know, the the Azure team that is watching over your fate at twenty four to seven. So that's my pitch. What do you what would you say to your your customers.
About why they should move to Azure or yeah, yeah, if you're on prem. Uh, you know, every every company that's started on prem is starting to think about the cloud. They've had this conversation for ten fifteen years. At this point, you're kind of feeling.
Like a late to the game. Yeah, but they're still out there obviously, Yeah, just having a conversation. Yeah.
So but yeah, I think most customers should be thinking about it. If they aren't already, you're not going to get the efficiencies of doing it yourself. There was there was this movement a few years ago where people started going back to their own data centers because they thought they could do it cheaper. And you can't, Like, you can't. You don't get the efficiencies at the scale that the cloud providers get like Azure. You don't get the like
the ability to buy bandwidth in huge amounts. If you're trying to buy bandwidth by yourself. You're trying to buy servers by yourself, you're gonna pay a lot more. Sure, so any any savings that you think you can get is just going to be wiped away by.
Especially if you're paying by the transaction. That's right.
Yeah, but yeah, we did this whole series on run Ass Radio where a whole bunch of folks list lifted and shifted their vms into the cloud. Then we're shocked when the bill was big, Yeah, not recognizing you've run those vms twenty four hours a day, like you're paying twenty four hours a day for them. Yeah, and then moving up to the platform pieces was more efficient, but then they haul them back and they're just ignoring a
bunch of the numbers. You know, you pay for the hardware once, so you forget about advertising across the period much less the replacement costs, and you know, all those other pieces to go into it.
And the difficulty of servicing them twenty four to seven.
Yeah, and then what a twenty four seven knock actually costs?
Yeah, it's expensive and it the minimum the minimum number of people you need to employ to do it properly is high. Yeah. Yeah, and you just can't get the scale like that, that's the biggest thing.
Like, yeah, if you're big enough in this debate, and it is still a debate because now we get into elastic utilization. Right when I had to build out websites, we built for peak. You know, you had to have enough gear to handle the peak load and then it ran its sixty percent utilization if you were lucky and you don't deal with that with the cloud, your peak can move around and you you scale dynamically. You only pay for what you use.
If you're a retailer and you're having to build for Black Friday or peak, that's yeah, it's crazy.
Once you rather just moving on or let it do that, not moving.
The knob moves by itself.
I can see it. It's moving. Yeah, it's not.
The same at all anymore. But yeah, it's been years since I've said, you know, if you haven't already moved the cloud, your CFO is looking at you're like, what are we doing?
Well?
I think yeah, I think that's a conversation most people had ten to fifteen years ago. Though, the conversation over the last couple of years is what's your AI strategy?
Yeah?
Right, Yeah, every every boardroom is asking their your exact team, like, what what's your ais ATEU? What are we doing to uh automate everything through AI? And that's a much harder question if you're not already on cloud. So if you, if you're, if you, if you skipped that way, you're already behind because the next thing is going to be like, you know, what are we doing to automate things with AI? What do we doing to automate sales? What are we
doing to automate marketing? You know, are the engineers and our company using AI tools?
Most these tools are dependent on cloud. They dependent on You need to have your data there already if you're going to take advantage of That's right.
All right, good, we've beaten that horse. Is there anything that we haven't talked about that you would like to mention?
Mostly just uh that you know, we love the fact that Azure has been such a great partner with us and integrating us into you know, in such a tight way, into the experience, uh for customers who want to use you know, the best vector database out there. We are integrated already into Azures. So it's a phenomenal experience. I've said that already, But like you're the number one.
Yeah, yeah, I love.
I love that we have such a tight partnership and it creates a great experience for our customers and I will keep make sure that people go out and try it.
It's awesome.
Well that sounds like the end of the show, So thanks very much, Ken, Yeah, thank you for the pleasure having you and talking to you. I learned a whole lot and I'm sure listeners to too, And we'll talk to you next time on dot net rock. Dot Net Rocks is brought to you by Franklin's Net and produced by Pop Studios, a full service audio, video and post production facility located physically in New London, Connecticut, and of
course in the cloud online at pwop dot com. Visit our website at d O T N E t R O c k S dot com for RSS feeds, downloads, mobile apps, comments, and access to the full archives going back to show number one, recorded in September two thousand and two. And make sure you check out our sponsors. They keep us in business. Now go write some code, see you next time.
You got Jamtle Vans