A new study that reveals how large language models (LLMs) encode truthfulness internally. The research focused on specific response tokens that determine correctness across various models, indicating that LLMs have a structured way of representing truthfulness. This finding could lead to improved reliability in AI outputs, particularly in critical applications like healthcare, where inaccuracies can have serious consequences. The episode also highlights the release of the Open Source AI definiti...
Oct 31, 2024•12 min•Ep 1457•Transcript available on Metacast CISA has garnered over 230 voluntary commitments from software manufacturers to adopt safer software development practices as part of the secure-by-design initiative. This initiative aims to address critical vulnerabilities, particularly those arising from memory-unsafe programming languages, which account for 60 to 70 percent of security issues. The agency has also released a document titled "Product Security Bad Practices," inviting public comments to guide vendors on best practices for enhanc...
Oct 30, 2024•15 min•Ep 1456•Transcript available on Metacast A new U.S. AI security framework has been introduced, emphasizing the importance of innovation, compliance, and national defense. The episode highlights a playbook from the International Data Corporation that outlines the role of Chief Artificial Intelligence Officers (CAIOs) in guiding public sector agencies through the integration of AI and machine learning. Key findings from the report reveal that many agencies are prioritizing generative AI projects while facing challenges such as a shortage...
Oct 29, 2024•13 min•Ep 1455•Transcript available on Metacast The episode starts with the significant impact of generative AI on IT spending, which is projected to exceed $5.3 trillion this year. A notable 35% year-over-year increase in infrastructure spending is attributed to investments in AI, with server sales expected to nearly triple from 2023 to 2028. Gartner analyst John-David Lovelock emphasizes the importance of careful navigation of vendor offerings to ensure a strong return on investment as organizations transition from pilot programs to full-sc...
Oct 28, 2024•14 min•Ep 1454•Transcript available on Metacast In this episode of The Business of Tech, host Dave Sobel engages in a thought-provoking discussion with Eitan Koter, CEO of Vimmi, about the evolving landscape of e-commerce and the rise of shoppable video. Koder emphasizes the necessity for managed services providers and IT services companies to adapt to the changing market by integrating e-commerce solutions that allow customers to purchase directly online. He highlights the growing trend of social commerce, driven by platforms like TikTok, wh...
Oct 27, 2024•20 min•Ep 1435•Transcript available on Metacast This episode delves into the ongoing remote work debate, particularly focusing on Amazon's recent mandate requiring employees to return to the office five days a week starting in 2025. This decision has sparked significant backlash, with a Newsweek study indicating that a majority of remote workers would consider resigning if forced back into the office. The dissatisfaction is echoed in a poll revealing that 91% of Amazon employees are unhappy with the policy, and many express concerns about its...
Oct 25, 2024•15 min•Ep 1450•Transcript available on Metacast A recent survey by Appen reveals a drop in both the deployment of AI initiatives and their return on investment. The survey indicates that the mean percentage of AI projects deployed has fallen from 55.5% in 2021 to 47.4% in 2024, with significant ROI dropping from 56.7% to 47.3%. Appen attributes these declines to a lack of high-quality training data, emphasizing the importance of expertly labeled data in enhancing AI model accuracy. Additionally, a Gartner report shows that nearly half of busi...
Oct 24, 2024•13 min•Ep 1449•Transcript available on Metacast A survey by Kaseya reveals that human behavior remains the primary challenge for IT professionals, with 89% citing insufficient training and poor user habits as significant issues. Phishing continues to be the top threat, affecting 58% of businesses, while the adoption of cyber insurance has surged from 27% in 2023 to 61% in 2024, indicating a growing awareness of cyber threats. As IT budgets stabilize, organizations are prioritizing investments in cloud security and security awareness training....
Oct 23, 2024•15 min•Ep 1448•Transcript available on Metacast A recent Salesforce survey reveals that while 84% of CIOs view AI as a game-changer, only 11% have fully implemented AI systems. The survey highlights a significant gap between the recognition of AI's potential and the reality of its adoption, with CIOs allocating four times more of their budgets to data initiatives than to AI projects. This prioritization underscores the importance of data security and infrastructure as foundational elements for successful AI integration. Further insights from ...
Oct 22, 2024•15 min•Ep 1447•Transcript available on Metacast Host Dave Sobel discusses the current state of the U.S. economy, highlighting a 0.4% increase in retail sales for September, which counters fears of an economic slowdown. Notably, sectors such as clothing, restaurants, and pet stores saw significant spending increases, while furniture and electronics experienced declines. Sobel also references Kindrall's 2024 readiness report, revealing a disconnect between executives' confidence in their IT infrastructure and its actual preparedness for future ...
Oct 22, 2024•15 min•Ep 1446•Transcript available on Metacast In this episode of The Business of Tech, host Dave Sobel engages in a deep conversation with Avi Perez, co-founder and CTO of Pyramid Analytics, who brings over 16 years of experience in the field of artificial intelligence and business intelligence. The discussion begins with a historical perspective on the evolution of AI, particularly in the realm of business intelligence, highlighting how AI has been a central component of BI for many years, long before the recent surge in popularity due to ...
Oct 20, 2024•20 min•Ep 1434•Transcript available on Metacast Host Dave Sobel engages in a thought-provoking conversation with Steven Cook, the owner of Strategic IT Services, a managed service provider (MSP) specializing in cybersecurity. Steven shares insights into the diverse range of services his organization offers, from general technical support to cybersecurity and disaster recovery. With a focus on co-managed IT, Steven explains how his company assists businesses of varying sizes, from solopreneurs to larger organizations in regulated sectors like ...
Oct 18, 2024•23 min•Ep 1442•Transcript available on Metacast A recent MIT report revealing that 78% of businesses face challenges in AI adoption due to weak data foundations. Despite high aspirations for AI, such as enhancing efficiency and fostering innovation, only a small percentage of business leaders feel adequately prepared to engage with AI technologies. The report highlights that data governance and quality are significant obstacles, emphasizing the need for organizations to address underlying data issues before embarking on AI projects. The episo...
Oct 17, 2024•12 min•Ep 1445•Transcript available on Metacast A recent Accenture survey indicates that nearly two-thirds of businesses are planning to increase their investments in AI and automation over the next two years, driven by positive outcomes from existing initiatives. However, challenges such as data readiness, infrastructure, and skill shortages threaten to hinder successful AI adoption. Gartner's prediction that one-third of generative AI projects may be abandoned by 2025 due to rising costs and unclear business value adds to the urgency for or...
Oct 16, 2024•14 min•Ep 1444•Transcript available on Metacast A recent GoDaddy survey reveals that inflation, taxes, and housing costs are top of mind, with 93% of respondents prioritizing wage and cost inflation. The survey also indicates a shift in voting behavior among small business owners, with many anticipating a significant impact from the elections on their future. Despite economic uncertainties, a majority of small business owners remain optimistic about growth in the coming year. Host Dave Sobel highlights the economic landscape, noting the poten...
Oct 15, 2024•13 min•Ep 1443•Transcript available on Metacast Host Dave Sobel sits down with Collin Graves, CEO of North Labs, to delve into the critical realm of data governance and analytics. Northlabs has positioned itself as a data operations partner, akin to a data Managed Service Provider (MSP), helping organizations design, implement, and operate their data capabilities. Collin explains that their approach encompasses a wide range of data projects, including internal and customer-facing analytics, Internet of Things (IoT) solutions, automation, and ...
Oct 13, 2024•20 min•Ep 1433•Transcript available on Metacast In this episode of the Business of Tech Lounge, host Dave Sobel engages in a thought-provoking discussion with technology writer Paris Marx, who brings a critical perspective on the hidden costs associated with business-to-business technology, particularly focusing on hyperscale data centers and the implications of artificial intelligence (AI). The conversation begins with an exploration of the environmental and economic impacts of these massive data centers, which have become essential for clou...
Oct 12, 2024•38 min•Ep 1439•Transcript available on Metacast Analysts from Jeffreies predict that true AI integration in smartphones, particularly with the iPhone 16, is still two to three years away, leading to a downgrade in Apple's stock rating. Despite some optimism for future AI capabilities, the episode emphasizes the need for human involvement in AI applications, especially in cybersecurity, as noted by CISA's chief AI officer, Lisa Einstein. The conversation shifts to the healthcare sector, where host Dave Sobel shares alarming statistics about th...
Oct 11, 2024•12 min•Ep 1441•Transcript available on Metacast Marriott was issued a hefty $52 million fine following major data breaches that compromised the personal information of over 344 million customers. The Federal Trade Commission (FTC) settlement mandates that Marriott enhance its security measures, including implementing multi-factor authentication and allowing customers to request data deletion. Host Dave Sobel emphasizes the long-term implications of such breaches, particularly for small and medium-sized businesses (SMBs) that may not have the ...
Oct 10, 2024•12 min•Ep 1440•Transcript available on Metacast T-Mobile and Starlink have launched a satellite texting service that will allow emergency alerts and basic texting for T-Mobile subscribers, even if they lose network connectivity. This initiative is part of a broader response to the hurricane, with over 10,000 Starlink kits being delivered to assist those affected. Sobel also highlights the growing coordination among managed service providers (MSPs) and IT service providers on platforms like Reddit to offer support during this crisis. The episo...
Oct 09, 2024•13 min•Ep 1438•Transcript available on Metacast The National Institute of Standards and Technology (NIST) facces ongoing challenges regarding its backlog of security vulnerability reports. Despite some progress, NIST missed its September 30th deadline to restore processing speeds to pre-February levels, leaving over 17,000 Common Vulnerabilities and Exposures (CVEs) unprocessed. This backlog poses significant risks to organizations, as they may remain unaware of vulnerabilities that are actively being exploited. The episode highlights the imp...
Oct 08, 2024•11 min•Ep 1437•Transcript available on Metacast The latest trends in the U.S. labor market highlight a resilient job landscape despite challenges faced by small and medium-sized businesses (SMBs). The September jobs report revealed that employers added 254,000 jobs, lowering the unemployment rate to 4.1%. However, SMBs are struggling to fill positions, with 34% of owners unable to find qualified applicants, leading to a decrease in hiring attempts. This situation suggests that SMBs may increasingly rely on technology solutions to maintain ope...
Oct 07, 2024•12 min•Transcript available on Metacast Host Dave Sobel welcomes Craig Petronella, founder of Petronella Technology Group, to discuss the evolving landscape of technology compliance and cybersecurity. With a focus on the Cybersecurity Maturity Model Certification (CMMC), Craig highlights its significance for defense industrial base contractors and its potential to streamline compliance across various industries. He emphasizes that while regulations like HIPAA and FTC compliance exist, they often lack a consistent framework, leading to...
Oct 06, 2024•20 min•Transcript available on Metacast Dave welcomes Carolyn April, Vice President of Industry Analysis at CompTIA, for an insightful discussion on the current state of the IT service provider channel. They delve into the evolving dynamics between managed service providers (MSPs) and vendors, highlighting a surprising statistic from CompTIA's latest report: 36% of MSPs express distrust in vendors potentially bypassing them to reach customers directly. This skepticism is compounded by a trend of IT providers enrolling in fewer vendor ...
Oct 05, 2024•35 min•Transcript available on Metacast Kyndryl's new services aimed at facilitating the adoption of Microsoft's CoPilot within enterprises, emphasizing the importance of tailoring AI solutions to meet specific business needs. With a focus on enhancing data integrity and continuous optimization, Kyndryl's offerings, including a Co-Pilot Value Discovery Workshop, aim to help organizations effectively implement AI technologies to drive meaningful business outcomes. Sobel also covers Google's recent launch of Gemini 1.5 Flash 8B, a produ...
Oct 04, 2024•13 min•Transcript available on Metacast OpenAI has raised $6.6 billion and secured a $4 billion revolving credit line, bringing its total liquidity to over $10 billion. Despite reporting substantial revenue growth, the company anticipates a $5 billion loss this year due to high GPU costs. OpenAI is also navigating leadership changes and considering a shift to a for-profit model while maintaining its non-profit segment. The episode highlights the competitive landscape, with OpenAI requesting investors to avoid funding rival AI startups...
Oct 03, 2024•11 min•Transcript available on Metacast The rollout of Windows 11 version 24H2 introduces a range of AI-powered features, such as enhanced Energy Saver, improved Bluetooth LE audio support, and Wi-Fi 7 compatibility. Notably, Microsoft has integrated Rust into the Windows kernel and introduced new functionalities for its CoPilot AI, which now includes natural voice interaction and daily news summarization. However, the update also marks the end of support for Windows Mixed Reality headsets, as Microsoft shifts its focus away from hard...
Oct 02, 2024•11 min•Transcript available on Metacast Mira Murati, the Chief Technology Officer, along with two other executives, announced their departures amid a critical restructuring phase for the company. As OpenAI transitions from a non-profit to a for-profit benefit corporation while seeking over $100 billion in investment, Sobel highlights the potential implications of these changes on the generative AI market, suggesting a possible consolidation as the industry grapples with high operational costs and limited use cases. Host Dave Sobel als...
Oct 01, 2024•12 min•Transcript available on Metacast Host Dave Sobel discusses the evolving landscape of IT budgets, emphasizing a significant shift towards AI and data modernization. Accenture's recent earnings call reveals that enterprises are reallocating their IT spending to focus on enhancing digital capabilities and workforce upskilling, rather than increasing overall budgets. This trend is underscored by Gartner's forecast that AI-enabled PCs will dominate global shipments, particularly in the consumer market, indicating a growing reliance ...
Sep 30, 2024•11 min•Transcript available on Metacast Host Dave Sobel engages in a compelling conversation with Eric O'Neill, a former FBI operative renowned for his role in capturing notorious spy Robert Hansen. The discussion delves into the evolution of espionage over the past two decades, highlighting how traditional spycraft has transitioned into the realm of cyber espionage. O'Neill explains that while classic methods like dead drops and clandestine meetings still exist, the majority of modern espionage is conducted through cyber attacks, whe...
Sep 29, 2024•21 min•Transcript available on Metacast 
