Sr. Content Developer at Microsoft, working remotely in PA, TechBash conference organizer, former Microsoft MVP, Husband, Dad and Geek.
162216 stories
·
33 followers

This Week in AI: Agents Are Outrunning the Systems Around Them

1 Share

On the latest episode of This Week in AI, host Vicki Reyzelman, a senior solutions engineer at Akamai, traced a common problem across cybersecurity, energy, model releases, consumer hardware, and regulation. AI agents can now probe networks, coordinate with other agents, make purchases, and interact with real-world systems faster than many organizations can respond. We’re seeing those capabilities move into systems built for slower, more predictable software.

Security has to operate at agent speed

Vicki opened with an incident in which an OpenAI agent reportedly found ways around security controls while researching public information in Australia’s Medicare system. The activity didn’t expose any  personal Medicare records, but OpenAI reportedly took 54 days to identify the incident and another month to notify the government. A response cycle measured in weeks can’t keep pace with systems that can test defenses in seconds.

She also brought up the recent Hugging Face incident involving a swarm of 1,200 agents that exchanged roughly 70,000 messages while coordinating their work. Agents can change tactics faster than traditional security processes play out, so teams can no longer rely on the familiar methods of addressing suspicious behavior. Companies are now experimenting with runtime enforcement, agent sandboxes, enterprise browsers, and other controls that sit closer to execution.

Policymakers are searching for workable controls too, from California proposals for emergency AI shutdown mechanisms to international discussions about independent model evaluation. Teams can’t govern agent behavior they can’t see, so they need to know what an agent did and when its behavior crossed a boundary.

Power and latency are becoming model decisions

Power is one constraint software teams can’t code their way around. Vicki pointed to a $2 billion US Department of Energy investment across 26 states alongside hundreds of billions of dollars in planned AI spending from Microsoft, Amazon, Alphabet, and Meta. Data centers can add servers quickly, but it won’t make a difference if the grid can’t provide the energy those servers require.

Meanwhile, major model releases are arriving roughly every 17 days, with context windows now exceeding one million tokens. Open weight and edge models are advancing too, particularly around low-latency reasoning. More frequent releases and heavier inference workloads put added pressure on networks, compute, and budgets.

Solving this challenge may mean companies have to run more reasoning at the edge or locally, where systems can reduce latency and avoid sending every request across the network. That gives teams another architectural choice to make alongside model selection. A frontier model may be appropriate for one workload, while a smaller local model may be faster and cheaper for another.

Consumer agents move autonomy into everyday life

Consumer hardware puts those architecture and governance choices directly in users’ hands. AI-enabled glasses, pendants, and other devices stay with users throughout the day and can learn preferences, connect with outside services, and take actions such as shopping or making reservations. Meta’s new Muse agent is one example of that shift.

Meta says the Muse ecosystem already includes roughly 1,500 developer connectors, including integrations with retailers such as Walmart and Best Buy. If more purchases begin with an agent acting for the customer, companies may have to rethink how people discover products and complete transactions. The convenience of Amazon Prime and one-click shopping, for example, looks different when another system is comparing options and buying on a user’s behalf.

Muse already ran into problems, including exposing information it wasn’t supposed to and relying on humans to complete some tasks, such as making dinner reservations. Those failures carry more weight when the software can spend money or act on personal preferences. Users and businesses need clear limits on what an agent can access, what it can do without approval, and how those actions are recorded.

What’s next

Deploying an agent means taking responsibility for the systems around it. Security controls, power and network constraints, local versus remote inference, and permission boundaries all shape what these systems can safely do in production. For practitioners, the job now includes the architecture around the models.

Join us again next Monday for another episode of This Week in AI, when we’ll dive into more of the news and developments shaping the AI era. And check back each Friday for the latest episode, or watch on YouTube, Spotify, Apple, or wherever you get your podcasts.



Read the whole story
alvinashcraft
20 minutes ago
reply
Pennsylvania, USA
Share this story
Delete

What’s new in Windows 365: September 2026 recap

1 Share

Windows 365 has turned five and we continue to focus on helping you get more from your Cloud PCs. Welcome to our new monthly roundup of Windows 365 and Azure Virtual Desktop updates together in one place- your guide to what’s new, why it matters, and how to get started. In this edition, explore September’s improvements to everyday experiences, security and recovery, IT management, and deployment flexibility.

Seamless user experience

This month, we're making Cloud PCs even more flexible and resilient, helping users work with the tools they use every day, initiate provisioning of Windows 365 Reserve Cloud PCs when needed, and stay productive with a seamless experience as network conditions change.

TWAIN scanner redirection

With TWAIN scanners in remote sessions (Public Preview), supported scanners connected to a local Windows device can now be redirected to a Cloud PC using high-level redirection, providing an optimized scanning experience compared with USB redirection.

Figure 1: Scanner and USB device options in Windows App.

User provisioning for Windows 365 Reserve

User provisioning for Windows 365 Reserve (Generally Available) helps employees get back to work when their primary device is unavailable—without waiting for IT to provision a Cloud PC. Once IT enables the capability, eligible users can initiate provisioning directly from Windows App, reducing manual work for administrators while keeping access governed through Microsoft Intune and selected Microsoft Entra ID groups.

RDP Multipath and RDP Shortpath

Windows 365 is gaining more resilient connectivity with RDP Multipath availability in Azure Government (Generally Available) and RDP Shortpath with TURN availability in Azure Government (Phased General Availability Rollout). RDP Multipath helps maintain sessions as network conditions change, with redundant UDP paths now generally available and redundant TCP paths rolling out in phases. RDP Shortpath with TURN is also in a phased general availability rollout, providing relayed UDP connectivity when a direct connection isn’t possible. Together, these updates help users stay productive with fewer session interruptions, even as network conditions change or direct connections are unavailable.

Figure 2: Redundant UDP and TCP paths help maintain Cloud PC session connectivity.

RDP Shortpath and RDP Multipath support in Windows App for macOS (beta) are now supported, bringing RDP Shortpath for public networks and RDP Multipath with UDP for Windows 365 and Azure Virtual Desktop. The update extends UDP-based connectivity and multipath resiliency to macOS.

External identities on macOS and iOS

Windows App is making it easier for external users to connect through macOS support (Generally Available) and iOS support (Preview), extending collaboration to invited users outside the organization without having to create a new user account for them.

Security & reliability

Keeping work secure and available takes both everyday protection and preparation for disruption. This month’s updates strengthen sensitive data protection, expand passwordless authentication, and give IT more options for recovery and regional resilience.

Plan for disruption and simplify recovery

Preparing for disruption starts with a clear recovery plan. Business continuity and disaster recovery in Cloud PC settings (Generally Available) brings point-in-time restore, cross-region disaster recovery, and disaster recovery plus together through a centralized Cloud PC configuration, making recovery options easier to manage for IT admins. Alternate regions for business continuity and disaster recovery (Generally Available) give IT admins more choice in where they back up Cloud PCs. With cross-region disaster recovery and disaster recovery plus, they can now select Australia Southeast, South India, Canada East, or West US to support their recovery and data residency needs. Cloud PC recovery for Windows 365 Government (Generally Available) enables IT admins in GCC and GCCH to reprovision and restore eligible Cloud PCs deprovisioned after a license expired. This extends a recovery capability already available in commercial environments.

Figure 3: Select the Restore option under the Cloud PC overview section.

Protect sensitive content and simplify authentication

Protecting sensitive data goes hand in hand with secure authentication. In-session passwordless authentication on iOS (Preview) lets users respond to supported Microsoft Entra ID sign-in prompts within their Cloud PC session using passkeys through Windows App on their iOS device, without entering a password. Supported methods include physical security keys and QR code experiences. Display protection for Windows 365 (Public Preview) helps reduce the risk of unauthorized screen capture or display interception on the endpoint devices.

Figure 4: Server-side verification that Display Protection is enabled on the endpoint.

Strengthen regional resilience with Azure Virtual Desktop

Regional host pools (Generally Available) give customers a regional deployment option to support enhanced resiliency and additional data sovereignty. This option is generally available in East US 2 and Central US.

Easy manageability

Less time navigating settings means more time supporting your organization. September’s updates help IT teams identify where attention is needed, manage user permissions, and provide Cloud PC environments tailored to different workloads.

Better insights and simpler access controls

To help IT admins see important signals more easily across Cloud PC environment, admin insights for Windows 365 (Generally Available) surfaces prioritized issues and optimization opportunities directly on the Cloud PC Overview page in the Microsoft Intune admin center. These service-generated insights link to relevant reports, where available, to help admins investigate and determine their next steps.

Figure 5: Admin insights on the Cloud PC Overview page.

Meanwhile, the enable local admin in Cloud PC configurations (Public Preview) setting lets IT admins grant selected users local administrator permissions on their Cloud PCs through the centralized Cloud PC configuration experience in Microsoft Intune. This allows users to perform tasks such as installing development tools that require elevated privileges, while IT centrally manages access through Microsoft Intune.

Figure 6: Create a Cloud PC configuration in Microsoft Intune.

Get started faster with Cloud PCs tailored to each workload

Developer configuration with pre-installed Microsoft 365 Apps (Generally Available) helps developers get productive faster by providing essential development tools, Microsoft 365 Apps, and required configurations from the start. The image is available for Windows 365 Enterprise and Windows 365 Flex in dedicated mode. For developers and other users who need separate environments, IT admins can assign multiple Windows 365 Flex Dedicated Cloud PCs to the same user (Generally Available), using either the same or different configurations. This supports scenarios where users need separate environments for different workloads, projects, configurations, or security boundaries while keeping those environments centrally managed.

Azure Virtual Desktop Hybrid 

Azure Virtual Desktop Hybrid (Generally Available) lets organizations modernize their virtual desktop environments without moving every workload to the cloud at once. Azure Virtual Desktop Hybrid enables customers to run session hosts in their own datacenters without requiring the purchase of new hardware or changing their existing hypervisor. Partners including Login VSI, Nerdio, and Nutanix can provide additional lifecycle management functionality with their updated offerings.

Partner news

Building on the Azure Virtual Desktop Hybrid update above, Hydra by Login VSI manages Azure Virtual Desktop across Azure and on-premises Hyper-V, with capabilities for image management, session host lifecycle automation, monitoring, and day-to-day administration.

Nerdio Manager for Enterprise adds support for Azure Virtual Desktop Hybrid on Nutanix AHV, including orchestration, automation, visibility, and management capabilities.

Nutanix AHV supports Azure Virtual Desktop Hybrid session hosts running on-premises while using the Azure Virtual Desktop cloud-based control plane.

For organizations exploring their next step, Nerdio Compass (Public Preview) is a VDI assessment tool that helps organizations evaluate existing environments and plan migration to Windows 365 or Azure Virtual Desktop.

Documentation updates

Windows 365 cloud-native and Zero Trust deployment guidance — New guidance brings recommended decisions across identity, networking, images, updates, management, user data, and clients into one cloud-native, Zero Trust-aligned blueprint.

Figure 7: Comparative deployment pillars

Operational benefits of a cloud-native deployment — A companion article explains how cloud-native deployment decisions can reduce issues, increase administrator self-resolution, and help support cases resolve faster.


Continue the conversation. Find best practices. Bookmark the Windows Tech Community, then follow us on  LinkedIn or @MSWindowsITPro for updates. Looking for support? Visit Windows on Microsoft Q&A.

Read the whole story
alvinashcraft
20 minutes ago
reply
Pennsylvania, USA
Share this story
Delete

Your Agent Shouldn't Wait for a Prompt: Build an Event-Driven Microsoft Foundry Routine

1 Share

Most agents are still waiting in a chat window.

They may be capable of classifying an incident, finding the right documentation, or recommending an owner - but nothing happens until someone remembers to ask. The hard part is no longer always the reasoning. It is noticing that work has arrived, invoking the agent securely, and keeping enough history to understand what happened.

Routines in Microsoft Foundry close that gap. A routine connects a trigger - such as a schedule, timer, GitHub issue, or Microsoft Teams message - to an agent action. Microsoft Foundry queues the invocation, runs the agent, and stores a run record for later inspection.

In this post, we will build an event-driven routine for a familiar developer workflow:

When someone opens a GitHub issue, invoke a triage agent immediately - without waiting for a person to copy the issue into a chat.

Along the way, we will look at the architecture, create the routine with the Azure Developer CLI (azd), test it, inspect its run history, and make an explicit identity decision before putting it into production.

From conversational agents to event-driven agents

A chat-first agent follows a request-response pattern:

  1. A user opens an interface.
  2. The user provides a prompt.
  3. The agent performs work.
  4. The interaction ends or waits for another prompt.

An event-driven agent starts differently. Work in an external system becomes the prompt.

A newly opened issue, for example, already contains useful context: its title, description, author, repository, labels, and timestamps. A routine can receive that event through an authorized connection and invoke an agent while the context is still fresh.

That changes the agent's role. It is no longer only a place people go for answers. It becomes a participant in an operational workflow.

The routine does not replace the agent. It supplies the managed automation around it:

  • Trigger: Defines when work starts.
  • Connection: Authenticates the event source.
  • Action: Identifies the agent and invocation protocol.
  • Dispatch identity: Determines whose permissions are used when the agent and its tools run.
  • Run history: Records executions so operators can inspect outcomes.

This separation is useful. The agent owns the reasoning; the routine owns when and how that reasoning begins.

The scenario: triage every new GitHub issue

Our example assumes that a triage agent is already deployed in a Microsoft Foundry project. When an issue opens, the agent should:

  1. Summarize the issue in two or three sentences.
  2. Classify it as a bug, feature request, documentation issue, or support question.
  3. Estimate severity and explain the evidence.
  4. Recommend an owner or team.
  5. Identify missing reproduction details.
  6. Produce a proposed response for a maintainer to review.

Keeping a human review step is intentional. Event-driven does not have to mean unrestricted autonomy. A routine can automate the expensive first pass while a maintainer remains responsible for labels, assignments, and public responses.

Prerequisites

You need:

  • An active Microsoft Foundry project.
  • The Foundry User role or higher on the project.
  • A deployed prompt agent or hosted agent. Workflow agents are not currently supported by routines.
  • The Azure Developer CLI.
  • A GitHub connection authorized in the Foundry project.
  • The routines extension for azd.

Install the extension and confirm that the routine commands are available:

azd extension install azure.ai.routines azd ai routine --help

Set the project endpoint through your active azd environment or pass it explicitly to each command:

azd env set AZURE_AI_PROJECT_ENDPOINT \ "https://<account>.services.ai.azure.com/api/projects/<project>"

The agent must exist before you attach a routine to it. A routine references an agent; it does not deploy one.

Create the GitHub issue routine

The following command creates an enabled routine named triage-on-open. Replace the placeholders with the connection and repository details from your environment:

azd ai routine create triage-on-open \ --trigger github-issue \ --connection-id "<workspace-connection-id>" \ --owner "<github-owner>" \ --repository "<github-repository>" \ --issue-event opened \ --action agent-invoke \ --agent-name "triage-agent" \ --description "Triage every newly opened GitHub issue"

There are two important type translations in this command:

  • The CLI alias github-issue represents the routine trigger type github_issue.
  • The CLI alias agent-invoke invokes the agent through the Invocations API.

If your agent uses the Responses API instead, use --action agent-response. Choose the protocol that matches the deployed agent rather than treating the two actions as interchangeable.

For automation that belongs in source control, define the routine as an azure.ai.routine service in azure.yaml. This makes the relationship between the agent and its trigger reproducible across environments:

services: triage-agent: host: azure.ai.agent project: ./agent triage-on-open: host: azure.ai.routine uses: - triage-agent description: Triage every newly opened GitHub issue enabled: true triggers: issue-opened: type: github_issue connection_id: ${GITHUB_CONNECTION_ID} owner: ${GITHUB_OWNER} repository: ${GITHUB_REPOSITORY} issue_event: opened action: type: invoke_agent_invocations_api agent_name: triage-agent

Deploy the routine after the target agent:

azd deploy triage-on-open --no-prompt

The uses relationship tells azd to order the agent before the routine. Deployment is idempotent: redeploying updates the named routine instead of creating duplicates.

Give the agent a clear triage contract

Automation magnifies ambiguity. A vague instruction that is merely inconvenient in a chat can produce inconsistent work every time an event fires.

Give the triage agent a bounded contract such as:

You are the first-pass triage agent for this repository. For each newly opened issue: 1. Summarize the reported behavior without adding facts. 2. Classify it as bug, feature, documentation, or support. 3. Assign severity only when the issue contains supporting evidence. 4. List missing information needed to reproduce or route the issue. 5. Recommend an owner from the approved ownership map. 6. Draft a response, but do not publish, close, label, or assign the issue. Return structured JSON that matches the triage schema.

A useful output contract might look like this:

{ "summary": "The CLI exits when a project endpoint contains an explicit port.", "category": "bug", "severity": { "level": "medium", "reason": "The issue blocks routine creation but has a documented workaround." }, "missing_information": [ "Azure Developer CLI version", "Redacted project endpoint shape", "Full error output" ], "recommended_owner": "developer-experience", "proposed_response": "Thanks for the report. Could you share..." }

Structured output gives downstream systems something predictable to validate. It also makes evaluation easier: you can test category accuracy, required-field completeness, unsupported severity claims, and whether the agent attempted a prohibited action.

Test before waiting for a real event

Start by checking that Foundry stored the routine you intended:

azd ai routine show triage-on-open --output json

Confirm:

  • The routine is enabled.
  • The trigger watches the correct owner and repository.
  • issue_event is opened.
  • The action references the intended agent.
  • The connection ID belongs to the expected Foundry project.

You can manually dispatch a routine while testing:

azd ai routine dispatch triage-on-open \ --input '{"test":true,"issue":{"number":123,"title":"Test triage event"}}'

The manual input is a one-time override for that dispatch. It does not replace the event payload or modify the routine's stored configuration.

Inspect recent executions:

azd ai routine run list triage-on-open --top 20

Then open a test issue in the watched repository and inspect the run list again. A production test should verify more than "the agent ran." Check that the correct event started the run, the agent received enough context, tool calls used the intended identity, the output matched the schema, and prohibited actions did not occur.

 

Choose the dispatch identity deliberately

Every routine uses the agent identity by default. This is usually the better fit for unattended automation because access belongs to the agent rather than to an employee's account.

Use agent identity when the agent's tools authenticate with managed identity, workload identity, or keys and the agent has been granted only the permissions required for the task.

Some tools require delegated user access. In that case, you can create the routine with creator identity. Creator identity means the Microsoft Entra identity of the person or service principal that creates the routine—not the agent publisher, connection creator, latest editor, or user who caused an event.

This distinction has operational consequences:

  • If the creator loses access or consent, delegated tool calls can fail.
  • Recreating the routine as another principal changes the delegated creator identity.
  • The event connection identity is separate from the identity used to dispatch the agent.
  • Dispatch identity is a creation-time decision. To switch an existing routine between agent and creator identity, delete and recreate it.

For a GitHub triage flow, a strong starting design is:

  • Use a narrowly scoped project connection to receive issue events.
  • Use agent identity for Foundry and Azure resources.
  • Keep repository-changing actions disabled until evaluation demonstrates reliable behavior.
  • Require human approval before posting, assigning, labeling, or closing.

Identity is not a deployment detail. It is part of the automation's behavior and should be reviewed with the same care as the prompt and tool list.

Make failure visible

An event-driven agent can fail even when its reasoning is sound. The connection might expire. The agent might receive an unexpected payload. A tool might lose permission. The output might violate its schema.

Monitor the workflow at four boundaries:

  1. Trigger: Did the expected event fire the routine exactly once?
  2. Invocation: Did Foundry invoke the intended agent and protocol?
  3. Tools: Did tool calls succeed with the intended identity and scope?
  4. Outcome: Did the output satisfy the triage contract?

Use azd ai routine run list for routine execution history and your agent's Foundry observability data for traces, tool calls, latency, and failures. Preserve representative failures as evaluation cases instead of fixing each incident only in the prompt.

Also design for duplicate delivery. Before taking a repository-changing action, check whether the issue and event have already been processed. Idempotency matters more once an agent can act without a person initiating each run.

Know the current boundaries

Before adopting routines for a regulated or business-critical workload, review the current service constraints:

  • Routines support prompt agents and hosted agents, but not workflow agents.
  • A recurring schedule has a minimum interval of five minutes.
  • GitHub issue triggers support opened and closed issue events.
  • Routines inherit the project's networking configuration and can work with virtual-network-secured projects.
  • Routines do not currently support customer-managed key encryption.
  • Regional availability has exceptions; verify your project's region in the current documentation.

These boundaries can change. Treat the routines documentation as the source of truth when moving from a tutorial to production.

What changes when agents stop waiting?

The most interesting part of this design is not the GitHub trigger. It is the change in operating model.

The agent begins work because the world changed, not because someone opened a chat. That makes trigger scope, identity, output contracts, run history, evaluation, and human approval part of the agent design—not infrastructure to consider later.

Once the triage routine is working, the same pattern can support:

  • A Teams message that starts support classification.
  • A nightly backlog review.
  • A one-time release-readiness check.
  • A scheduled compliance summary.
  • A hosted agent that uses the reminder tool to resume the same conversation after a long-running task.

Start with one bounded event and one reversible outcome. Measure what the agent does, not merely whether it ran. Then expand its permissions only as evidence earns that autonomy.

Try it next

Choose the path that matches where you are:

  • Build: Follow the Microsoft Foundry routines documentation and connect one existing agent to a schedule or event.
  • Harden: Review dispatch identity, connection scope, idempotency, output validation, and human approval before enabling repository-changing tools.
  • Extend: Add the reminder tool to a hosted agent that needs to continue work later.
  • Explore: Open the Microsoft Foundry portal to inspect your project, agents, and routine runs.

Your agent already knows how to do useful work. The next step is teaching it when that work should begin.

Read the whole story
alvinashcraft
20 minutes ago
reply
Pennsylvania, USA
Share this story
Delete

Build expressive voice experiences with new MAI models in Microsoft Foundry

1 Share

A voice agent has to do more than hear a request and produce a reply. It has to keep the interaction moving while it listens, reasons, uses tools, and speaks. A delay at either end can turn a conversation into a series of awkward pauses.

Today, we’re introducing three new Microsoft AI (MAI) models in Microsoft Foundry:

  • MAI-Transcribe-2-Streaming, which turns live speech into text as it arrives
  • MAI-Voice-2.1, our most expressive multilingual text-to-speech model yet
  • MAI-Voice-2.1-Flash, optimized for responsive, high-volume voice applications.

Together, they give developers more choice in how to build natural voice experiences.

MAI-Transcribe-2-Streaming: Understand speech while it’s happening

Earlier this month, we introduced MAI-Transcribe-2, raising the bar for transcription accuracy, speed, and cost efficiency. It ranked #1 on FLEURS for multilingual accuracy and #1 on the Artificial Analysis accuracy × latency Pareto frontier, giving developers high-quality transcription without trading away speed. With MAI-Transcribe-2-Streaming, we’re extending that leadership to real-time conversations.

Instead of waiting for someone to finish speaking before returning text, MAI-Transcribe-2-Streaming transcribes continuously across 60 languages, with automatic language detection. It produces its first hypotheses, known as partials, within the low hundreds of milliseconds of receiving audio, then refines them as more context arrives and commits a stable transcript once the utterance ends.

That distinction matters when an application needs to act while someone is speaking. A customer-service agent can begin identifying a caller’s request before the sentence is complete. A voice assistant can start reasoning or preparing a tool call sooner. A live transcription experience can surface words almost as quickly as they are spoken.

And the proof is in the results. MAI-Transcribe-2-Streaming debuts at #1 for accuracy on both partial and final transcripts on the Artificial Analysis leaderboard. In most cases, words appear in the transcript as early as 320 milliseconds after they’re spoken, while the closest competition takes more than 500 milliseconds.

 

Together, MAI-Transcribe-2 and MAI-Transcribe-2-Streaming give developers a choice depending on the experience they’re building:

 

  • MAI-Transcribe-2 for when you need high-quality transcription with capabilities like speaker diarization and word-level timestamps
  • MAI-Transcribe-2-Streaming for when your application needs to understand and act on speech as it happens.

MAI-Voice-2.1: One voice across languages

The other half of a voice experience is how it sounds. MAI-Voice-2.1 generates natural, expressive speech across 23 languages, with a consistent voice identity across supported languages.

A tutoring app, for example, can move from an English explanation to a Mandarin exercise without sounding as though a different teacher has taken over. A multilingual assistant can respond in the user’s language while retaining the voice people recognize. The model adapts its pronunciation and delivery to the language rather than carrying one accent across every response.

Choose MAI-Voice-2.1 when voice quality is central to the experience: interactive learning, branded assistants, narration, or content where expression and consistency matter.

MAI-Voice-2.1-Flash: Responsive speech at scale

MAI-Voice-2.1-Flash supports the same languages and cross-language voice identities, but is optimized for workloads where response time and volume are critical. In the supplied comparison, Flash is 55% faster and 60% less expensive than competing models in its class*.

That makes Flash a natural fit for live support agents, voice assistants, and other applications that generate spoken responses throughout the day. Developers can choose MAI-Voice-2.1 when expressive fidelity is the priority, or Flash when they need to balance natural speech with responsiveness and cost at scale.

Put the models to work together

These models really come to life when applied together to build expressive voice agents. Consider a customer calling to change a reservation. MAI-Transcribe-2-Streaming begins returning text while the customer is still speaking. The agent can identify the emerging request, check availability, and prepare an action. Once it has an answer, MAI-Voice-2.1-Flash delivers the response in natural speech. Saving time in listening and speaking gives the agent more room to reason and use tools while keeping the exchange conversational.

Developers can apply the same pattern to:

  • Customer-service agents that follow a request as it unfolds, retrieve relevant information, and respond aloud.
  • Multilingual assistants that recognize the spoken language and reply in a consistent voice across supported languages.
  • Interactive learning experiences that move between languages, speakers, and conversational exercises.
  • Live captions and voice-driven interfaces that surface words as they arrive instead of waiting for a completed recording.

Start building

All three models are available in Microsoft Foundry through Azure Speech and with direct API access through Microsoft Foundry:

-          MAI-Transcribe-2-Streaming is available at an introductory price of $0.54 per hour of audio through the end of the year.

-          MAI-Voice-2.1 is available at $22 per 1M characters

-          MAI-Voice-2.1 Flash is available at $15 per 1M characters

We’re also excited to make these models available through additional platforms, including OpenRouter, Vercel, and LiveKit, giving developers more ways to discover, access, and build with MAI models.

 

*Source: Models | ElevenLabs Documentation

Read the whole story
alvinashcraft
20 minutes ago
reply
Pennsylvania, USA
Share this story
Delete

Foundry IQ in Microsoft Copilot Studio is now generally available

1 Share

Today, we're announcing the general availability of the Foundry IQ integration with Microsoft Copilot Studio. Users can connect a Foundry IQ knowledge base to an agent in Copilot Studio, giving the agent access to grounded enterprise knowledge and citations. Additionally, for organizations that require zero public network exposure, the GA release includes full private connectivity through Azure Private Link. 

Bring enterprise knowledge into your Copilot Studio agent

Enterprise data is spread across systems, governed by different access policies, and often available only through private networks. Connecting an agent to that data must fit the organization's identity, access, encryption, and networking requirements.

Foundry IQ provides a managed knowledge layer for agents, enabling Copilot Studio makers to connect to a single knowledge base that handles enterprise data access, retrieval, ranking, and permissions without requiring each source to be configured separately.

With the generally available integration, makers can:

  • Connect to a Foundry IQ knowledge base they are authorized to access.
  • Authenticate with an API key, client certificate, service principal, or Microsoft Entra ID integrated authentication.
  • Use Azure Private Link and Power Platform VNet support to connect without enabling public access on the underlying Azure AI Search service.
  • Work within established enterprise controls for authentication, permissions, encryption, and network isolation.
  • Inspect the activity trace to confirm that Foundry IQ performed retrieval and review the items returned to the agent.

Connect through a virtual network (VNet)

Private connectivity combines two capabilities:

  1. Azure Private Link for Foundry IQ, gives the service behind Foundry IQ a private IP address.
  2. Power Platform VNet support routes supported Copilot Studio connection traffic through delegated subnets.

1. Configure the private endpoint

On the Azure AI Search service that backs your Foundry IQ knowledge base:

  1. Open Networking and create a private endpoint for the Foundry IQ sub resource.
  2. Select the virtual network and subnet that will host the endpoint.
  3. Enable private DNS integration with privatelink.search.windows.net.
  4. Validate private connectivity, then disable public network access.

Note: Clients continue to use https://<service-name>.search.windows.net; private DNS resolves the address to the service's private IP.

2. Enable Power Platform VNet support

  1. Create dedicated subnets in the Azure regions required for your Power Platform environment and delegate them to: "Microsoft.PowerPlatform/enterprisePolicies"
  2. Keep the Foundry IQ private endpoint in a separate subnet. If it is in another virtual network, configure peering or another private route. Ensure private DNS resolution and HTTPS traffic to the endpoint are allowed.
  3. Create a subnet-injection enterprise policy for the delegated subnets, then assign it in the Power Platform admin center under Security > Data and privacy > Azure Virtual Network policies. Confirm that the environment's history shows a Succeeded status.

 

3. Connect Foundry IQ in Copilot Studio

  1. Open the agent and select Build.
  2. Select Tools > Foundry IQ > Create new connection.
  3. Choose an authentication method and enter the standard Azure AI Search endpoint.
  4. Create the connection, select a knowledge base, and add it to the agent.
  5. Give the connection a clear name and description, then save the agent.

Note: Use Microsoft Entra ID authentication when it fits your organization's requirements and apply least privilege for every authentication method.

4. Validate before publishing

Ask a question that the knowledge base should answer, then verify:

  • The response contains the expected grounding and citations.
  • The activity trace shows a Foundry IQ retrieval step.
  • Users with different permissions receive only authorized content.
  • Network traffic reaches Azure AI Search through the private endpoint.
  • The service isn't reachable through its public endpoint.

If the answers aren't what you expect, review the knowledge base sources, retrieval instructions, and ranking settings in Foundry IQ.

VIDEO

Get started

 

Foundry IQ in Copilot Studio is generally available today, giving organizations a direct way to ground agents in enterprise knowledge while retaining the security controls required for production.

Read the whole story
alvinashcraft
20 minutes ago
reply
Pennsylvania, USA
Share this story
Delete

GitHub’s advice for its new Copilot feature is to try something else first

1 Share
Tangled lines

GitHub launched computer use in public preview on Thursday, giving Copilot CLI and its desktop app the ability to operate applications on macOS and Windows. Agents can read app content and click, type, scroll, and drag, including in older, GUI-only software with no API, command-line interface, or MCP integration.

An expense report in Safari was GitHub’s launch demonstration but the company described other uses including summarizing information in a legacy application, updating a presentation, entering data, and moving information between apps. Developers can access the feature from the terminal or through the Copilot app, which runs on Copilot CLI and launched earlier this year as a rival to Claude Code and Codex.

GitHub has some catching up to do. OpenAI added computer use to Codex in April, while Anthropic brought broader computer use on macOS to Claude Code and Claude Cowork earlier this year.

GitHub has some catching up to do.

Computer use vs. MCP servers

Enabling computer use in Copilot CLI activates a bundled plugin with its own MCP server. It works in local sessions, reading application content through the operating system’s accessibility tree and taking screenshots when it needs visual context.

The company recommends using direct tools wherever possible. So, if an API, MCP server, terminal command, filesystem tool, or dedicated browser tool can handle the task, it typically provides more structured information and more predictable results than desktop interaction.

That advice limits where GitHub thinks computer use belongs. OpenAI president Greg Brockman made a broader case last month, arguing that agents could use the same interfaces as people and spare the industry the work of building and maintaining a connector for every piece of software.

Saved approvals outlast their removal

Developers enable the feature with /computer on in Copilot CLI or through the Copilot app’s Computer Use settings. macOS also requires Accessibility permission to operate controls and Screen Recording permission to inspect windows when visual context is needed.

The CLI session’s permission mode determines whether Copilot asks before accessing an app; developers can check it with /permissions show. When prompted, they can allow access for the current session, choose “Always allow” for future sessions or decline. Deny rules override both automatic and saved approvals.

Approvals saved in the CLI carry over to the desktop app on the same computer. Removing an app from the always-allowed list clears its approval for future sessions but leaves access already granted in a running session intact.

Stopping work requires a separate action: press Esc twice in the CLI, or click Stop or press Esc in the desktop app.

Enterprise controls over computer use

Enterprise policy overrides a developer’s local preference. If managed settings block computer use, Copilot CLI reports that the feature is unavailable.

Enterprise policy overrides a developer’s local preference.

Through managed-settings.json, enterprise owners can also control whether developers may bypass approval prompts. That restriction applies across the Copilot app, CLI, and VS Code.

GitHub’s default-enablement policy for Business and Enterprise does not change this preview’s opt-in status. The policy starts applying to unconfigured features on October 22 but excludes preview features.

Reliability depends on the interface

A change in timing or window state can cause Copilot to repeat an action or stall. GitHub also warns that the agent may choose the wrong control, type into the wrong field, or struggle with dynamic interfaces and complex workflows.

Sensitive information visible in an application window may also become context for the agent.

Unexpected on-screen content and ambiguous instructions can lead to actions affecting the user’s device, data, or connected accounts. Sensitive information visible in an application window may also become context for the agent.

The post GitHub’s advice for its new Copilot feature is to try something else first appeared first on The New Stack.

Read the whole story
alvinashcraft
21 minutes ago
reply
Pennsylvania, USA
Share this story
Delete
Next Page of Stories