GitHub - microsoft/BitNet: Official inference framework for 1-bit LLMs
bitnet.cpp is the official inference framework for 1-bit LLMs (e.g., BitNet b1.58). It offers a suite of optimized kernels, that support fast and lossless inference of 1.58-bit models on CPU (with NPU and GPU support coming next). The first release of bitnet.cpp is to support inference on CPUs. bitnet.cpp achieves speedups of 1.37x to 5.07x on ARM CPUs, with larger models experiencing greater perf
GitHub - microsoft/garnet: Garnet is a remote cache-store from Microsoft Research that offers strong performance (throughput and latency), scalability, storage, recovery, cluster sharding, key migration, and replication features. Garnet can work with exis
Garnet is a new remote cache-store from Microsoft Research, that offers several unique benefits: Garnet adopts the popular RESP wire protocol as a starting point, which makes it possible to use Garnet from unmodified Redis clients available in most programming languages of today, such as StackExchange.Redis in C#. Garnet offers much better throughput and scalability with many client connections an
GitHub - microsoft/UFO: A UI-Focused Agent for Windows OS Interaction.
📅 2024-07-06: We have a New Release for v1.0.0!. You can check out our documentation. We welcome your contributions and feedback! 📅 2024-06-28: We are thrilled to announce that our official introduction video is now available on YouTube! 📅 2024-06-25: New Release for v0.2.1! We are excited to announce the release of version 0.2.1! This update includes several new features and improvements: Host
GitHub - microsoft/autogen: A programming framework for agentic AI. Discord: https://aka.ms/autogen-dc. Roadmap: https://aka.ms/autogen-roadmap
📚 Cite paper. 🔥 Mar 26: Andrew Ng gave a shoutout to AutoGen in What's next for AI agentic workflows at Sequoia Capital's AI Ascent. 🔥 Mar 3: What's new in AutoGen? 📰Blog; 📺Youtube. 🔥 Mar 1: the first AutoGen multi-agent experiment on the challenging GAIA benchmark achieved the No. 1 accuracy in all the three levels. 🎉 Jan 30: AutoGen is highlighted by Peter Lee in Microsoft Research Forum
GitHub - microsoft/windows-drivers-rs: Platform that enables Windows driver development in Rust. Developed by Surface.
This repo is a collection of Rust crates that enable developers to develop Windows Drivers in Rust. It is the intention to support both WDM and WDF driver development models. This repo contains the following crates: wdk-build: A library to configure a Cargo build script for binding generation and downstream linking of the WDK (Windows Driver Kit). While this crate is written to be flexible with di
GitHub - microsoft/Olive: Olive: Simplify ML Model Finetuning, Conversion, Quantization, and Optimization for CPUs, GPUs and NPUs.
Olive is an easy-to-use hardware-aware model optimization tool that composes industry-leading techniques across model compression, optimization, and compilation. Given a model and targeted hardware, Olive composes the best suitable optimization techniques to output the most efficient model(s) for inferring on cloud or edge, while taking a set of constraints such as accuracy and latency into consid
GitHub - microsoft/TypeChat: TypeChat is a library that makes it easy to build natural language interfaces using types.
TypeChat is a library that makes it easy to build natural language interfaces using types. Building natural language interfaces has traditionally been difficult. These apps often relied on complex decision trees to determine intent and collect the required inputs to take action. Large language models (LLMs) have made this easier by enabling us to take natural language input from a user and match t
GitHub - microsoft/restler-fuzzer: RESTler is the first stateful REST API fuzzing tool for automatically testing cloud services through their REST APIs and finding security and reliability bugs in these services.
RESTler is the first stateful REST API fuzzing tool for automatically testing cloud services through their REST APIs and finding security and reliability bugs in these services. For a given cloud service with an OpenAPI (formerly Swagger) specification, RESTler analyzes its entire specification, and then generates and executes tests that exercise the service through its REST API. RESTler intellige
Convert the codebase to modules by jakebailey · Pull Request #51387 · microsoft/TypeScript
This is it; the PR that converts the TypeScript repo from namespaces to modules. TL;DR: The TypeScript compiler is now implemented internally with modules, not namespaces. The compiler is now 10-25% faster. tsc is now 30% faster to start. Our npm package is now 43% smaller. More improvements are in the works. If you're reading this and the 5.0 beta is out, now that the above results were as of thi
リリース、障害情報などのサービスのお知らせ
最新の人気エントリーの配信
j次のブックマーク
k前のブックマーク
lあとで読む
eコメント一覧を開く
oページを開く
GitHub - microsoft/prompty: Prompty makes it easy to create, manage, debug, and evaluate LLM prompts for your AI applications. Prompty is an asset class and format for LLM prompts designed to enhance observability, understandability, and portability for d
GitHub - microsoft/graphrag: A modular graph-based Retrieval-Augmented Generation (RAG) system
GitHub - microsoft/go: The Microsoft build of the Go toolset
GitHub - microsoft/retina: eBPF distributed networking observability tool for Kubernetes
GitHub - microsoft/LLMLingua: To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.
GitHub - microsoft/inshellisense: IDE style command line auto complete
GitHub - microsoft/azurechat: 🤖 💼 Azure Chat Solution Accelerator powered by Azure Open AI Service
GitHub - microsoft/devicescript: TypeScript for Tiny IoT Devices (ESP32, RP2040, ...)
Release v1.32.0 · microsoft/playwright
GitHub - microsoft/BioGPT
Release v1.28 · microsoft/playwright
