最強ローカルLLM実行環境としてのEmacs
みなさん、ローカルLLMで遊んでいますか？ 昨年末に、Ollamaが登場してから誰でも簡単にローカルLLMで遊べる時代がやってきました。そこで、僕もローカルLLMでどんなことができるんだろうと思って触りはじめたのですが、ローカルLLMを最大限に活用するためには、まずはどうやったらEmacsからローカルLLMを使えるようになるのかと考えるのはあまりにも自然な流れでした。 この記事では、ローカルLLMに関する基本的な知識から、EmacsからローカルLLMを扱う方法までを解説していきたいと思います。 ローカルLLMの基礎知識 # ローカルLLMとは、LLM（大規模言語モデル）をローカル環境、つまり自分のパソコンで扱えるようにしたモデルです。Facebookが開発しているLlamaが業界のトップランナーで、それをベースにしたモデルを色々な組織（中には個人もいるのかも）が開発しています。 そのLla
@Hiroki__IT が目の前にやってきて私にIstioのこと教えてくれた。- Istio in Action の読書感想文 - じゃあ、おうちで学べる
はじめに マイクロサービスアーキテクチャの台頭により、サービスメッシュ技術は現代のクラウドネイティブ環境において外せない選択肢の一つとなっています。 その理由は明確です。マイクロサービスに求められる非機能要件の多くは類似しており、これをアプリケーション側で個別に実装すると、開発者やインフラエンジニアの負担が増大するからです。 ここで登場するのがサービスメッシュです。サービスメッシュの採用により、これらの非機能要件をインフラ層で一元管理することが可能となり、アプリケーション開発者とインフラエンジニアの責務を明確に分離できます。つまり、各エンジニアが自身の専門領域にフォーカスできるのです。これは単なる効率化ではなく、イノベーションを加速させるためサービス開発する上での労苦をなくします。 そして、サービスメッシュの世界で圧倒的な存在感を放っているのがIstioです。その包括的な機能と広範な採用で
[OUTDATED] First-Party Sets and the SameParty attribute | Privacy Sandbox
Send feedback [OUTDATED] First-Party Sets and the SameParty attribute Stay organized with collections Save and categorize content based on your preferences. Many organizations have related sites with different domain names, such as brandx.site and fly-brandx.site—or domains for different countries such as example.com, example.rs, and example.co.uk. Browsers are moving towards making third-party co
Building Uber’s Fulfillment Platform for Planet-Scale using Google Cloud Spanner
You’re seeing information for Japan . To see local features and services for another location, select a different city. Show more Introduction The Fulfillment Platform is a foundational Uber domain that enables the rapid scaling of new verticals. The platform handles billions of database transactions each day, ranging from user actions (e.g., a driver starting a trip) and system actions (e.g., cre
Hypershell: A Type-Level DSL for Shell-Scripting in Rust | Context-Generic Programming
Discuss on Reddit, Lobsters, and Hacker News. Summary I am thrilled to introduce Hypershell, a modular, type-level domain-specific language (DSL) for writing shell-script-like programs in Rust. Hypershell is powered by context-generic programming (CGP), which makes it possible for users to extend or modify both the language syntax and semantics. Table of Contents Estimated reading time: 1~2 hours
GitHub - mlc-ai/web-llm: High-performance In-browser LLM Inference Engine
In-Browser Inference: WebLLM is a high-performance, in-browser language model inference engine that leverages WebGPU for hardware acceleration, enabling powerful LLM operations directly within web browsers without server-side processing. Full OpenAI API Compatibility: Seamlessly integrate your app with WebLLM using OpenAI API with functionalities such as streaming, JSON-mode, logit-level control,
Overview We have been seeing amazing progress in generative AI and LLM recently. Thanks to the open-source efforts like LLaMA, Alpaca, Vicuna and Dolly, we start to see an exciting future of building our own open source language models and personal AI assistant. These models are usually big and compute-heavy. To build a chat service, we will need a large cluster to run an inference server, while c
NVIDIA Releases Open-Source GPU Kernel Modules | NVIDIA Technical Blog
NVIDIA has released its Linux GPU kernel modules as open source with a dual GPL/MIT license, starting with the R515 driver release, to improve the experience of using NVIDIA GPUs in Linux.The open-source kernel modules are production-ready for data center GPUs in the NVIDIA Turing and NVIDIA Ampere architecture families, while support for GeForce and Workstation GPUs is alpha-quality.The release i
Abstract The Integrity Data Platform (IDP) team decided to rewrite one of our heavy Queries Per Second (QPS) Golang microservices in Rust. It resulted in 70% infrastructure savings at a similar performance, but was not without its pitfalls. This article will elaborate on: How we picked what to rewrite in Rust. Approach taken to tackle the rewrite. The pitfalls and speed bumps along the way. Was it
In August 2024 Node.js introduced a new experimental feature, Type Stripping, aimed at addressing a longstanding challenge in the Node.js ecosystem: running TypeScript with no configuration. Enabled by default in Node.js v23.6.0, this feature is on its way to becoming stable. This article explores the motivations behind this feature, the problems it solves, and its implications for the Node.js com
The 11 Best iOS Features That Android Still Doesn't Have
Although Android is a feature-packed operating system, it misses several functionalities that have been integral to iOS for years. So, if you're planning to switch from an iPhone to an Android device anytime soon, be prepared to miss out on the following features. 1. AirPlay AirPlay is one of the biggest features that Android devices still don't have. Since AirPlay is a propriety protocol that App
Use Thunder Client and VSCode as an alternative to Postman
Visual Studio Code (VSCode) is a popular code editor that can be used as an alternative to Postman for API testing. With the right extensions, developers can easily create, manage, and test APIs within the VSCode environment. Using Thunder Client with VSCode for API testing can streamline the development workflow and save time by using a single tool for coding and testing, as this article will sho
Real-world gen AI use cases from the world's leading organizations | Google Cloud Blog
AI is here, AI is everywhere: Top companies, governments, researchers, and startups are already enhancing their work with Google's AI solutions. Published April 12, 2024; last updated April 22, 2026. We first published this list two years ago at Next ‘24, as the agentic era was just dawning. Watching this list grow — propelled by our customer’s enthusiastic commitment to AI — proves we are now fir
DuckDB Community Extensions
TL;DR: DuckDB extensions can now be published as DuckDB Community Extensions. The repository makes it easier for users to install extensions using the INSTALL extension_name FROM community syntax. Extension developers avoid the burdens of compilation and distribution. To browse existing community extensions, visit the DuckDB Community Extensions documentation page. DuckDB Extensions Design Philoso
Xiaomi's secret blacklist of phrases sounds scary, but it may not be what it seems
Chinese smartphone makers are often under heavy scrutiny due to geopolitical reasons, and the company that has taken the brunt of criticism is Huawei. However, other companies like Xiaomi haven't been left untouched, as the world's number one smartphone vendor recently had to fight off the U.S. Government's attempt to label it a "Communist Chinese military company". Now the company is back in the
Update 1.86.2: The update addresses these issues. Update 1.86.1: The update addresses these issues. Downloads: Windows: x64 Arm64 | Mac: Universal Intel silicon | Linux: deb rpm tarball Arm snap Welcome to the January 2024 release of Visual Studio Code. There are many updates in this version that we hope you'll like, some of the key highlights include: Per-window zoom levels - Adjust the zoom leve
ML Education at Uber: Frameworks Inspired by Engineering Principles
You’re seeing information for Poland . To see local features and services for another location, select a different city. Show more Introduction At Uber, millions of machine learning (ML) predictions are made every second, and hundreds of applied scientists, engineers, product managers, and researchers work on ML solutions daily. Uber wins by scaling machine learning. We recognize org-wide that a p
The Cost of a Call: From Voice Phishing to Data Extortion | Google Cloud Blog
Google Threat IntelligenceVisibility and context on the threats that matter most. Contact Us & Get a Demo Update (August 8): Google has completed its email notifications to those affected by this incident. Update (August 8): Emails are actively being sent to those affected by this incident. Another update will be posted here once these alerts have been issued. Update (August 5) In June, one of Goo
Blog
Hachi: An (Image) Search engine Only the dead have seen the end of war .. George Santayana For quite some time now, i have been working on and off on a fully self-hosted search engine, in hope to make it easier to search across Personal data in an end to end manner. Even as individuals, we are hoarding and generating more and more data with no end in sight. Such "personal" data is being stored fro
You’re seeing information for Japan . To see local features and services for another location, select a different city. Show more API gateways are an integral part of microservices architecture in recent years. An API gateway provides a single point of entry for all our apps and provides an interface to access data, logic, or functionality from back-end microservices. It also provides a centralize
Cloud Run gets always-on CPU allocation | Google Cloud Blog
Cloud Run, Google Cloud's serverless container platform, offers a very granular pay-per-use pricing, charging you only for CPU and memory when your app processes requests or events. By default, Cloud Run does not allocate CPU outside of request processing. For a class of workloads that expect to do background processing, this can be problematic. So today, we are excited to introduce the ability to
An Introduction to Asynchronous Programming in Rust and a High-level Overview of Tokio's Architecture
An Introduction to Asynchronous Programming in Rust and a High-level Overview of Tokio's Architecture Asynchronous programming allows the development of services that can handle millions of requests without saturating memory and CPU utilization. Support for asynchrony is usually baked into the programming language; we take a look at async support in Rust, a type-safe and memory-safe systems progra
Goodbye Microsoft SQL Server, Hello Babelfish | Amazon Web Services
AWS News Blog Goodbye Microsoft SQL Server, Hello Babelfish [UPDATE May 17 2022: I added one command line in the demo section to automatically select the latest version of PostgreSQL RDS engine] Many of our customers are telling us they want to move away from proprietary database vendors to avoid expensive costs and burdensome licensing terms. But migrating away from commercial and legacy database
Smart Contact Lenses Market Growth, Trends Report 2032 | MRFR
Smart Contact Lenses Market Research Report By Application (Medical, Sports, Consumer Electronics, Military), By Technology (Sensor Embedded, Display Technology, Microbattery Technology), By Functionality (Health Monitoring, Augmented Reality, Vision Correction), By Material (Hydrogel, Silicone Hydrogel, Scleral) and By Regional (North America, Europe, South America, Asia Pacific, Middle East and
Automotive Cockpit Electronics Market Size, Share Report 2034
Automotive cockpit electronics comprise integrated electronic systems within a vehicle's interior, enhancing driver and passenger experience. Automotive cockpit electronics represents an area dedicated to instrument panel and controls that allow center stack electronics and information for enhanced safety, convenience, and driving experience. These electronics encompass a wide range of features, i
Advancing Windows for AI development: New platform capabilities and tools introduced at Build 2025
We’re excited to be back at Build, a special moment each year to connect with the global developer community. It’s energizing to share what we’ve been working on, and just as important, to hear how developers are using Microsoft platforms to build what’s next. At Microsoft, we believe the future of AI is being built right now across the cloud, on the edge and on Windows. Windows is, and will remai
Ambulatory EHR Market Size, Growth, Trends, Report 2034 | MRFR
✉ info@marketresearchfuture.com 📞 +1 (855) 661-4441(US) 📞 +44 1720 412 167(UK) 📞 +91 2269738890(APAC) Global Market Outlook In-depth analysis of global and regional trends Analyze and identify the major players in the market, their market share, key developments, etc. To understand the capability of the major players based on products offered, financials, and strategies. Identify disrupting pro
Exoskeleton Market Size, Share,Trends Report 2032 | MRFR
✉ info@marketresearchfuture.com 📞 +1 (855) 661-4441(US) 📞 +44 1720 412 167(UK) 📞 +91 2269738890(APAC) Global Market Outlook In-depth analysis of global and regional trends Analyze and identify the major players in the market, their market share, key developments, etc. To understand the capability of the major players based on products offered, financials, and strategies. Identify disrupting pro
Ambulance Market Size, Share, Trends Report 2032 | MRFR
Figure1: Ambulance Market, 2018 - 2032 (USD Million) These automobiles serve as the initial point of contact in critical circumstances within the healthcare system, including but not limited to accidents, abrupt disorders, and traumatic injuries. Ambulances are purpose-built to respond rapidly to pleas for assistance and transport patients to medical facilities for additional treatment. The medica
United States Automotive Electrically ORVM Market Size 2032
✉ info@marketresearchfuture.com 📞 +1 (855) 661-4441(US) 📞 +44 1720 412 167(UK) 📞 +91 2269738890(APAC) Global Market Outlook In-depth analysis of global and regional trends Analyze and identify the major players in the market, their market share, key developments, etc. To understand the capability of the major players based on products offered, financials, and strategies. Identify disrupting pro
Advanced Driver Assistance Systems Market Size, Trends 2032 - Industry Growth Analysis
Global Market Outlook In-depth analysis of global and regional trends Analyze and identify the major players in the market, their market share, key developments, etc. To understand the capability of the major players based on products offered, financials, and strategies. Identify disrupting products, companies, and trends. To identify opportunities in the market. Analyze the key challenges in the
Exactly ten years ago today, we published "Why We Created Julia", introducing the Julia project to the world. At this point, we have moved well past the ambitious goals set out in the original blog post. Julia is now used by hundreds of thousands of people. It is taught at hundreds of universities and entire companies are being formed that build their software stacks on Julia. From personalized me
US Orthopedic Prosthetics Market Size, Growth Insights 2035
US Orthopedic Prosthetics Market Research Report By Product Type (Upper Extremity Prosthetics, Lower Extremity Prosthetics, Liners, Sockets, Modular Components), By Technology (Conventional, Electric Powered, Hybrid Orthopedic Prosthetics) and By End User (Hospitals, Prosthetic Clinics, Rehabilitation Center, Others) - Forecast to 2035 US Orthopedic Prosthetics Market Overview As per MRFR analysis
Laboratory Information Systems Market Size, Growth Report 2035
Key Laboratory Information Systems Market Trends Highlighted Significant growth is being driven by a number of key market drivers in the Laboratory Information Systems Market. One of the primary factors is the growing complexity of laboratory workflows, which requires effective management solutions. In order to optimize operations, improve data administration, and guarantee regulatory compliance,
Extracorporeal Membrane Oxygenation Machine Market 2035
Key Extracorporeal Membrane Oxygenation Machine (ECMO) Market Trends Highlighted The Global Extracorporeal Membrane Oxygenation Machine (ECMO) Market has been experiencing significant advancements and shifts driven by several key market drivers. The increasing prevalence of respiratory and cardiac diseases, particularly in aging populations, is fueling the demand for ECMO machines, as these device
GitHub Actionsを利用したE2E自動化テストの実現 ～ Achieving E2E Automated Testing with GitHub Actions ～ 利用GitHub Actions实现E2E自动化测试 - スタディサプリ Product Team Blog
こんにちは。スタディサプリのQAチームです。 今回のBlogではスタディサプリで実施している自動化テストの一部の取り組みについて紹介させていただきます。 なお、スタディサプリQAチームの特性を活かし、本記事については日英中３言語で記載します。より多くのオーディエンスに読んで頂ければ嬉しいです。 自動化する動機 まず、なぜ自動化テストを導入するのでしょうか。 1. 新規機能が追加される度に、既存機能への影響を確認するための回帰テストをしなければなりません。 2. 繰り返し同じテストを手動実行することにより、テストコストが増加します。 3. 人間が実施すると、人為的ミスによる不具合の検出漏れが発生してしまう可能性が否定できません。 そのため、品質を担保した上でより早くリリースすることを目的とし自動化を導入しました。 現在の開発およびテストフロー QAが回帰テストの自動化テストスクリプトをGit
Home Infusion Therapy Devices Market Size, Growth Report 2035
Key Home Infusion Therapy Devices Market Trends Highlighted The Global Home Infusion Therapy Devices Market is experiencing a notable shift driven by several key market drivers. Increasing demand for at-home healthcare solutions is primarily influenced by efforts to reduce hospital visits, optimize patient care, and lower healthcare costs. This trend is bolstered by advancements in technology that
US Automotive Trailer Market Size, Share and Forecast 2035
✉ info@marketresearchfuture.com 📞 +1 (855) 661-4441(US) 📞 +44 1720 412 167(UK) 📞 +91 2269738890(APAC) Global Market Outlook In-depth analysis of global and regional trends Analyze and identify the major players in the market, their market share, key developments, etc. To understand the capability of the major players based on products offered, financials, and strategies. Identify disrupting pro
Elastomeric Infusion Pump Market Size, Growth Outlook 2034
✉ info@marketresearchfuture.com 📞 +1 (855) 661-4441(US) 📞 +44 1720 412 167(UK) 📞 +91 2269738890(APAC) Global Market Outlook In-depth analysis of global and regional trends Analyze and identify the major players in the market, their market share, key developments, etc. To understand the capability of the major players based on products offered, financials, and strategies. Identify disrupting pro
Biomaterials Market Forecast 2035 - Size, Trends, Growth Report
✉ info@marketresearchfuture.com 📞 +1 (855) 661-4441(US) 📞 +44 1720 412 167(UK) 📞 +91 2269738890(APAC) Global Market Outlook In-depth analysis of global and regional trends Analyze and identify the major players in the market, their market share, key developments, etc. To understand the capability of the major players based on products offered, financials, and strategies. Identify disrupting pro
j次のブックマーク
k前のブックマーク
lあとで読む
eコメント一覧を開く
oページを開く
WebLLM | Home
Counter Service: How we rewrote it in Rust
Node.js Type Stripping Explained
January 2024 (version 1.86)
The Architecture of Uber's API gateway
Why We Use Julia, 10 Years Later