Building Enterprise-Ready Backend Services Distributed Systems with Node.js, a book I wrote through O'Reilly, has been published! Distributed Systems with Node.js hard copies In this hands-on guide I prove that Node.js is just as capable as traditional enterprise platforms for building services that are observable, scalable, and resilient. Intermediate to advanced Node.js developers find themselve
Back to articlesThe Cloud is dead, long live the Cloud! Announcing Wasmer EdgeWe are incredibly excited to share a new paradigm for apps: a magnitude more affordable than the clouds, more flexible than Cloudflare workers and with a Heroku-like experience Once in a lifetime you get the opportunity to work on something unique, something so innovative that you know it will set the future of computing
Every so often I read an essay that I end up thinking about, and citing in conversation, over and over again. Here’s my index of all the ones of those I can remember! I’ll try to keep it up to date as I think of more. There's a lot in here! If you'd like, I can email you one essay per week, so you have more time to digest each one: Nelson Elhage, Computers can be understood. The attitude embodied
Infrastructure Democratizing data analysis with Google BigQuery Every day, over a hundred million people come to Twitter to find out what’s happening in the world and talk about it. Every Tweet and user action generates an event that we make available for internal data analysis at Twitter. Hundreds of employees analyze and visualize this data, and improving their experience is a top priority for t
【日本初導入】 AWS Outposts ラックを徹底解説 第2回 〜AWS CDKによるInfrastructure as Code〜 - NTT Communications Engineers' Blog
はじめに こんにちは、イノベーションセンターの福田です。 前回 に引き続き、 AWS Outposts について紹介していきます。 今回は、特に AWS CDK による AWS Outposts の Infrastructure as Code (以降 IaC) を行う方法について記載していきたいと思います。 AWS CloudFormation AWS CDK では AWS CloudFormation というサービスをバックエンドで利用しているため、まずはこの AWS CloudFormation について解説します。 AWS CloudFormation は、AWS の各種リソースを JSON/YAML 形式で記述した"テンプレート"として管理します。 これによって AWS リソースの IaC を実現してくれますが、サービスとして IaC を実現するものというよりは AWS リソース
Discussion on Hacker News This article and its topic were the subject of fairly detailed discussion on this thread here on Hacker News. Perusing through the comments should be well worth your time, albeit you might emerge completely confused by the experience. And no–tech guys do not hate each other, we just have a wide-ranging spectrum of view points. Introduction It is impossible to escape heari
GitHub - spyboy-productions/CloakQuest3r: Uncover the true IP address of websites safeguarded by Cloudflare & Others
CloakQuest3r is a powerful Python tool meticulously crafted to uncover the true IP address of websites safeguarded by Cloudflare and other alternatives, a widely adopted web security and performance enhancement service. Its core mission is to accurately discern the actual IP address of web servers that are concealed behind Cloudflare's protective shield. Subdomain scanning is employed as a key tec
New AlloyDB for PostgreSQL frees you from legacy databases | Google Cloud Blog
Introducing AlloyDB for PostgreSQL: Free yourself from expensive, legacy databases Enterprises are struggling to free themselves from legacy database systems, and need an alternative option to modernize their applications. Today at Google I/O, we’re thrilled to announce the preview of AlloyDB for PostgreSQL, a fully-managed, PostgreSQL-compatible database service that provides a powerful option fo
Top Announcements of AWS re:Invent 2021 | Amazon Web Services
AWS News Blog Top Announcements of AWS re:Invent 2021 Welcome to AWS re:Invent! Below are some of the most noteworthy launches from our biggest event of the year. AWS Chief Evangelist Jeff Barr and our team of AWS developer advocates from around the globe share their insights and offer helpful tips for getting started with some of their favorite new AWS releases. With so much amazing building goin
There will be cases like the serverless compute engine ECS Fargate, Google Cloud Run, etc., where some of these pieces are out of our control, so we work on a shared responsibility model. The provider is responsible for keeping the base pieces working and secured And you can focus on the upper layers. Prevention: 8 steps for shift left security Before your application inside a container is execute
Discover 3 advantages of Podman over Docker | Red Hat Developer
Many think of Podman to be a replacement for Docker (if they have heard of Podman at all). But, this is not the case, as Podman is another option that provides better security and developer features. Podman is a cloud-native, daemonless tool that helps developers manage their Linux containers. Podman is all about security, but also minimizing the friction between your local development environment
Internet Engineering Task Force (IETF) K. Davis Request for Comments: 9562 Cisco Systems Obsoletes: 4122 B. Peabody Category: Standards Track Uncloud ISSN: 2070-1721 P. Leach University of Washington May 2024 Universally Unique IDentifiers (UUIDs) Abstract This specification defines UUIDs (Universally Unique IDentifiers) -- also known as GUIDs (Globally Unique IDentifiers) -- and a Uniform Resou
What is CockroachDB Serverless? If you’ve created a database before, you probably had to estimate the size and number of servers to use based on the expected traffic. If you guessed too low, your database would fall over under load and cause an outage. If you guessed too high or if your traffic came in bursts, you’d waste money on servers that are just sitting idle. Could there be a better way? Se
AWS App Runner introduces web application firewall (WAF) support for enhanced security
AWS App Runner now supports AWS web application firewall (WAF). AWS WAF gives you control over what traffic reaches your web applications or APIs depending upon your security and business needs. App Runner makes it easier for developers to quickly deploy containerized web applications and APIs to the cloud, at scale, and without managing infrastructure. Now, you can strengthen the security posture
Microsoft Azureはマイクロソフト社が提供するクラウドサービスです。AmazonのAWS（Amazon Web Service）やGoogleのGCP（Google Cloud Platform）と並ぶ人気のクラウドサービスです。 近年はリモートワークを導入する企業も増えているため、クラウドサービスの需要も高くなっています。 この記事では、Microsoft Azure導入のメリットや、知っておくと便利な情報についてわかりやすく解説します。 なお、「クラウドサービス」の意味や概要について詳しく解説した記事がありますので、併せてご覧ください。 Microsoft Azure(マイクロソフトアジュール)とは？ Microsoft Azureとは、2008年10月にマイクロソフト社のデベロッパーカンファレンスで発表され、2010年10月に「Windows Azure」としてサービスを
How COVID-19 is affecting internet performanceTL;DR To understand how the internet is performing with the changes in internet use brought on by the COVID-19 pandemic, we investigated two key metrics during February and March in some of the countries and states that were hit hardest by the virus: changes in the traffic volume served to those regions as a reflection of changes in internet use, and c
Disappointed with the lack of US response to the Hermit Kingdom's attacks against US security researchers, one hacker took matters into his own hands. "I want them to understand that if you come at us, it means some of your infrastructure is going down for a while."Illustration: Elena Lacey; Getty Images For the past two weeks, observers of North Korea's strange and tightly restricted corner of th
Photo by timJ on UnsplashIn this article, we will see how to structure a Rust project so that it’s easily testable. We will build a simple authentication module that is exposed via REST API while storing the data to PostgreSQL and Redis. We will use actix-web for handling the REST API part, sqlx for interacting with PostgreSQL, and redis-rs for interacting with Redis. We will see how the applicati
セキュリティ英単語帳
2022年6⽉ 独⽴⾏政法⼈ 情報処理推進機構 産業サイバーセキュリティセンター 第5期中核⼈材育成プログラム 「セキュリティエンジニアのための English Reading」プロジェクト 動詞 単語 意味 関連語 使用例 include ～を含む 【名】inclusion: 包含、含まれるもの 【形】inclusive: すべてを含んだ the email including a malicious macro 悪意のあるマクロを含むメール steal ～を盗む steal sensitive information 機微な情報を盗む exploit (脆弱性) を突いて攻撃する 【名】エクスプロイト (コード) 【名】exploitation: (脆弱性を突く) 攻撃 【形】exploitable: 悪用可能な actively exploited vulnerability よく攻
ChatGPT - Wikipedia
ChatGPT（チャットジーピーティー、英語: Chat Generative Pre-trained Transformer）[1]は、OpenAIが2022年11月に公開した人工知能チャットボットであり、生成AIの一種。 GPTの原語のGenerative Pre-trained Transformerとは、「生成可能な事前学習済み変換器」という意味である[2]。OpenAIのGPT-3ファミリーの大規模な言語モデルに基づいて構築されており、教師あり学習と強化学習の両方の手法を使って転移学習され、機械学習のサブセットである深層学習を使って開発されている[3]。 概要 2022年11月30日にプロトタイプとして公開され、幅広い分野の質問に詳細な回答を生成できることから注目を集めた。しかし、人間が自然と感じる回答の生成を特徴としていることから、一見自然に見えるが事実とは異なる回答を生成する
A peek behind Colossus, Google’s file system | Google Cloud Blog
Colossus under the hood: a peek into Google’s scalable storage system You trust Google Cloud with your critical data, but did you know that Google also relies on the same underlying storage infrastructure for its other businesses as well? That’s right, the same storage system that powers Google Cloud also underpins Google’s most popular products, supporting globally available services like YouTube
Announcing Distributed Application Runtime (Dapr), an open source project to make it easier for every developer to build microservice applications - Microsoft Open Source Blog
Announcing Distributed Application Runtime (Dapr), an open source project to make it easier for every developer to build microservice applications Toggle share menu for: Announcing Distributed Application Runtime (Dapr), an open source project to make it easier for every developer to build microservice applications Share Share Announcing Distributed Application Runtime (Dapr), an open source proje
Why AWS loves Rust, and how we’d like to help | Amazon Web Services
AWS Open Source Blog Why AWS loves Rust, and how we’d like to help One of the most exciting things about the Rust programming language is that it makes infrastructure incredibly boring. That’s not a bad thing, in this case. No one wants their electrical wiring to be exciting; most of us prefer the safety that comes with being able to flip a switch and have light to see by. For similar reasons, at
AWS Network Firewall – New Managed Firewall Service in VPC | Amazon Web Services
AWS News Blog AWS Network Firewall – New Managed Firewall Service in VPC Our customers want to have a high availability, scalable firewall service to protect their virtual networks in the cloud. Security is the number one priority of AWS, which has provided various firewall capabilities on AWS that address specific security needs, like Security Groups to protect Amazon Elastic Compute Cloud (Amazo
New – AWS Proton Supports Terraform and Git Repositories to Manage Templates | Amazon Web Services
AWS News Blog New – AWS Proton Supports Terraform and Git Repositories to Manage Templates Today we are announcing the launch of two features for AWS Proton. First, the most requested one in the AWS Proton open roadmap, to define and provision infrastructure using Terraform. Second, the capability to manage AWS Proton templates directly from Git repositories. AWS Proton is a fully managed applicat
Chapter 12 - Introducing Non-Abstract Large System Design, Google SRE Book
Introducing Non-Abstract Large System Design By Salim Virji, James Youngman, Henry Robertson, Stephen Thorne, Dave Rensin, and Zoltan Egyed with Richard Bondi With responsibilities that span production operations and product engineering, SRE is in a unique position to align business case requirements and operational costs. Product engineering teams may not be aware of the maintenance cost of syste
AWS price reduction for data transfers out to the internet
Effective December 1, 2021, AWS is making two pricing changes for data transfer out to the internet. Each month, the first terabyte of data transfer out of Amazon Cloudfront, the first 10 million HTTP/S requests, and the first 2 million CloudFront Functions invocations will be free. Free data transfer out of CloudFront is no longer limited to the first 12 months. In addition, the first 100 gigabyt
by Frank San Miguel on behalf of the Cosmos team IntroductionCosmos is a computing platform that combines the best aspects of microservices with asynchronous workflows and serverless functions. Its sweet spot is applications that involve resource-intensive algorithms coordinated via complex, hierarchical workflows that last anywhere from minutes to years. It supports both high throughput services
The EU's Proposed CRA Law May Have Unintended Consequences for the Python Ecosystem
The EU's Proposed CRA Law May Have Unintended Consequences for the Python Ecosystem After reviewing the proposed Cyber Resilience Act and Product Liability Act, the PSF has found issues that put the mission of our organization and the health of the open-source software community at risk. While we support the stated goals of these policies of increasing security and accountability for European soft
Amazon Time Sync is now available over the internet as a public NTP service
The Amazon Time Sync Service is now available over the Internet. Built on Amazon's network infrastructure, the Amazon Time Sync Service utilizes a global fleet of redundant satellite-connected and atomic reference clocks in AWS regions to deliver current time readings of the Coordinated Universal Time (UTC) global standard. Previously, Amazon Time Sync was available through EC2 instances. Now, you
Dear Google Cloud: Your Deprecation Policy is Killing You
God dammit, I didn’t want to blog again. I have so much stuff to do. Blogging takes time and energy and creativity that I could be putting to good use: my novels, my music, my game, and so on. But you get me riled enough, and I have to blog. Let’s get this over with, then. I’ll begin with a small but enlightening story from my early days at Google. For the record, I know I’ve said some perhaps unk
New – Import Existing Resources into a CloudFormation Stack | Amazon Web Services
AWS News Blog New – Import Existing Resources into a CloudFormation Stack With AWS CloudFormation, you can model your entire infrastructure with text files. In this way, you can treat your infrastructure as code and apply software development best practices, such as putting it under version control, or reviewing architectural changes with your team before deployment. Sometimes AWS resources initia
青山氏が語った、「クラウドネイティブ」がやがて「Kubernetesネイティブ」へ進む理由：仮想マシン時代とクラウドネイティブ時代の違い（1/2 ページ） 青山真也氏は2020年5月20日、Forkwell主催のオンラインミートアップで、仮想マシン時代の開発とKubernetesによるクラウドネイティブな開発のこれからについて話した。この講演を要約してお届けする。 「5年後、オンプレ環境でデータベース以外はKubernetesで稼働している状態が実現し、パブリッククラウドではKubernetes上で全てが管理されている状態になる」――。サイバーエージェントのソフトウェアエンジニアで、プライベートクラウドKubernetes基盤のプロダクトオーナーである青山真也氏は2020年5月20日、Forkwell主催の「Infra Study Meetup #2」で、「VM 時代の開発とKuberne
Building a more accurate time service at Facebook scale
UPDATE: To continue our support of this public NTP service, we have open-sourced our collection of NTP libraries on GitHub. Almost all of the billions of devices connected to the internet have onboard clocks, which need to be accurate to properly perform their functions. Many clocks contain inaccurate internal oscillators, which can cause seconds of inaccuracy per day and need to be periodically c
Table 1. System performance comparison for old and new architectures.
Infrastructure Processing billions of events in real time at Twitter At Twitter, we process approximately 400 billion events in real time and generate petabyte (PB) scale data every day. There are various event sources we consume data from, and they are produced in different platforms and storage systems, such as Hadoop, Vertica, Manhattan distributed databases, Kafka, Twitter Eventbus, GCS, BigQu
EnterpriseApplying GitOps principles to your operationsCould we use our Git repository as the source of truth for operational tasks, and somehow reconcile changes with our real-world view? DevOps practices have helped demonstrate the value in bringing teams together to accelerate value for end-users. This typically includes automating build and release processes and bringing quality checks directl
Marc Brooker, Mike Danilov, Chris Greenwood, and Phil Piwonka, Amazon Web Services Awarded Best Paper! AWS Lambda is a serverless event-driven compute service, part of a category of cloud compute offerings sometimes called Function-as-a-service (FaaS). When we first released AWS Lambda, functions were limited to 250MB of code and dependencies, packaged as a simple compressed archive. In 2020, we r
Preview: AWS Proton – Automated Management for Container and Serverless Deployments | Amazon Web Services
AWS News Blog Preview: AWS Proton – Automated Management for Container and Serverless Deployments Today, we are excited to announce the public preview of AWS Proton, a new service that helps you automate and manage infrastructure provisioning and code deployments for serverless and container-based applications. Maintaining hundreds – or sometimes thousands – of microservices with constantly changi
Retrospective and Technical Details on the recent Firefox Outage – Mozilla Hacks - the Web developer blog
Retrospective and Technical Details on the recent Firefox Outage On January 13th 2022, Firefox became unusable for close to two hours for users worldwide. This incident interrupted many people’s workflow. This post highlights the complex series of events and circumstances that, together, triggered a bug deep in the networking code of Firefox. What Happened? Firefox has a number of servers and rela
Open sourcing Kube2Hadoop: Secure access to HDFS from Kubernetes
Open Source Open sourcing Kube2Hadoop: Secure access to HDFS from Kubernetes Co-authors: Cong Gu, Abin Shahab, Chen Qiang, and Keqiu Hu Editor's note: This blog has been updated. LinkedIn AI has been traditionally Hadoop/YARN based, and we operate one of the world’s largest Hadoop data lakes, with over 4,500 users and 500PB of data. In the last few years, Kubernetes has also become very popular at
j次のブックマーク
k前のブックマーク
lあとで読む
eコメント一覧を開く
oページを開く
Distributed Systems with Node.js
The Cloud is dead, long live the Cloud! Announcing Wasmer Edge · Blog · Wasmer
Essays on programming I think about a lot
Democratizing data analysis with Google BigQuery
A Manager’s Guide to Kubernetes Adoption
Container security best practices: Comprehensive guide
RFC 9562: Universally Unique IDentifiers (UUIDs)
How we built a serverless SQL database
Microsoft Azure（アジュール）とは何かをわかりやすく解説！｜Udemy メディア
How COVID-19 is affecting internet performance
North Korea Hacked Him. So He Took Down Its Internet
Structuring Rust Project for Testability
The Netflix Cosmos Platform
青山氏が語った、「クラウドネイティブ」がやがて「Kubernetesネイティブ」へ進む理由
Applying GitOps principles to your operations
On-demand Container Loading in AWS Lambda | USENIX