Data Engineering Design Patterns: Mastering Convergent Evolution
Book: Data Engineering Design Patterns (DEDP) Hey there 👋, this is the start of a book about Data Engineering Design Patterns. About This Book This book is different from usual books. It does not come finished. I will steadily release new chapters of the book, carefully listen to all your feedback, and integrate them to create a (hopefully) great book at the end of the day. Keep an eye on the cha
Beyond introvert vs. extrovert
It would be hard today to find anyone who hasn't heard about the ideas of introversion and extroversion. Though Carl Jung first defined the concept in the early 1900s, it broke into the mainstream in recent years, being featured on morning news shows, TED talks, and self-help books. Search interest in the topic keeps growing. I've even overheard strangers talking about the idea on the street. In 2
Whether you plan to visit Tokyo as a tourist, for business, or to live there, this insider’s guide to Tokyo is for you. As an insider living in Tokyo for a long, I will let you know about the places and activities that a tourist should not miss while planning to discover Tokyo. Tokyo: A City with Things to Do for Every Age Group and Taste Tokyo, being the largest metropolis by population and havin
In a time when technology is in every part of our daily lives, IT security has become a top priority in organizational strategies worldwide. This article discusses IT security and its various areas and aspects. What is IT Security All About Information technology is at the heart of our society, which heavily relies on digital tools. While it helps us interact easily and smoothly with each other, i
AI could pose ‘extinction-level’ threat to humans and the US must intervene, report warns | CNN Business
A new report commissioned by the US State Department paints an alarming picture of the “catastrophic” national security risks posed by rapidly evolving artificial intelligence, warning that time is running out for the federal government to avert disaster. The findings were based on interviews with more than 200 people over more than a year – including top executives from leading AI companies, cybe
How ransomware abuses BitLocker
Introduction Attackers always find creative ways to bypass defensive features and accomplish their goals. This can be done with packers, crypters, and code obfuscation. However, one of the best ways of evading detection, as well as maximizing compatibility, is to use the operating system’s own features. In the context of ransomware threats, one notable example is leveraging exported functions pres
🎯 daily.dev switched from Preact to React for its frontend framework, aiming to resolve development issues and enhance performance. The move, executed during a team hackathon, involved significant planning, testing, and codebase adjustments. This shift allowed for better compatibility with Next.js, improved development experience, and prepared the platform for future technological advancements. U
Playing with Infinity in CSS
CSS has an infinity constant. When I first learned about this, my brain lit up with all kinds of absurd possibilities. Let’s discuss! There might even be some practical use cases. No promises, though. Before we get into things, there’s one important ground rule: infinity can only be used inside a calc() statement. Alright, let’s go. Never Lose a z-index Battle AgainHave you ever needed an element
Make Ethereum Cypherpunk Again 2023 Dec 28 See all posts Special thanks to Paul Dylan-Ennis for feedback and review. One of my favorite memories from ten years ago was taking a pilgrimage to a part of Berlin that was called the Bitcoin Kiez: a region in Kreuzberg where there were around a dozen shops within a few hundred meters of each other that were all accepting Bitcoin for payments. The center
Engineering Unexpected Anti-Patterns for Engineering Leaders — Lessons From Stripe, Uber & Carta Will Larson, a veteran engineering leader and the CTO at Carta, holds three conventional engineering management “anti-patterns” up to the light for a closer look. Whenever Will Larson meets up with fellow CTOs or heads of engineering at other startups, he often finds himself having the same conversatio
Consulting giant McKinsey unveils its own generative AI tool for employees: Lilli
Continuing our tour, we’re headed to Atlanta for the AI Impact Tour stop on April 10th. This exclusive, invite-only event, in partnership with Microsoft, will feature discussions on how generative AI is transforming the security workforce. Space is limited, so request an invite today. Roth and his collaborators at McKinsey told VentureBeat that Lilli has already been in use by approximately 7,000
Grow Up Already! Why It Takes So Long to Mature The school-to-work transition can take longer for young adults with ADHD, who don’t mature at the same pace as their peers. Here’s how parents can nudge without pushing. The phone is ringing again at the posh day spa where Betsy Patterson ushers in an elegant new client. A customer is calling to schedule an eyebrow wax, but Betsy can’t fit her in; th
This post is also available in Français, 繁體中文, 한국어, Deutsch, 简体中文, 日本語, Português, Español. Welcome to the second DDoS threat report of 2023. DDoS attacks, or distributed denial-of-service attacks, are a type of cyber attack that aims to disrupt websites (and other types of Internet properties) to make them unavailable for legitimate users by overwhelming them with more traffic than they can handl
wezzyでフェミニスト批評「お砂糖とスパイスと爆発的な何か」を連載中の北村紗衣さんの新刊『英語の路地裏 オアシスからクイーン、シェイクスピアまで歩く』（アルク）が、2023年6月に刊行されたことを記念して、オンラインイベント「入試に絶対出てこない入試問題を作ってみよう 『英語の路地裏』刊行記念」を8月27日（日）に開催します。 本記事はイベントのために北村さんにお書きいただいた、「入試に絶対に出てこないテーマ」を扱った英文とその訳（2ページ目）です。テーマは、Netflixなどの配信サービスで多数配信されている、実際に起きた犯罪を取り扱ったドラマや映画、いわゆる「実録犯罪モノ」に指摘されている問題について。イベントに参加予定の方は必ず、そうでない方はぜひ、英文とその訳を読んでください。 True Crime The ‘true crime’ genre, which consists o
icarus_l 「私は昔からエジプトという地に魅了されてきた、だからエジプトを訪れてみたいと思っている．．．エジプト人さえいなければ。 ピラミッドから数十マイル以内は "全て" が観光客から金を貪るように設計されている。私の知っているエジプト訪問者は全員が同じことを言う。 - 現地人は失礼なんてもんじゃない - 彼らは常にふっかけてくる、あらゆるものに対して - 食べ物と宿泊施設が酷い - 何かを見ようと思ったら法外な値段のツアーに支払わなければならない - 古代エジプトの遺跡を見る以外にやるべきことは何もない - 訪問者の半数が食中毒を起こし、数日後に体調を崩してしている そしてこれらすべてに対して代金をぼられる。アホか！ そんな所に行くくらいなら大英博物館に行ってエジプトの遺物を静かに鑑賞す方を選ぶわ！」 kablob I visited Egypt multiple times a
Paul Graham on Ambition, Art, and Evaluating Talent (Ep. 186)
August 9, 2023 Paul Graham on Ambition, Art, and Evaluating Talent (Ep. 186) Plus, his bizarre strategy for getting over a fear of flying. Tyler and Y Combinator co-founder Paul Graham sat down at his home in the English countryside to discuss what areas of talent judgment his co-founder and wife Jessica Livingston is better at, whether young founders have gotten rarer, whether he still takes a di
LoopBack Framework of Node.js
Developed and maintained by StrongLoop (acquired by IBM), Node.js’s LoopBack framework emerged as a leading choice for developers aiming to simplify complex integrations between the front end and various data sources, using a mix of predefined and custom-made building blocks. What is the LoopBack Framework? LoopBack is a highly extensible, open-source Node.js framework that facilitates RESTful API
Tokyo is the new Paris
“There are only two places in the world where we can live happy: at home and in Paris.” — Ernest Hemingway What is the greatest city on Earth? If you answered “New York City”, I wouldn’t laugh at you. As the financial hub of what’s still nominally the world’s biggest economy, it commands economic power that any other single city would have trouble rivaling, and it’s still the city of dreams for un
DevTools Tips & Tricks
Front-end developers spend a significant amount of time working inside the browser’s DevTools. Likely just as much as they spend time writing code in the code editor. However, most developers barely scratch the surface of what DevTools can accomplish. I have been curating a collection of DevTools tips across major browsers. The following are some of the useful tips & tricks for across different br
Design Engineering at Vercel: What we do and how we do it – Vercel
Design Engineer is a new role that is gaining popularity—a role that is both confusing and exciting. Expectations for what good software looks and feels like have never been higher. Design Engineers are a core part in exceeding that expectation. This post will go behind the scenes for Design Engineering at Vercel, our work, skills, and how we contribute to shipping with a high degree of polish and
Applied LLMs - What We’ve Learned From A Year of Building with LLMs
A practical guide to building successful LLM products, covering the tactical, operational, and strategic. Also published on O’Reilly Media in three parts: Tactical, Operational, Strategic. Also see podcast. It’s an exciting time to build with large language models (LLMs). Over the past year, LLMs have become “good enough” for real-world applications. And they’re getting better and cheaper every ye
Perpetually growing meat!
This is mildly interesting: scientists have modified muscle cells in culture so that they produce their own growth factors. This is a major cost reduction, because now you won’t need to constantly supplement your vat of muscle cells with a relatively expensive reagent. Cellular agriculture – the production of meat from cells grown in bioreactors rather than harvested from farm animals – is taking
Tracking the Fake GitHub Star Black Market with Dagster, dbt and BigQuery | Dagster Blog
In this blog post, we explore the topic of fake GitHub stars. We will share our approach for identifying them and invite you to run this analysis on repos you are interested in. Click here to skip the background story and jump right to the code. And if you enjoy this article, head on over to the Dagster repo and give us a real GitHub star! In this post:Why buy stars on GitHub?Where to buy GitHub S
Orthopedic Implants Market Size to Hit USD 67.48 Billion by 2030 at 4.71% CAGR – Report by Market Research Future (MRFR)
Orthopedic Implants Market Size to Hit USD 67.48 Billion by 2030 at 4.71% CAGR – Report by Market Research Future (MRFR) Orthopedic Implants Market Trends and Insights By Product Type (Spinal Implants, Reconstructive Joint Implants, Orthbiologics and others), By Biomaterial (Metallic, Ceramic, And Others), By End Users (Hospitals & Ambulatory Surgery, Orthopedic Clinics, And Others), And By Region
SEO Visibility Shifts from Review Sites to eCommmerce & User-Generated Content Sites in 2024
Several recent Google algorithm updates and other adjustments to Google’s algorithms have led to substantially different search results in mid-2024 compared to the prior year. Google launched a number of significant, confirmed updates – most notably, the September 2023 Helpful Content Update and March 2024 Core Update – which reduced “unhelpful” content in the search results by 45%, while simultan
LangChain Cheat Sheet LangChain simplifies building AI assistants with large language models, providing an intuitive API, memory capabilities, access to external tools, the ability to chain LLM actions, and prompt templating. Check out our newest cheat sheet to get up and running now. Don't Be a Weak Link The field of artificial intelligence continues advancing rapidly, with new frameworks and too
Data engineering at Meta: High-Level Overview of the internal tech stack
Data engineering at Meta: High-Level Overview of the internal tech stack This article provides an overview of the internal tech stack that we use on a daily basis as data engineers at Meta. The idea is to shed some light on the work we do, and how the tools and frameworks contribute to making our day-to-day data engineering work more efficient, and to share some of the design decisions and technic
👋 We’re Knock. We provide a set of simple APIs developers use to introduce notifications into their products, without needing to build and maintain a notification system in-house. Tl;dr: We recently upgraded from Postgres 11.9 to 15.3 with zero downtime by using logical replication, a suite of support scripts, and tools in Elixir & Erlang’s BEAM virtual machine. This post will go into far too muc
Like many segments of the entertainment industry, this year in anime was defined by an abundance of excellent works that came into being despite an array of labor issues. But unlike the American film and television industry, where creatives got a well-deserved happy ending in tentative new union contracts, 2023 signaled the continuation of brutal trends for those who create anime. Many series expe
Performance impact of the memoization idiom on modern Ruby
One major internal change in Ruby 3.2 was the introduction of object shapes. In this post, we’ll try to cover why they were introduced, how they work, and what their limitations are. How object instance variables are stored Because of how dynamic Ruby is, an operation as simple as accessing an instance variable is a lot of work. In most cases, Ruby objects store their instance variables in an arra
Machine Learning is making a buzz in the industry. And it’s the right time to get familiar with it. Let’s get the basics right. Let’s get started. What is Machine Learning What the heck is machine learning? If I had to quote it in a single sentence, I would say, ‘Machine Learning is a way to find a pattern in data to predict the future. The above is not the only definition of machine learning. The
Experts are constantly discussing how to make the web better. Accessibility, UI/UX, web performance, you name it. You might not hear about internationalization (i18n) as much as other topics, but it is still essential to making the web better. In this article, we'll gain an understanding of the impact of i18n, explore the fundamental logic, and learn how to implement i18n in a Remix app. I also ta
IBM is releasing a family of Granite code models to the open-source community. The aim is to make coding as easy as possible — for as many developers as possible. Over the last several decades, software has been woven into the fabric of every aspect of our society. But for all the increased productivity that modern software has brought to how we work, the actual act of writing, testing, debugging,
Last updated on June 6, 2024. Rust is for the Engine, Not the Game Macros are cool! But, if we're going to create another language anyways... LogLog Games recently posted Leaving Rust gamedev after 3 years, a must-read article for folks who're doing game development in Rust. It focuses on a small indie developer organization and their experiences with Rust development. If you haven't given it a re
Data Security refers to practices employed in securing data from unauthorized tampering or corruption in an IT ecosystem. The entire digital world is run on data, and hence the statement, “data” is the new oil.” Data is in files, databases, accounts, and networks in forms like emails, passwords, texts, names, IDs, or electronic cash. We need to ensure the security of all these items from threat or
In the realm of leadership, two prominent styles often come to the forefront: transactional leadership vs. transformational leadership. These distinct leadership approaches represent contrasting philosophies and methodologies for leading teams and achieving organizational goals. While transactional leadership focuses on exchanges and task-oriented performance, transformational leadership emphasize
Leona Hioki, Albus Dompeldorius, Yutaka Hashimoto Abstract We introduce a new kind of blockchain scaling solution, which can be classified as a kind of Plasma, but without the online requirement of users. Our design satisfies the following requirements: O(1) state growth per block relative to the number of users before withdrawals No need for channels or individual liquidity preparations between r
[レベル: 初級] なぜ Google は、すべての検索ランキングシステムのアップデートをアナウンスしないのでしょうか？ 理由を、Google 検索の広報担当の Search Liason が説明しました。 すべてのアップデートを告知しない理由 Google は、広範囲なコア アップデートについては情報提供するが、広範囲なコア アップデートの延長に思える大きなランキング変動については説明しないのはどうしてなのか？ こんな問いかけに SearchLiason の X 公式アカウントは次のように返答しました。 コア アップデートに関する情報は、こちらのページでご確認いただけます: https://developers.google.com/search/updates/core-updates 次のように書かれています。 Google では常に検索エンジンのアルゴリズムを更新しており、その更新
Last month the V8 team published an excellent blog post on what they call the V8 Sandbox. This isn’t a sandbox for your JavaScript code — it’s intended to mitigate browser exploits caused by bugs in the JIT compiler itself. That’s important work because they report that most Chrome exploits start with a V8 memory safety bug. V8 is written in C++, so it may seem like these are the sort of bugs you’
GitHub's Engineering Fundamentals program: How we deliver on availability, security, and accessibility
EngineeringGitHub’s Engineering Fundamentals program: How we deliver on availability, security, and accessibilityThe Fundamentals program has helped us address tech debt, improve reliability, and enhance observability of our engineering systems. How do we ensure over 100 million users across the world have uninterrupted access to GitHub’s products and services on a platform that is always availabl
j次のブックマーク
k前のブックマーク
lあとで読む
eコメント一覧を開く
oページを開く
Places to Visit and the Best Things to Do in Tokyo
Delving Into the World of IT Security
Moving back to React
Make Ethereum Cypherpunk Again
Unexpected Anti-Patterns for Engineering Leaders
Grow Up Already! Why It Takes So Long to Mature
DDoS threat report for 2023 Q2
トゥルークライム 実在したシリアルキラーを扱う「実録犯罪モノ」の問題点 - wezzy｜ウェジー
外国人「エジプトを訪れた日本人の感想をご覧ください」（海外の反応）
LangChain Cheat Sheet - KDnuggets
Zero downtime Postgres upgrades | Knock
The Best Anime Series of 2023
Introduction to Machine Learning
Internationalization with Remix
IBM’s Granite code model family is going open source
Rust is for the Engine, Not the Game - Barrett's Club
Data Security: Importance, Spheres, and Best Practices
Transactional Leadership Vs. Transformational Leadership
Plasma Next: Plasma without Online Requirements
すべての検索ランキングシステムのアップデートをなぜGoogleはアナウンスしないのか？
Writing Truly Memory Safe JIT Compilers