Logo
Picture

Brim Data @brimdata

The company behind Zed https://t.co/9s5PTryCYd - a schema-less, fully-typed data lake - a pipeline query language - a unified family of data tools: zq, zed, zui brimdata.io Oakland, CA Joined January 2020
  • Tweets
    294
  • Followers
    676
  • Following
    60
  • Likes
    200
brimdata Profile Picture

Brim Data @brimdata

2 years ago

The little UI details... Also, we're working on bringing an "inspector" view to the Zui detail pane in the right sidebar, much like the "inspector" view in the main results, but for only the selected value. Stay tuned.

specialCaseDev Profile Picture

James Kerr @specialCaseDev

2 years ago

This was hard to get right... #react #webdev #css #UI

brimdata Profile Picture

Brim Data @brimdata

2 years ago

Love this quote from a happy zq user! We expect Zed is going change some norms in the data world. #DataEngineering #DataScience

brimdata Profile Picture

Brim Data @brimdata

2 years ago

We are now creating Apple silicon builds for Zui. We previously only built for Intel and relied on Rosetta to run on the “M” chips. If you are on a newer Mac, you’ll enjoy a performance boost thanks to our friends in Cupertino. You can find your platform on our download page.

brimdata Profile Picture

Brim Data @brimdata

2 years ago

@wgeary What software was used to create this?

brimdata Profile Picture

Brim Data @brimdata

2 years ago

@simongerman600 This is beautiful.

brimdata Profile Picture

Brim Data @brimdata

2 years ago

Red squiggly lines! The Zui app can now detect errors in the query and mark them up within the query editor as you’re writing. It can underline your semantic errors in addition to syntax problems. Thanks to @MattNib for the /query/describe endpoint. #datascience #dataviz

brimdata Profile Picture

Brim Data @brimdata

2 years ago

@bibryam Perfect description. Although Java & Kubernetes can actually die and the world would be just fine.

brimdata Profile Picture

Brim Data @brimdata

2 years ago

@samcodes_io So true.

brimdata Profile Picture

Brim Data @brimdata

2 years ago

@gunnarmorling Why do we think that everything must do everything?

brimdata Profile Picture

Brim Data @brimdata

2 years ago

Fresh off the build servers! A new Zed and Zui release. Here are the best parts: 1. Inline Editor Errors 2. Apple Silicon Support 3. Redesigned Settings 4. JSON Pretty Print CLI Option Read the details on the Brim Data Blog: brimdata.io/blog/june-2024…

Brim Data retweeted
SteveMcCanne Profile Picture

Steven McCanne @SteveMcCanne

2 years ago

@ankrgyl @datadoghq @splunk @braintrustdata Turns out you can build a high performance, vectorized query engine (development underway) where data self-organizes around its types instead of externally defined schemas. We call this super-structured data. zed.brimdata.io/docs/formats

brimdata Profile Picture

Brim Data @brimdata

2 years ago

@joe_hellerstein Boring software to news reporters means stable, finished, heavily relied upon software to developers.

brimdata Profile Picture

Brim Data @brimdata

2 years ago

And as for Zed, we've got language improvements. like nameof() supporting type values and better scoping in user-defined operators. The buffer size for "line" input also got bumped up to 25MB. Full release notes here: github.com/brimdata/zed/r…

brimdata Profile Picture

Brim Data @brimdata

2 years ago

Zui got a big upgrade to the "export results" workflow. You can now export the results of a query to a new pool, an existing pool , or even your clipboard's paste buffer! Full release notes here: github.com/brimdata/zui/r…

brimdata Profile Picture

Brim Data @brimdata

2 years ago

It's a release day! We've got fresh versions of Zed and Zui up at brimdata.io/download Zui 1.7 Zed 1.15

brimdata Profile Picture

Brim Data @brimdata

2 years ago

Pull up the export modal with the keyboard shortcut CmdOrCtrl+Shift+E

brimdata Profile Picture

Brim Data @brimdata

2 years ago

Data has been incredibly easy to load into Zui, now it's just as easy to export it. Our latest Zui Insiders build includes the option to export the results of a query into a new or existing pool. Export to Pool Demo

brimdata Profile Picture

Brim Data @brimdata

2 years ago

The whole point of schemas and tables is to have data type certainty. As soon as you put data in a JSON column however, all certainty is lost. There is even an entirely different query language within SQL you must use to interact with the JSON columns. If your foundation is built on table schemas, it begins to crack under the weight of complex types like arrays and objects. With a system like Zed which supports first-class types for primitive and nested data, type certainty returns. Schemas become simple policies determining if data is of a given type, not gatekeepers of saving bytes to disk. With Zed, the types allow for schemas rather than schemas allowing for types. What an exciting world to work in!

brimdata Profile Picture

Brim Data @brimdata

2 years ago

Here we explore an entire day of public #GitHub activity about (2GB compressed) with Zui and Zed's fuse() aggregator. With a 4 word query, we can see the "schema" for each GitHub event type. Zed is a powerful tool for exploring unfamiliar datasets.

brimdata Profile Picture

Brim Data @brimdata

2 years ago

The zed language now has the "grok()" function. Use it to turn lines of text into structured records. Here's a syslog example:

Trends for United States

Spurs
Knicks
Brunson
Brewers
#NBAFinals
Game 4
Melanie
Keldon Johnson
Castle
Adam Silver
Belfast
Aaron Fox
Mike Brown
#TrumpCurse
Clarkson
Winn
Ashby
Chad Patrick
Josh Hart
New Yorkers

You might like

Peel back the layers of your enterprise and make your adversaries cry! FREE and OPEN platform BY defenders FOR defenders!
Security Onion
@securityonion
19K Followers
@FalconForceTeam | researcher with a camera | Microsoft MVP | Snow man role model
Olaf Hartong
@olafhartong
17K Followers
Generic Detection Rules for Log Data
sigma
@sigma_hq
5K Followers
AI-turbocharged detection intelligence. Enable line-speed cyberattack detection with AI trained on 11 years of Detection Intelligence.
SOC Prime
@SOC_Prime
6K Followers
We’re an information security practitioner-focused company dedicated to providing impactful, high quality training and education. Founded by @chrissanders88.
Applied Network Defen...
@NetworkDefense
4K Followers
I post more on LinkedIn now. X is dead. | Sr. Detection Engineering and Threat Hunting Manager @HuntressLabs | Former Principal @CrowdStrike and HuntressLabs
Jai Minton
@CyberRaiju
8K Followers
Learn Threat Hunting, Detection Engineering, DFIR, and KQL https://t.co/uAlYlXIXot @BluRavenSec Microsoft Security MVP #ThreatHunting #DataScience
Mehmet Ergene
@Cyb3rMonk
14K Followers
Suricata IDS/IPS/NSM engine developed by the @OISFoundation
Suricata IDS/IPS
@Suricata_IDS
13K Followers
CSIRT | https://t.co/Tu1l2ZFe0T | Microsoft Security MVP | Blue & Purple Team | SOC | SIEM | Threat Hunting | Detection Engineering | #KQL |
Bert-Jan 🛡️
@BertJanCyber
4K Followers
#CyberDefense #AI #DataScience @GeorgeMasonU @NOVAcommcollege @pucp
Jose Rodriguez 🇵�...
@Cyb3rPandaH
6K Followers
great, now I'm on twitter
Greg Lesnewich
@greglesnewich
4K Followers
Detection @Splunk & @cisco | previously @nextronsystems | @sigma_hq & @magicswordio maintainer | Eternal Learner
Nasreddine Benchercha...
@nas_bench
12K Followers
Nuclei uses a vast templating library to scan applications, cloud infrastructure, and networks to find and remediate vulnerabilities.
Nuclei by ProjectDisc...
@pdnuclei
38K Followers
Specializing in pen testing, red teaming, and Active SOC. We share our knowledge through blogs, webcasts, open-source tools, and Backdoors & Breaches game.
Black Hills Informati...
@BHinfoSecurity
49K Followers
Malware Analyst @BoschGlobal CERT | Author of #pestudio
marc ochsenmeier
@ochsenmeier
14K Followers