99魔都论坛

 找回密碼
 立即註冊
查看: 3|回復: 0

Know that we can ignore

[複製鏈接]

1

主題

1

帖子

5

積分

新手上路

Rank: 1

積分
5
發表於 2024-2-27 14:21:58 | 顯示全部樓層 |閱讀模式
The LD data also has a key in the root dictionary, otherwise the files are identical. For example, you have a GB file that is served twice, one of which also contains approximately KB of metadata. Therefore, smaller files are completely useless. On the one hand, it is a strange situation, on the other hand, it is an unexpected surprise. The same vendor needlessly released the vast majority of its data last time we looked at its work, and now only half of it is released.



Author: Screenshot, Ondřej Kokeš So we already half of the dataset, so we Benin Mobile Number List download the entire JSON-LD dataset. The high compression ratio might surprise you at first glance (approximately: , i.e. the largest file is about GB compressed but over GB decompressed), but this is due to the very verbose JSON format. Normally this doesn't matter, it's common to process data iteratively, but solution providers make this option more difficult by choosing a format.





Rather than choosing a format that allows stream processing, the vendor chose a structure that encourages loading the entire file into memory (few implementations allow sequential processing of this structure), which is very difficult for GB files on common hardware . This may sound cliché, but it is a major drawback of open data in electronic collections. All other limitations can be solved in some way, but if the average user encounters such a huge amount of data, it will be very difficult to process it in any way.


回復

使用道具 舉報

您需要登錄後才可以回帖 登錄 | 立即註冊

本版積分規則

Archiver|手機版|自動贊助|99魔都网

GMT+8, 2024-5-16 21:27 , Processed in 0.892436 second(s), 18 queries .

抗攻擊 by GameHost X3.4

© 2001-2017 Comsenz Inc.

快速回復 返回頂部 返回列表
一粒米 | 中興米 | 論壇美工 | 設計 抗ddos | 天堂私服 | ddos | ddos | 防ddos | 防禦ddos | 防ddos主機 | 天堂美工 | 設計 防ddos主機 | 抗ddos主機 | 抗ddos | 抗ddos主機 | 抗攻擊論壇 | 天堂自動贊助 | 免費論壇 | 天堂私服 | 天堂123 | 台南清潔 | 天堂 | 天堂私服 | 免費論壇申請 | 抗ddos | 虛擬主機 | 實體主機 | vps | 網域註冊 | 抗攻擊遊戲主機 | ddos |