TikTok parent company ByteDance is World Of Single Jayeamassing huge volumes of web data way faster than the other major web crawlers
ByteDance may be planning to release its own LLM, and is aggressively using its web crawler, "Bytespider," to scrape up data to train its models, Fortune reported.
Bytespider showed up on the scene in April, and since then, its rate of consumption puts web scrapers from OpenAI, Google, Meta, and Anthropic to shame.
Sam Crowther, CEO of Kasada, a company that specializes in bot management, told the outlet that Bytespider's scraping rate is 25 times more than OpenAI's GPTbot and 3,000 times the rate of ClaudeBot, which is Anthropic's web crawler for its Claude LLM. Crowther also said that Kasada's data has seen "huge spikes in scraping activity" from Bytespider in the last six weeks.
As Bytespider voraciously consumes the web, the U.S. government is trying to inhibit potential access of American user data to the Chinese government. In April, President Biden signed a bill forcing the ban of TikTok unless it was sold by ByteDance within the year. Given ByteDance's ticking clock for selling TikTok, the sense of urgency fits the massive rate of its web crawling activity — whether for an LLM, a better algorithm, or something else, we don't know.
What ByteDance plans to do with all of its newly-mined data remains to be seen. But TikTok has launched several AI-powered features for the platform. In May, it announced a suite of tools for advertisers to create AI-generated ads, and AI-generated avatars for brands and creators. TikTok is also rumored to be working on an internal search engine, with results powered by AI — possibly using ChatGPT.
Topics Artificial Intelligence TikTok
A Woman and a Philosopher: An Interview with Amia Srinivasan by Lidija HaasHow to watch Samsung Unpacked: Galaxy S24, Galaxy AI awaitsThanksgiving with John Ehle by Valerie StiversSamsung Galaxy S24 Ultra handsGalaxy AI: 5 new features you can do with the Galaxy S24 camerasThe Paris Review Podcast, Episode 20 by The Paris ReviewWordle today: The answer and hints for January 18Best Dyson deal: Save $320 on the Dyson Zone Active NoiseThe Happiest Place on Earth? by Albert SamahaRemembering Jan MorrisNYT's The Mini crossword answers for January 18U.S. officials in Signal chat left their Venmo data exposed onlineOrganic Video by The Paris ReviewThe Happiest Place on Earth? by Albert SamahaTikTok is criticizing young girls who shop at Sephora. They're missing the point.Allowing Things to Happen: An Interview with Tyshawn Sorey by Craig Morgan TeicherHarvest Moon by Nina MacLaughlinJim Jarmusch’s Collages by Lucy SanteTolstoy’s Uncommon Sense and Common Nonsense by Yiyun LiNetflix might ditch the 'Match' feature Just when we thought we could move on, Tim Tebow homers in his first minor league at The simple reason Apple AirPods will be ubiquitous someday Here are the words businesses are using to avoid paying you benefits The DIY space race is here, and it's awesome HBO promos give us a peek at new 'Game of Thrones' costumes The next iPhone will be less expensive than we thought, analysts say Road rage in Australia? It's basically a bunch of indecipherable squawking Jake Johnson wants you to watch 'Win It All,' but only if it makes you happy Mastodon the band’s response to Mastodon the platform is metal AF Solange Knowles asked Twitter for an unexpected favor and thank goodness the internet delivered This man makes amazing surreal animations from famous artwork It's official: People are having sexual fantasies about their digital voice assistants iPad 2017 review: Good becomes perfect at $329 The results are in from that adorable second grade class survey There's more to tech stock photography than hokey gold bitcoins Man drives his car into the middle of a river because his GPS said to Great news for both the NBA and the internet: Lance Stephenson is back Corporations like PepsiCo will never be 'woke,' but here's how they can be better Shared bikes are so popular, they've squeezed humans out of this park This dog that was raised with cats loves hanging in a cat tree
2.3933s , 8198.9921875 kb
Copyright © 2025 Powered by 【World Of Single Jaye】,Fresh Information Network