• Lore
  • Posts
  • 🧙🏼‍♂️ Lore AI Newsletter #7

🧙🏼‍♂️ Lore AI Newsletter #7

Cover Art by Ben Kanizay

GM.

We hit 1,000 subscribers this week! More is on the way, with our new website expected to be done in ~2 weeks.

If you're interested in sponsoring Lore, let us know. Our readers include people from AMEX, TikTok, Spotify, Tesla, a16z, Nvidia, Fujitsu, Airbnb, Google, IBM, Cloudflare, Amazon, SoftBank, USV, Samsung, Oracle, Riot Games, Lightspeed Ventures, Wizards of the Coast, and Toyota, among others.

Okay, let's get to it.

In today's issue:

  • 💡MOST INNOVATIVE PRODUCT: Stable Diffusion 2.0

  • 📰 AI NEWS: Google licenses cancer-screening algorithm, Meta AI has been super busy with MultiRay and CICERO, NVIDIA wins two NeurIPS awards for Generative AI research

  • 🤯 COOLEST THING: AI Virtual World

  • 🧠THINGS WE LEARNED: Stable Diffusion has insane developer adoption, large language models are running out of data, OpenAI explores imitation learning, and people are pretty scared of AI

  • FEATURED ARTISTS: Ben Kanizay, Nico, Ai Machina, Eroteme Art

Stable Diffusion 2.0

💡MOST INNOVATIVE PRODUCT

The biggest buzz in Generative AI this week is the release of Stable Diffusion 2.0 by Stability.ai, which includes some major updates that have so far received mixed reviews.

 Stable Diffusion 2.0 has officially been released!

- image quality improved

- base 512x512 and 768x768 image generation

- up to 4x upscaling for 2048x2048+ images

- depth->image model released as well

blogpost: https://t.co/9oCVvwUfbK

HF: https://t.co/ej9JmDJOUA pic.twitter.com/FKIumbCaMY— nearcyan (@nearcyan) November 24, 2022 

Key features of the 2.0 release

  • New text-to-image diffusion models using a brand new text encoder (OpenCLIP). Result: improved image quality, although not everyone likes the style.

  • Super-resolution upscaler diffusion models which enhance the resolution of images by a factor of 4.

  • Depth-to-image diffusion model which infers the depth of an input image and then generates new images using both the text and depth information.

  • Updated inpainting diffusion model which makes it possible to switch out parts of an image.

 That was a nice, long Thanksgiving weekend!

And yes, I also think that Stable Diffusion 1.5 is actually better than Stable Diffusion 2.0 pic.twitter.com/LldadPPWCW— Sebastian Raschka 📚 (@rasbt) November 28, 2022 

 Tried Stable Diffusion 2.0's inpainting, it's still unusable or maybe I'm doing smth wrong pic.twitter.com/Z6ODkB6FU4— @levelsio (@levelsio) November 29, 2022 

Additional notes on Stable Diffusion 2.0

Some users are unhappy that the update has made it more difficult to generate images in the styles of specific artists, or create NSFW artworks.

Individual interests aside, this update is good for the Generative AI space and preserves the integrity of the model. There's less controversy over potential copyright infringements, and more protection against child pornography.

It does mean that more effort is required to generate specific results, and we expect this will boost personality-refined styles among AI artists.

 He who has ears to hear, let him hear.#StableDiffusion2 #depth2img #AI #3D pic.twitter.com/mogIU2K02k— Emm (@emmanuel_2m) November 24, 2022 

How does AI text-to-image actually work?

Posted on r/StableDiffusion by u/MicahBurke (thanks Dylan for sharing!)

(Psst. Still writing every word by hand? You're a little behind the curve. Check out Jasper for some AI-powered speed writing👇)

Jasper.ai

❤️ We've partnered with Jasper to offer you 10,000 free credits if you signup using our affiliate link. Bonus: it helps support our newsletter and community.

📰AI NEWS

Google licenses cancer-screening algorithm, Meta AI has been super busy with MultiRay and CICERO, NVIDIA wins two NeurIPS awards for Generative AI research

Google licenses cancer-screening algorithm

Google Health announced that its AI algorithm for breast cancer screening will now be part of commercial mammograms after licensing its technology to iCAD, a med-tech company that provides global breast cancer detection services to healthcare facilities.

Meta AI has been super busy

Last week, the company launched MultiRay, a new platform which executes cutting-edge AI models at a large scale to make AI systems more productive. MultiRay effectively allows countless AI models to share the same input.

Meta AI also announced an AI called CICERO that successfully beat humans at ‘Diplomacy' [here's the research paper], a big advancement since Google's AI beat a human at 'Go' in 2016.

NVIDIA wins two NeurIPS awards for Generative AI research

Two NVIDIA research papers have been honored with NeurIPS 2022 Awards for their contributions to the field of AI and machine learning. The first paper explores diffusion-based generative AI models, while the other addresses training generalist AI agents.

Who got funding this week

  • RedBrick AI raised $4.6M to accelerate AI in clinical settings, through rapid data annotation on medical imagery.

  • V7 Labs raised $33M to automate training data for computer vision AI models.

  • Netail raised $5M to advance retail-focused AI development.

  • Deepgram raised $72M for AI speech recognition technology.

  • Sapia.ai raised $17M to solve for diversity and inclusion using AI.

  • Advanced Navigation raised $68M for AI robotics and navigation technology.

  • Deepomatic raised $10.5M for its AI-based computer vision companion for field workers.

  • The Applied AI Company raised $42M to build products for pharmaceutical, healthcare, safety and government sectors.

  • Silverpush raised $12M for cookieless solutions through its proprietary AI platform.

  • Harvey.ai raised $5M led by OpenAI for its AI legal assistant product.

🤯 COOLEST THING 

AI Virtual World

Thanks to community member AP for suggesting this!

It is now possible to combine AI images with cinematic projection to create AI-generated virtual worlds.

 Collaboration with @HODLFrance 

AI Image -> Cinematic Projection#AIart #touchdesigner #deforum pic.twitter.com/l1XiaohDUy— ScottieFox (@ScottieFoxTTV) November 28, 2022 

The implications of this for virtual reality could be significant. We immediately think about video games and entertainment, architecture/urban/industrial design, education and training, engineering, restorative nature experiences... it could be all of this, and possibly more.

What else we found this week

You can now generate 3D models of animals from a single image, given a training data set

 It's now possible to generate 3D models of animals from as single image(!), given a training data set 🤯 #ai pic.twitter.com/1FlvSiiMMN— Nick (@fryingneurons) November 24, 2022 

AI is doing incredible things for product design

 +200 #AI-generated sneakers in less than 2h.

(I'd wear many of them ✨)

More examples below.🧵

What should I create next?#stablediffusion #AIart #fashion #fashiondesign pic.twitter.com/hbXWIntnoU— javierjrueda (@javierjrueda) November 24, 2022 

The potential is also huge for interior design

 Exploring #midjourney for interior design.#AIart #digitalart pic.twitter.com/gFoeWjrjzG— The Brauhaus (Braulio Baltazar) (@brauliobaltazar) November 25, 2022 

AI avatars are still all the rage, with early movers growing fast

 ✨ Just launched the next phase of Avatar AI:

🙂 -> 📸 Pivoting from just avatars to entire photo shoots!

1) make 120+ avatars

2) select your favorite(s)

3) expand them into photo shoot-style pics w/ AI

📸 IRL Photo shoot: $300 - $3000

🤖 This: $99https://t.co/tiRwTS25CN pic.twitter.com/dSJNLakVvO— @levelsio (@levelsio) November 25, 2022 

AI also happens to be revolutionizing warfare

 I'm publishing a call to action: The AI War and How to Win It.

AI for national security will define the future of our world. Either the USA wins, or our authoritarian adversaries do.

I walk through The AI War, The China Threat, and How to Win It.

🧵https://t.co/7by2iroWWD— Alexandr Wang (@alexandr_wang) November 27, 2022 

🧠THINGS WE LEARNED

Stable Diffusion has insane developer adoption, large language models are running out of data, OpenAI explores imitation learning, and people are pretty scared of AI

🥋 Prompt Tip of the Week: "Try the prompt "split screen" or "two shot" to get two #midjourney widescreen compositions in a single image. Great for telling stories!" - Davis Taylor Brown

 Quick tip: Try the prompt "split screen" or "two shot" to get two #midjourney widescreen compositions in a single image. Great for telling stories! pic.twitter.com/t8AnhhYl70— Davis Taylor Brown (@Davistaylorbro) November 28, 2022 

Stable Diffusion has insane developer adoption

Source: Art Isn’t Dead, It’s Just Machine-Generated

Most people miss the almost-vertical line to the left of the graph — which should indicate just how radical developer adoption of Stable Diffusion has been since day one.  

Generative AI is growing at a rate unlike anything we have seen in our lifetimes, a clear sign that the technology is quickly revolutionizing the world as we know it.

We could soon run out of data to train AI models on

According to a paper published this week by AI research and forecasting organization Epoch, we could soon run out of the types of data typically used for training large language models (think Wikipedia, news articles, scientific papers, and books). Excerpt:

Our analysis indicates that the stock of high-quality language data will be exhausted soon; likely before 2026. By contrast, the stock of low- quality language data and image data will be exhausted only much later; between 2030 and 2050 (for low-quality language) and between 2030 and 2060 (for images).

This looming problem might cause a few headaches for programs like GPT-3 that can write coherent articles and computer code.

OpenAI explores imitation learning with a bot that watched 70,000 hours of Minecraft...

...and then proceeded to play the game better than any AI had before.

Imitation learning could be used to train machines to carry out a wide range of tasks by watching humans do them first — which highlights the potential of sites like YouTube as a vast and untapped source of training data.

Technophobia. AI-phobia. Algorithmophobia?

This isn't new, but people are actually pretty scared of AI and its implications.

We dug up some old texts on the topic.

A reassuring article titled Fear No AI by Wired in 1995 said:

Computers may evolve, but their evolution isn't shaped by natural selection … So, to ask what computers will become is to ask what we want from them. […] Instead of replacing us, computers will become a secondary, symbiotic species, enhancing our lives in specialized but powerful ways. In the process, they will transform what it means to be human.

20 years later (2015), the MIT Technology Review wrote:

A superintelligence would be godlike, but would it be animated by wrath or by love? It’s up to us (that is, the engineers). Like any parent, we must give our child a set of values. And not just any values, but those that are in the best interest of humanity. We’re basically telling a god how we’d like to be treated. How to proceed?

Then on Monday this week, The Highlight by Vox published an article called AI experts are increasingly afraid of what they’re creating. Here's what it said:

Handing over huge sectors of our society to black-box algorithms that we barely understand creates a lot of problems, which has already begun to help spark a regulatory response around the current challenges of AI discrimination and bias. But given the speed of development in the field, it’s long past time to move beyond a reactive mode, one where we only address AI’s downsides once they’re clear and present. We can’t only think about today’s systems, but where the entire enterprise is headed.

Creating something smarter than us, which may have the ability to deceive and mislead us — and then just hoping it doesn’t want to hurt us — is a terrible plan. We need to design systems whose internals we understand and whose goals we are able to shape to be safe ones. However, we currently don’t understand the systems we’re building well enough to know if we’ve designed them safely before it’s too late.

Further reading on the topic:

  • Fear of Autonomous Robots and Artificial Intelligence: Evidence from National Representative Data with Probability Sampling (2017) — read article

  • Dimensions of artificial intelligence anxiety based on the integrated fear acquisition theory (2020) — read article

Further Study 📖

AI in healthcare (this industry is exploding right now) —

  • Artificial Intelligence (AI) in Drug Discovery Market to Grow at a CAGR of 28.34% over the forecast period 2023 to 2032: Quince Market Insights — read article

  • GE Healthcare unveils AI program bundle for simplified MRI scans — read article

  • Big Data analytics and artificial intelligence in mental health — read article

  • University of Southern California Launches Center on AI Research for Health — read article

  • Have Your Cake And Eat It, Too: How AI Can Help Ensure Health Care Organizations Don’t Have To Sacrifice Quality, Time Or Cost — read article

  • AI-Powered Algorithm May Enhance CT Assessment of Aortic Dissection — read article

  • Aidoc nets FDA clearances for AI detection of aortic tears, medium-vessel strokes — read article

  • Philips Launches AI-Enabled 'Visualization Workspace' at RSNA — read article

Other segments —

  • AI affecting jobs: Could Amazon Be Replacing Recruiters With Artificial Intelligence Software? — read article

  • AI in academia: Now AI can write students’ essays for them, will everyone become a cheat? — read article

  • AI in finance: Tom Van Horn of Magnifi discusses the first AI-powered tool for DIY investors — listen to podcast

  • AI in engineering: AI Is Automating Defect Inspection — read article | Bosch uses AI to design new e-motors — read article (paywall)

  • AI in gambling: From customer service to tailored game choices — AI will be huge in the online casino industry — read article

  • AI in sport: Golfing robot uses physics-based model to train its AI system — read article

  • AI in government: End-to-End Artificial Intelligence Supports Federal Mission Sets — read article

  • AI in science: AI invents millions of materials that don’t yet exist — read article

  • AI in mining: AI can help mining companies keep up with modern demands — read article

  • AI bias: How New AI Technology Helps People With Disabilities but Introduces Discrimination — read article

  • Technical: 5 risks of AI and machine learning that modelops remediates — read article | Why the future of AI is flexible, reusable foundation models — read article | Heres a plain C/C++ implementation of AI speech recognition so get hackin' — read article

+ For those looking to build a career in AI, read this article.

✨FEATURED ARTISTS

Ben Kanizay, Nico, Ai Machina, Eroteme Art

This week's contest theme was retrofuturism.

Runner Ups:

Created by Nico

Created by Ai Machina

Created by Eroteme Art

Closing  

Glad to have you along for the journey, and thanks for helping us to grow to over 1,055 subscribers in 7 weeks.

See you next week!

-Nathan Lands & Michele du Toit

💌

Support the Newsletter

  1. Share this newsletter. 🥰

  2. Follow us on Twitter @NathanLands & @LunaMageAI.

  3. Sign-up for one of our affiliate partner's services. We get paid a commission which might be able to support this newsletter long-term!