Zhebrak et al.

Zhebrak et al.

Share this post

Zhebrak et al.
Zhebrak et al.
A window
Copy link
Facebook
Email
Notes
More

A window

Alex Zhebrak's avatar
Alex Zhebrak
Nov 02, 2024

Share this post

Zhebrak et al.
Zhebrak et al.
A window
Copy link
Facebook
Email
Notes
More
Share

Achieving synthetic general intelligence is likely impossible without decoupling the models from human interfaces. While there is a hope that existing models will learn the nature of reality as a by-product of their interaction with human-generated data, their inputs and outputs conform by design to our biology, and these data points present a limited perspective on the true state of things. Such decoupling raises alignment concerns as our directions can have unexpected outcomes as the model translates the human interface (even if it has one) into its interface with general reality. Unlike feral children who share human biology, an autonomous intelligence can evolve unpredictably and devise abstractions incompatible with ours. Models capable of more than integration and repetition should have a window into general reality, and we need to design this window so that we get to experience the view.


Subscribe to Zhebrak et al.

By Alex Zhebrak · Launched 2 years ago
Notes on science, technology, progress, and synthetic intelligence

Share this post

Zhebrak et al.
Zhebrak et al.
A window
Copy link
Facebook
Email
Notes
More
Share

Discussion about this post

User's avatar
Distorted virtual avatars
From AI-enabled photo editing apps to fully-fledged virtual avatars, our synthetic presence becomes more vivid and pronounced. Every year we step…
Jan 21, 2023 â€¢ 
Alex Zhebrak
2

Share this post

Zhebrak et al.
Zhebrak et al.
Distorted virtual avatars
Copy link
Facebook
Email
Notes
More
Self and local models
If self is indeed just a story we tell ourselves to preserve the agent's continuity in the physical world and culture is a similar type of story on the…
Feb 18, 2023 â€¢ 
Alex Zhebrak
2

Share this post

Zhebrak et al.
Zhebrak et al.
Self and local models
Copy link
Facebook
Email
Notes
More
Losing authorship
As the lines between the human author and their digital assistants blur further, the existing idea of data authorship loses its value. We might be…
Mar 18, 2023 â€¢ 
Alex Zhebrak
2

Share this post

Zhebrak et al.
Zhebrak et al.
Losing authorship
Copy link
Facebook
Email
Notes
More

Ready for more?

© 2025 Alex Zhebrak
Privacy ∙ Terms ∙ Collection notice
Start writingGet the app
Substack is the home for great culture

Share

Copy link
Facebook
Email
Notes
More

Create your profile

User's avatar

Only paid subscribers can comment on this post

Already a paid subscriber? Sign in

Check your email

For your security, we need to re-authenticate you.

Click the link we sent to , or click here to sign in.