Skip to content
Carmelics
TopicsThinkersChangesContributorsLoading account…

    Carmelics

    A reasoning platform. Break down any belief into clear reasons, explore both sides, and weigh the evidence honestly.

    Navigate

    • Topics
    • Search
    • Recent Changes
    • Contribute
    • How It Works
    • Glossary
    • Thinkers
    • Contributors
    • About
    • Statistics
    • Terms
    • Privacy

    Database

    Statements
    —
    Perspectives
    —
    Topics
    —

    Press ? for keyboard shortcuts

    LoyalLoyalJusticeJustice
    Made withinDC&Austin
    Statements
    321,452
    Perspectives
    108,905
    Topics
    42
    Unbounded utility functions permit adversarial exploitati... — Carmelics
    Home
    HistoryEditSee Inverse

    Part of a larger discussion

    Challenges→If 'outlandish' hypotheses are defined by low prior probability, the Mugger scenario (Bostrom, Yudkowsky) shows that even vanishingly small priors can be overwhelmed by sufficiently large utility multipliers.

    Unbounded utility functions permit adversarial exploitation; rational decision theory should be robust against agents who claim arbitrarily large payoffs.

    ?Rate how convincing each reason is below to see the overall strength.

    No one has weighed in yet. Be the first to share reasons for or against this statement.

    Sign in or register to share your perspective on this statement.

    Connections

    1 linked claim

    If 'outlandish' hypotheses are defined by low prior probability, the Mugger scen...

    Related

    If 'outlandish' hypotheses are defined by low prior probability, the Mugger scen...

    Details

    Type
    premise
    Perspectives

    Next step

    Based on where you are in your exploration

    Explore a random proposition
    Start fresh with something unrelated.
    0 (0 for, 0 against)

    Open for perspectives

    This idea is waiting for its first supporting or challenging perspective.

    Share the first perspective