A century after its invention, the form seems to have lost its nerve — but in Venice, two bold artists are preparing to test audiences’ limits