Microsoft's VALL-E 2: AI Voice Too Real to Release

[{"selector":"#anim-9d8538a9-1a65-4e01-acd1-0c049a42089b","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-0f20b8a7-e0f0-43fd-a03f-fbe036ad08b2","keyframes":{"transform":["translate3d(0px, 183.06880%, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-db505c82-4978-4dc3-812e-e810602dbb4d","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-4ffbd1c4-bd84-4024-b767-77f6b1dcdec5","keyframes":{"transform":["translate3d(0px, -99.64229%, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] Microsoft made a new AI speech generator called VALL-E 2 that sounds so real it can't be released to the public.

[{"selector":"#anim-74cde862-4b24-41ee-b6a8-19c2ea1924c0","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-78a56c62-5832-466b-83c3-a1243c67e7ed","keyframes":{"transform":["translate3d(0px, 240.27785%, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-40183700-0e12-4e98-8a88-5a5675296c9a","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-41eb96e1-7fb7-46d6-b9d6-4dc51d07a664","keyframes":{"transform":["translate3d(0px, -99.64229%, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] VALL-E 2 can copy a person's voice using just a few seconds of audio.

[{"selector":"#anim-eef6979e-5245-46cf-a443-f544632639df","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-a525fc25-8fe6-485b-be45-619a01161ac9","keyframes":{"transform":["translate3d(0px, 240.27785%, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-78b31a4a-237d-470d-bb73-5ac1d653f18c","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-6a244a9d-6f9e-4d06-9810-cd79e162d873","keyframes":{"transform":["translate3d(0px, -99.64229%, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] Researchers say VALL-E 2 creates speech that is as good as human speech.

[{"selector":"#anim-4c2a3d68-7e4d-41e4-ba24-d6d2c4b88e93","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-ff35a440-c99f-4aad-b12f-e583b6e6bea0","keyframes":{"transform":["translate3d(0px, 163.32496%, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-e737eebc-1cdb-42d0-8291-8e767f0b72cb","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-3f20094a-95b3-428b-ac48-dee782c7e5bd","keyframes":{"transform":["translate3d(0px, -99.64229%, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] It uses two special methods, "Repetition Aware Sampling" and "Grouped Code Modeling," to make speech sound natural and quick.

[{"selector":"#anim-372cd235-a489-414b-942d-e37b8546dc6a","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-dfb34d33-2ea7-4186-b4c7-c82b830bdd94","keyframes":{"transform":["translate3d(0px, 193.54502%, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-127a102c-6daa-4c60-b705-69e4b3e495ad","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-ba8ac1ff-069f-491b-a150-73c9d0ee1cde","keyframes":{"transform":["translate3d(0px, -99.64229%, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] VALL-E 2 was tested using audio samples and proved better than past AI systems at matching human speech.

[{"selector":"#anim-065b63d5-ee39-4089-825f-acbe0c31c828","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-bd49706b-932d-4e94-9ed0-4d283d06d82d","keyframes":{"transform":["translate3d(0px, 236.52783%, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-c6465e99-e444-4b40-9f5f-2df1f4d8db47","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-223a5826-3c6b-4839-9cfb-eb8a2609d2e6","keyframes":{"transform":["translate3d(0px, -99.64229%, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] The AI is not being released because it could be misused, like for faking voices.

[{"selector":"#anim-ef3b7ed2-c126-48a8-ab81-2943b51757e2","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-46c256c1-3e3d-4195-acf6-ba01e894fd24","keyframes":{"transform":["translate3d(0px, 236.52783%, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-9184defd-8c66-43c8-a776-f2b8515268d9","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-e187fda6-9941-4418-b740-9062d8ae3dd7","keyframes":{"transform":["translate3d(0px, -99.64229%, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] Microsoft is keeping VALL-E 2 as a research project and has no plans to make it public.

[{"selector":"#anim-1159ffd3-c384-4b6b-abe0-199dd7454bb4","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-ca1a9f03-6716-49ce-94c4-6ec2341a1c38","keyframes":{"transform":["translate3d(0px, 236.52783%, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-4b1d8a20-a5b6-4b5e-981c-094b349df001","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-2930e32c-a75c-457a-9881-d789a2cbc0c5","keyframes":{"transform":["translate3d(0px, -99.64229%, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] In the future, this AI could be used for education, entertainment, and other helpful applications.