Eleven Labs - A.I. Voice Cloning

edited February 2023 in General

Since my other thread was locked over the video content, I'll give a direct link to the website. This technology outta scare you. You can upload a voice sample and using A.I, it can create speech using that voice that sounds nearly 100% convincing.

https://beta.elevenlabs.io/

Comments

  • edited February 2023

    I listened to it. Not quite perfect but good enough to fool most of the people most of the time. Very impressive. Bolt it onto a deep fake video and you've really got something.

  • edited February 2023

    My favorite blog is one that details how an AI learned to cheat by breaking the games physics to win at tag!

    https://openai.com/blog/emergent-tool-use/

    AI has been out of the bag for years and cant be put back, enjoy the ride into science fact!

  • It's only going to get better. No longer will you be able to use video or audio "evidence" as sufficient proof. Somebody who doesn't like you for some reason can use this technology against you to get you into trouble.

  • That’s the least of your worries. They can use a loved one’s voice and call you and extract your identity and secrets through a conversation you are not actually having with them.

  • @FunCartel even that’s the least of our worries 😂😂 they can probably kill us all

  • @funcartel back in the day the scammers would call in to gramma or papa and say “ it’s sue or Joe and I’m in trouble, please send money”. Good news, though, it was kinda easier to deny because they sounded like 44 year old Jose or Garesh instead of 21 year old sue or Joe at college.

    Vocal patterns & micro expressions.

    This is what scares me. TikTok, Snapchat, all messenging apps are a library & database to mine/farm our identities. The way we write, talk, move, look, interact. All of those “reaction” videos? Absolute gold mines for this nefarious practice.

    What does this lead to? Instead of 100% faked video or audio…. They instead farm the 100% real you off social media. They then expertly stitch it together and voila, the fake you now looks real. Now, they have “you” conning money, committing bad acts, lewd acts, harassment, any number of questionable activities.

    How will you dispute it? How will any of us? This is a lot more insidious than we realize.

  • edited February 2023

    Chat GPT & fake photos that are hyper realistic.

    How do we know that everyone on here is 100% legit? How can we know whether who we are communicating with is real? I’ve been impressed & concerned by how effective chatgpt is in seeming… human like… in its communications.

    These advances are monumental. Stunning. Don’t get me wrong, I see countless uses for bona fide good here.

    Unfortunately, as with any true good, there is also potential for nefarious use as well.

    Use caution, folks. ☣️⚠️☢️

  • [Deleted User]natickben (deleted user)

    I worry a lot about this for a lot of reasons, but consent is one of the biggest. I happen to have an odd life with some very famous friends. People already deepfake porn of them. Adding their “voice” to it is so much more deeply unethical and a high violation of their autonomy and consent. And creeps on the internet will do it, and platforms won’t stop it. Type in the name of literally any actress on Reddit, and you’ll see what I mean.

    We need laws that are in front of this tech, not behind it, and they need teeth that will force platforms to take strong action to stop its spread

  • @natickben I 100% agree with you. Absolutely & then some. They cannot get the teeth in place soon enough. I’d say they are already behind the curve & really need to catch up. It’s scary.

  • The genie is out of the bottle, we have people only worried about the next election running this country, and it would take an international agreement between several countries to curb what’s coming. Rome is burning as we speak.

    We have rendered ourselves obsolete by our own design.

  • edited February 2023

    You cannot stop this or cap it. Anyone with a decent computer setup and the willingness to train it on datasets will be able to do it.

    How do you propose nations stop it? How will you tell? Even if you did tell how do you attribute one to someone. Think of it like pirating, you can stop a few, but it will always be around.

  • Deepfake porn is a whole new level of perversion and creepiness. If they don't willingly do sexual content then they obviously didn't consent to having fakes made of them.

  • @Mike403 It’s ok. I settled out of court. Plus the deepfake was enhanced.

  • @tacpmurg as per usual, you hit the subject matter right on it's head. 🙌

  • Idk, I think it's great.
    If someone wants to see me performing some act that I didn't want to/feel like doing it at the time, but others can still get the enjoyment of seeing me do it, more power to them.
    As long as there's an obvious way to tell, criminally/legally wise, that it's not real, and officials don't jump to arresting innocent people, I'm for it. But again, innocent people already in jail before any of this...so, nothing changing.

    No matter what technology we have...there will always be nefarious uses for it. That's nothing new at all.
    Even when fingerprints were first found that can be used... It was immediately also used to fake them.

    Not sure why people are always surprised and act like it's new. Humans have always been known to resist change. If more people embraced changed, and adopted it sooner, or at least tried more things... Maybe world would be more on same page.

    I also feel like laws will always be behind... That's how it works. Something happens, we decide it shouldn't happen, we make a law for it. Otherwise we have to what, say everything is illegal, and work backwards? Maybe some things would be more obvious then others, but always easier to say that in hindsight.

    I like to see it as everything comes down to yes/no... Hotdog/not hotdog...black/white...the gray comes in by how many of these checks are you doing before coming up with a decision before accepting the consequence.

  • edited February 2023

    Not sure why people are always surprised and act like it's new. Humans have always been known to resist change. If more people embraced changed, and adopted it sooner, or at least tried more things... Maybe world would be more on same page.

    Not change people are talking about here. The reason discussion of a universal income system is coming about is because millions of jobs are about to become obsolete and millions will be thrown out of work. Journalists, middle management, sales people, customer service people, warehouse workers, factory workers and construction workers will be disappearing in the ensuing years. Don’t believe me? Look at the people championing a universal income—tech CEOs. They know what will be happening very soon. They are the ones bringing the technology to market. Many tech CEOs warned about the ethical questions we never took under advisement or discussed in a rush to get to market.

    Now it is too late and millions of people still don’t realize it. I fear for the upcoming generations as the world population expands as jobs and water begin to shrink. Chaos is around the corner.

  • [Deleted User]Mman (deleted user)

    @FunCartel I agree with your take on this. I have discussed this with family and friends and mostly they just scoff at me.
    I fear for my grandchildren having the ability and opportunity to obtain a life supporting job, a house and a fulfilling life. I saw this coming years ago after retirement.
    The Train has left the station at full speed.

  • @Mman Yes and the sad truth is the game as we knew it is over and the wealthiest people will be fine but 99% of the world will eventually be disposable. The worst possible people are winning and have a universal income plan of $12,000 a year for those that are not them. Yet so many people are buried in their social media, video games and smart houses funding their own demise and touting how cool tech is.

  • [Deleted User]Mman (deleted user)

    @FunCartel This is a real life sci-fi disaster movie and Superman cannot stop it.

  • @FunCartel @Mman so interesting. I just had similar conversation with one of my sons. He's currently a High School math teacher here in Ohio. I always ask the same thing.... What will people do with their time all day? Not everyone has a passion, like art or music. Not everyone wants to travel or learn a language etc.

    There is a lot of chatting around these parts about universal income, and disappearing jobs. And it is needed conversation. I am trying to picture that world. I've mentioned many times on these threads about how the economy around here is slow to recover. I was chatting with a member today about how a popular restaurant chain now closes at 4 pm daily. And this is 2023!!

    I'm not against anything. I am just trying to get an understanding of what is happening. Lots of thoughts 🤔

  • [Deleted User]Mman (deleted user)

    @OhioMike Thanks for your input. I love that you are having these conversations. You are correct about they need to take place.
    I don't mean to be such a Debbie downer on this but I feel it is very important and I have lots of questions and concerns with no answers.

  • @Mman I like to think I'm more of an optimistic person, but yeah, I got concerns. What is a lifetime of not having a job like? Oh and @FunCartel ...the water wars? Oh man!!

  • @OhioMike My son is in his final semester of getting his Comp Sci degree and landed a full time job as a project manager supervising the coders and presenting results to upper management and marketing when he was a sophomore in college—very bright future. The CEO of the corporation even knows him because my son is an extrovert and a computer scientist at the same time and they are hard to find (I wish I had a $70,000/yr job at 19)! But even he is fearful of the future inside tech because AI is being developed that codes, troubleshoots, builds and is self-sufficient without people. He has thrown himself into AI technology and he will be fine, but he sees a dim future for millions of other people.

    My daughter is studying and double majoring in Conservation Biology/Environmental Science and the water crisis is very real. We have developed areas in the US taking as much as 100x the amount of water than nature can replace. You do not need a degree to know that math is not good for a sustainable future.

  • @FunCartel That's impressive information about your son and daughter. Wishing you and them the best! I enjoy sitting down with my three sons and talking about their careers and futures. Hoping for the best for all of them .

Sign In or Register to comment.