How to use text to speech with streaming in Python or Node.js
How to convert text into speech, upload to S3, and share with a signed URL
In this tutorial, you’ll learn how to convert text to speech with the ElevenLabs SDK. We’ll start by talking through how to generate speech and receive a file and then how to generate speech and stream the response back. Finally, we’ll show you how to upload the generated audio to an AWS S3 bucket, and share it through a signed URL. This signed URL will provide temporary access to the audio file, making it perfect for sharing with users by SMS or embedding into an application.
If you want to jump straight to the finished repo you can find it.
Requirements
- An ElevenLabs account with an API key (here’s how to find your API key).
- Python(Node.js, TypeScript) installed on your machine
- (Optionally) an AWS account with access to S3.
Setup
Installing our SDK
Before you begin, make sure you have installed the necessary SDKs and libraries. You will need the ElevenLabs SDK for the text to speech conversion. You can install it using pip:
Additionally, install necessary packages to manage your environmental variables:
Next, create a .env
file in your project directory and fill it with your credentials like so:
ELEVENLABS_API_KEY=your_elevenlabs_api_key_here
Convert text to speech (file)
To convert text to speech and save it as a file, we’ll use the convert
method of the ElevenLabs SDK and then it locally as a .mp3
file.
You can then run this function with:
Convert text to speech (streaming)
If you prefer to stream the audio directly without saving it to a file, you can use our streaming feature.
You can then run this function with:
Bonus - Uploading to AWS S3 and getting a secure sharing link
Once your audio data is created as either a file or a stream, we can upload it to an AWS S3 bucket and generate a secure sharing link.
This process enables you to store your audio files securely in the cloud, offering robust data protection and scalability options provided by AWS. Additionally, by generating a secure sharing link, you ensure that only authorized recipients can access the file, further enhancing the security of your content. This method facilitates easy sharing of audio data, supporting a wide range of applications from content delivery to collaborative projects, while maintaining the integrity and privacy of the data.
Creating your AWS credentials
To upload the data to S3 you’ll need to add your AWS access key ID, secret access key and AWS region name to your .env
file. Follow these steps to find the credentials:
- Log in to your AWS Management Console: Navigate to the AWS home page and sign in with your account.
AWS Console Login
- Access the IAM (Identity and Access Management) Dashboard: You can find IAM under “Security, Identity, & Compliance” on the services menu. The IAM dashboard manages access to your AWS services securely.
AWS IAM Dashboard
- Create a New User (if necessary): On the IAM dashboard, select “Users” and then “Add user”. Enter a user name.
Add AWS IAM User
- Set the permissions: attach policies directly to the user according to the access level you wish to grant. For S3 uploads, you can use the AmazonS3FullAccess policy. However, it’s best practice to grant least privilege, or the minimal permissions necessary to perform a task. You might want to create a custom policy that specifically allows only the necessary actions on your S3 bucket.
Set Permission for AWS IAM User
- Review and create the user: Review your settings and create the user. Upon creation, you’ll be presented with an access key ID and a secret access key. Be sure to download and securely save these credentials; the secret access key cannot be retrieved again after this step.
AWS Access Secret Key
- Get AWS region name: ex. us-east-1
AWS Region Name
If you do not have an AWS S3 bucket, you will need to create a new one by following these steps:
- Access the S3 dashboard: You can find S3 under “Storage” on the services menu.
AWS S3 Dashboard
- Create a new bucket: On the S3 dashboard, click the “Create bucket” button.
Click Create Bucket Button
- Enter a bucket name and click on the “Create bucket” button. You can leave the other bucket options as default. The newly added bucket will appear in the list.
Enter a New S3 Bucket Name
S3 Bucket List
Installing the AWS SDK and adding the credentials
Install boto3
for interacting with AWS services using pip
and npm
.
Then add the environment variables to .env
file like so:
AWS_ACCESS_KEY_ID=your_aws_access_key_id_here
AWS_SECRET_ACCESS_KEY=your_aws_secret_access_key_here
AWS_REGION_NAME=your_aws_region_name_here
AWS_S3_BUCKET_NAME=your_s3_bucket_name_here
Uploading to AWS S3 and generating the signed URL
Add the following functions to upload the audio stream to S3 and generate a signed URL.
You can then call uploading function with the audio stream from the text.
After uploading the audio file to S3, generate a signed URL to share access to the file. This URL will be time-limited, meaning it will expire after a certain period, making it secure for temporary sharing.
You can now generate a URL from a file with:
If you want to use the file multiple times, you should store the s3 file path in your database and then regenerate the signed URL each time you need rather than saving the signed URL directly as it will expire.
Putting it all together
To put it all together, you can use the following script:
Conclusion
You now know how to convert text into speech and generate a signed URL to share the audio file. This functionality opens up numerous opportunities for creating and sharing content dynamically.
Here are some examples of what you could build with this.
-
Educational Podcasts: Create personalized educational content that can be accessed by students on demand. Teachers can convert their lessons into audio format, upload them to S3, and share the links with students for a more engaging learning experience outside the traditional classroom setting.
-
Accessibility Features for Websites: Enhance website accessibility by offering text content in audio format. This can make information on websites more accessible to individuals with visual impairments or those who prefer auditory learning.
-
Automated Customer Support Messages: Produce automated and personalized audio messages for customer support, such as FAQs or order updates. This can provide a more engaging customer experience compared to traditional text emails.
-
Audio Books and Narration: Convert entire books or short stories into audio format, offering a new way for audiences to enjoy literature. Authors and publishers can diversify their content offerings and reach audiences who prefer listening over reading.
-
Language Learning Tools: Develop language learning aids that provide learners with audio lessons and exercises. This makes it possible to practice pronunciation and listening skills in a targeted way.
For more details, visit the following to see the full project files which give a clear structure for setting up your application:
For Python: example repo
For TypeScript: example repo
If you have any questions please create an issue on the elevenlabs-doc Github.