VaniScript AI 🎙️🤖

An AI-powered multilingual content generation platform that transforms voice input into engaging, platform-specific social media content using AWS AI services.

📌 Overview

VaniScript AI helps users turn their voice thoughts and ideas into ready-to-use social media content.

Users can securely sign up and log in, record or upload a voice note, convert the audio into text using Amazon Transcribe, and generate customized social media content using Amazon Bedrock.

The platform also provides additional AI-powered features such as hashtag generation, virality score prediction, post rewriting, trending topic generation, and smart scheduling.

Generated content can be stored securely and accessed later through the application.

✨ Features

🔐 User Authentication

Secure user registration and login
OTP-based verification
Authentication powered by AWS Amplify
Protected access to application features

🎤 Voice Input

Record voice directly from the application
Upload existing audio recordings
Supports multilingual voice input

📝 Speech-to-Text

Converts voice recordings into text
Uses Amazon Transcribe
Enables users to transform spoken ideas into editable content

🤖 AI Content Generation

Generates social media content from the transcript
Uses Amazon Bedrock
Creates platform-specific content based on the user's input
Supports different content styles and formats

☁️ Secure Cloud Storage

Audio files are stored using Amazon S3
Provides reliable and scalable cloud storage
Keeps uploaded files separate from application data

💾 Content Storage

Generated posts can be saved for future use
Uses Amazon DynamoDB for persistent application data
Allows users to access previously generated content

🔥 Hashtag Generator

Generates relevant hashtags for generated posts
Helps improve content discoverability
Uses the generated content as context

📈 Virality Score Prediction

Provides an estimated virality score for generated content
Helps users evaluate the potential engagement of a post
Can be used to compare different versions of content

✍️ AI Post Rewriter

Allows users to rewrite generated content
Can improve clarity, engagement, and presentation
Uses AI to create alternative versions of a post

💡 Trending Topic Generator

Generates potential trending content ideas
Helps users discover topics that can be converted into social media posts

📅 Smart Scheduling

Extracts scheduling information from user input
Allows users to specify when content should be posted
Displays scheduled content within the application

Note: VaniScript currently does not automatically publish scheduled posts to social media platforms. Direct publishing depends on the APIs, permissions, authentication requirements, and restrictions imposed by individual social media platforms.

🏗️ System Architecture

The overall workflow of VaniScript AI is:

                         ┌─────────────────┐
                         │      User       │
                         └────────┬────────┘
                                  │
                                  ▼
                         ┌─────────────────┐
                         │ Login / Signup  │
                         │   AWS Amplify   │
                         └────────┬────────┘
                                  │
                                  ▼
                    ┌─────────────────────────┐
                    │ Record / Upload Audio  │
                    └────────────┬────────────┘
                                 │
                                 ▼
                         ┌─────────────────┐
                         │   Amazon S3     │
                         │ Audio Storage   │
                         └────────┬────────┘
                                  │
                                  ▼
                         ┌─────────────────┐
                         │ Amazon Transcribe│
                         │ Speech-to-Text  │
                         └────────┬────────┘
                                  │
                                  ▼
                         ┌─────────────────┐
                         │    Transcript   │
                         └────────┬────────┘
                                  │
                                  ▼
                         ┌─────────────────┐
                         │ Amazon Bedrock  │
                         │  AI Generation  │
                         └────────┬────────┘
                                  │
                                  ▼
                    ┌─────────────────────────┐
                    │ Generated Social Media  │
                    │       Content           │
                    └────────────┬────────────┘
                                 │
                 ┌───────────────┼────────────────┐
                 │               │                │
                 ▼               ▼                ▼
          ┌────────────┐  ┌─────────────┐  ┌─────────────┐
          │ Hashtags   │  │ Virality    │  │ AI Rewriter │
          │ Generator  │  │ Score       │  │             │
          └────────────┘  └─────────────┘  └─────────────┘
                                 │
                                 ▼
                         ┌─────────────────┐
                         │ Smart Scheduling│
                         └────────┬────────┘
                                  │
                                  ▼
                         ┌─────────────────┐
                         │   DynamoDB      │
                         │ Saved Content   │
                         └─────────────────┘

🔄 Application Workflow

1. Authentication

The user creates an account or logs in using the authentication system powered by AWS Amplify.

OTP verification is used as part of the authentication process.

2. Voice Input

After authentication, the user can record a voice note or upload an existing audio file.

3. File Storage

The uploaded audio is sent to Amazon S3, which acts as the cloud storage layer for the audio files.

4. Transcription

The stored audio is processed using Amazon Transcribe.

The audio is converted into text, producing the transcript that will be used for content generation.

5. AI Content Generation

The transcript is sent through the backend and processed using Amazon Bedrock.

The AI generates content based on the user's input and the selected social media platform or content requirements.

6. Content Enhancement

The generated content can then be enhanced using additional features such as:

Hashtag generation
Virality score prediction
AI rewriting
Trending topic generation
Smart scheduling

7. Save Content

Users can save generated posts.

The application stores persistent content data in Amazon DynamoDB.

8. Scheduled Content

Users can specify scheduling information, and the application parses and displays the scheduled content.

Currently, the application does not directly publish posts to third-party social media platforms because of platform-specific API restrictions and permissions.

🛠️ Tech Stack

Frontend

React
TypeScript
Vite
Tailwind CSS
Material UI

Backend

Node.js
Express.js

AWS Services

AWS Service	Purpose
AWS Amplify	User authentication and OTP verification
Amazon S3	Audio/file storage
Amazon Transcribe	Speech-to-text conversion
Amazon Bedrock	AI-powered content generation
Amazon DynamoDB	Persistent application and content storage

🚀 Installation

Prerequisites

Make sure the following are installed:

Node.js
npm
Git
AWS account
Required AWS services configured

1. Clone the Repository

git clone <repository-url>

Navigate into the project:

cd VaniScript

2. Install Frontend Dependencies

npm install

3. Configure Environment Variables

Create the required .env files for the frontend and backend.

Example:

AWS_REGION=your-region
AWS_ACCESS_KEY_ID=your-access-key
AWS_SECRET_ACCESS_KEY=your-secret-key
AWS_S3_BUCKET=your-bucket-name

Add any additional environment variables required by the application.

Important: Never commit AWS credentials, API keys, or other secrets to GitHub.

4. Install Backend Dependencies

Navigate to the backend directory:

cd backend

Install dependencies:

npm install

5. Start the Backend

node index.js

The backend server will start on the configured port.

6. Start the Frontend

Open another terminal and navigate back to the project root:

cd ..
npm run dev

The Vite development server will start and provide a local URL.

📊 Data Flow

Audio Input
     │
     ▼
Amazon S3
     │
     ▼
Amazon Transcribe
     │
     ▼
Transcript
     │
     ▼
Node.js / Express Backend
     │
     ▼
Amazon Bedrock
     │
     ▼
Generated Content
     │
     ├──────────────► Hashtags
     │
     ├──────────────► Virality Score
     │
     ├──────────────► AI Rewriting
     │
     ├──────────────► Trending Topics
     │
     └──────────────► Smart Scheduling
                         │
                         ▼
                    DynamoDB

🌍 Multilingual Content Generation

One of the primary goals of VaniScript is to make content creation accessible from regional and multilingual voice input.

Instead of requiring users to manually type their ideas in English, users can express their thoughts through voice.

The application then:

Regional / Multilingual Voice
            ↓
      Speech-to-Text
            ↓
        Transcript
            ↓
      AI Processing
            ↓
   Social Media Content

This allows users to move from a spoken idea to publish-ready content with minimal manual effort.

🔮 Future Improvements

The following features can be added in future versions:

🎨 AI Image Generation — Generate images matching the generated social media content
📊 Advanced Analytics Dashboard — Track content performance and engagement
👥 Multi-user Collaboration — Allow teams to collaborate on content
🌐 Expanded Social Media Integration — Integrate with additional platforms where APIs and permissions allow
📱 Mobile Application — Extend VaniScript to Android and iOS
🌍 Expanded Language Support — Add support for more regional and international languages
📈 Improved Virality Prediction — Train models using larger engagement datasets

Name		Name	Last commit message	Last commit date
backend		backend
frontend		frontend
.gitignore		.gitignore
README.md		README.md

Latest commit

History

Folders and files

Repository files navigation