Skip to content

Commit ec4a8c0

Browse files
committed
Updated README.md
1 parent 82ae8a0 commit ec4a8c0

7 files changed

+68
-26
lines changed

README.md

Lines changed: 68 additions & 26 deletions
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,7 @@
11
# JobAssist AI
22
**Empowering Coaches, Transforming Lives**
33

4-
[![Deployed on Azure](https://img.shields.io/badge/Deployed%20on-Azure-blue?logo=microsoft-azure)](https://jobassistai-dhbzhtbxerdwedhh.eastus2-01.azurewebsites.net/)
4+
![Deployed on Azure](https://img.shields.io/badge/Deployed%20on-Azure-blue?logo=microsoft-azure)
55
*Built for the Microsoft Innovation Challenge, March 2025*
66

77
---
@@ -14,8 +14,6 @@ By facilitating job matching in sectors such as retail, healthcare, IT, and manu
1414

1515
Developed as part of the **Microsoft Innovation Challenge in March 2025**, this Flask-based application harnesses Azure's advanced AI and cloud capabilities to address pressing real-world challenges. JobAssist AI reflects a commitment to inclusion, transforming it from an aspiration into actionable impact.
1616

17-
**[Try it live here!](https://jobassistai-dhbzhtbxerdwedhh.eastus2-01.azurewebsites.net/)**
18-
1917
---
2018

2119
## 🌟 The Problem We’re Solving
@@ -37,16 +35,16 @@ JobAssist AI redefines this landscape by automating repetitive tasks, centralizi
3735
- **How**: Azure AI Search and OpenAI analyze stored guidelines in Blob Storage.
3836
- **Impact**: Minimizes administrative stress, keeping the focus on clients.
3937

40-
### 2. Automated Documentation
41-
- **What:** Upload notes, receive polished reports.
42-
- **How:** Azure AI Document Intelligence extracts text, Azure OpenAI (GPT-4o) crafts HTML reports, and PDFs are stored in Blob Storage.
43-
- **Impact:** Reduces paperwork time significantly, freeing coaches for client advocacy.
44-
45-
### 3. Centralized Knowledge Base
38+
### 2. Centralized Knowledge Base
4639
- **What:** A comprehensive repository of strategies and contacts.
4740
- **How:** Coaches log insights into Azure Cosmos DB; Azure AI Search enables instant retrieval.
4841
- **Impact:** Preserves expertise, even as team members change.
4942

43+
### 3. Automated Documentation
44+
- **What:** Upload notes, receive polished reports.
45+
- **How:** Azure AI Document Intelligence extracts text, Azure OpenAI (GPT-4o) crafts HTML reports, and PDFs are stored in Blob Storage.
46+
- **Impact:** Reduces paperwork time significantly, freeing coaches for client advocacy.
47+
5048
### 4. Personalized Task Guidance
5149
- **What:** Detailed, step-by-step task guides customized for each client.
5250
- **How:** Azure OpenAI generates instructions; Azure Speech Services provides audio for accessibility.
@@ -67,9 +65,35 @@ JobAssist AI integrates a robust set of Azure services with a Flask frontend:
6765
- **Azure Functions**: Workflow automation.
6866
- **Azure Key Vault**: Secures sensitive credentials.
6967

70-
### System Architecture Diagram
68+
### System Architecture Diagrams
69+
70+
#### Overall System Architecture
71+
The following diagram provides a high-level overview of JobAssist AI’s architecture:
7172
![JobAssist AI System Architecture](docs/JobAssistAI-system-architecture.png)
7273

74+
#### Feature-Specific Architectures
75+
Below are detailed architecture diagrams for each key feature, illustrating their specific workflows:
76+
77+
- **AI Assistant**
78+
This diagram shows how Azure AI Search and Azure OpenAI work together to provide real-time answers to compliance questions by analyzing guidelines stored in Blob Storage.
79+
![AI Assistant Architecture](docs/JobAssistAI-system-architecture-ai-assistant.png)
80+
81+
- **Automated Documentation**
82+
This diagram illustrates the flow of handwritten notes through Azure AI Document Intelligence for text extraction, Azure OpenAI (GPT-4o) for report generation, and Blob Storage for storing the final PDFs.
83+
![Document Processing Architecture](docs/JobAssistAI-system-architecture-document-processing.png)
84+
85+
- **Centralized Knowledge Base**
86+
This diagram depicts how coaches log insights into Azure Cosmos DB, with Azure AI Search enabling instant retrieval for a comprehensive repository of strategies and contacts.
87+
![Knowledge Base Architecture](docs/JobAssistAI-system-architecture-knowledge-base.png)
88+
89+
- **Save Voice Insights**
90+
This diagram outlines the process of transcribing audio files, categorizing insights, and saving them in Azure Cosmos DB for AI-powered searches, supporting formats like WAV, MP3, OGG, and FLAC.
91+
![Save Voice Insights Architecture](docs/JobAssistAI-system-architecture-save-voice-insights.png)
92+
93+
- **Personalized Task Guidance**
94+
This diagram shows how Azure OpenAI generates step-by-step task instructions from user input, with Azure Speech Services providing audio output for accessibility.
95+
![Task Breakdown Architecture](docs/JobAssistAI-system-architecture-task-breakdown.png)
96+
7397
---
7498

7599
## 📂 Project Structure
@@ -105,24 +129,34 @@ JobAssistAI/
105129
## 🔧 Azure Functions Deep Dive
106130

107131
### `jobassistai-document-processing`
108-
**Purpose**: Turns handwritten notes into polished PDFs.
109-
- **Flow**: Extracts text → Generates HTML reports → Converts to PDF → Stores in Blob Storage.
110-
- **Diagram**: *[Insert architecture diagram here]*
132+
- **Purpose**: Turns handwritten notes into polished PDFs.
133+
- **Flow**: Extracts text → Generates HTML reports → Converts to PDF → Stores in Blob Storage.
111134
- **Details**: See [its README](azure-functions/jobassistai-document-processing/README.md).
112135

113136
### `jobassistai-http-trigger-openai`
114-
**Purpose**: Powers AI responses with OpenAI + optional Azure Search citations.
115-
- **Flow**: Takes user prompts → Fetches system prompts → Returns JSON responses.
116-
- **Diagram**: *[Insert architecture diagram here]*
137+
- **Purpose**: Powers AI responses with OpenAI + optional Azure Search citations.
138+
- **Flow**: Takes user prompts → Fetches system prompts → Returns JSON responses.
117139
- **Details**: See [its README](azure-functions/jobassistai-http-trigger-openai/README.md).
118140

119141
### `jobassistai-http-trigger-tts`
120-
**Purpose**: Converts text instructions to audio with Azure SpeechSDK.
121-
- **Flow**: Accepts JSON text → Outputs MP3 audio.
122-
- **Diagram**: *[Insert architecture diagram here]*
142+
- **Purpose**: Converts text instructions to audio with Azure SpeechSDK.
143+
- **Flow**: Accepts JSON text → Outputs MP3 audio.
123144
- **Details**: See [its README](azure-functions/jobassistai-http-trigger-tts/README.md).
124145

125-
*More functions (`save-insights`, `save-voice-insights`, `search-insights`) coming soon!*
146+
### `jobassistai-save-insights`
147+
- **Purpose**: Saves insights in Azure Cosmos DB for AI powered searches.
148+
- **Flow**: Accepts JSON text → Outputs response message in text format.
149+
- **Details**: See [its README](azure-functions/jobassistai-save-insights/README.md).
150+
151+
### `jobassistai-save-voice-insights`
152+
- **Purpose**: Transcribes the audio files, categorize text to insights (category and details) and save in Azure Cosmos DB for AI powered searches.
153+
- **Flow**: Accepts audio in `WAV`, `MP3`, `OGG` and `FLAC` format and returns response message in text format.
154+
- **Details**: See [its README](azure-functions/jobassistai-save-voice-insights/README.md).
155+
156+
### `jobassistai-search-insights`
157+
- **Purpose**: Converts natural language queries to embeddings and uses Azure AI Search & Azure OpenAI to retrieve relevant information.
158+
- **Flow**: Accepts search query in JSON format and returns relevant insights in JSON format.
159+
- **Details**: See [its README](azure-functions/jobassistai-search-insights/README.md).
126160

127161
---
128162

@@ -143,8 +177,8 @@ We’re committed to ethical AI. For a detailed look at how JobAssist AI upholds
143177
### Steps
144178
1. **Clone the Repo**
145179
```bash
146-
git clone https://github.com/yourusername/jobassistai.git
147-
cd jobassistai
180+
git clone https://github.com/harshitjain17/JobAssist-AI.git
181+
cd JobAssist-AI
148182
2. **Set Up Virtual Environment**
149183
```bash
150184
python -m venv venv
@@ -156,10 +190,18 @@ We’re committed to ethical AI. For a detailed look at how JobAssist AI upholds
156190
4. **Configure Environment Variables**
157191
Create a .env file in the root directory:
158192
```bash
159-
AZURE_STORAGE_CONNECTION_STRING="your_connection_string"
160-
AZURE_OPENAI_KEY="your_openai_key"
161-
AZURE_COSMOS_ENDPOINT="your_cosmos_endpoint"
162-
AZURE_SEARCH_KEY="your_search_key"
193+
AZURE_STORAGE_CONNECTION_STRING="your_connection_string" # Connection string for Azure Blob Storage
194+
AZURE_OPENAI_KEY="your_openai_key" # API key for Azure OpenAI to enable GPT-4o
195+
AZURE_COSMOS_ENDPOINT="your_cosmos_endpoint" # Endpoint URL for Azure Cosmos DB
196+
AZURE_SEARCH_KEY="your_search_key" # API key for Azure AI Search
197+
FUNCTION_HTTP_OPENAI_URL="" # URL for the Azure Function handling OpenAI-powered responses
198+
FUNCTION_HTTP_OPENAI_WITH_INDEX_URL="" # URL for the Azure Function handling OpenAI responses with Azure Search citations
199+
FUNCTION_HTTP_TEXT_TO_SPEECH_URL="" # URL for the Azure Function converting text to speech
200+
FUNCTION_SAVE_INSIGHTS_URL="" # URL for the Azure Function saving insights to Azure Cosmos DB
201+
FUNCTION_COSMOSDB_URL="" # URL for the Azure Function interacting with Azure Cosmos DB for data operations
202+
FUNCTION_SEARCH_INSIGHTS_URL="" # URL for the Azure Function handling search queries to retrieve insights
203+
SYSTEM_ROLE_TASKBREAKDOWN="taskbreakdown" # System role identifier for task breakdown feature to customize OpenAI behavior
204+
SYSTEM_ROLE_CHAT="chat" # System role identifier for chat feature to customize OpenAI behavior
163205
5. **Run Locally**
164206
```bash
165207
python app.py # Flask app
1.44 MB
Loading
1.41 MB
Loading
1.43 MB
Loading
1.41 MB
Loading
22 KB
Loading
639 KB
Loading

0 commit comments

Comments
 (0)