Snowflake-Labs/openflow-unstructured-data-pipeline-demo

Snowflake-Labs/openflow-unstructured-data-pipeline-demo

Description: Unstructured Data Pipeline processing and Cortex Integration Demo

Language: JavaScript

License: NOASSERTION

Stars: 1

Forks: 1

Open issues: 0

Created: 2025-09-24T12:02:34Z

Pushed: 2025-10-28T11:53:45Z

Default branch: main

Fork: no

Archived: no

README:

Unstructured Document Intelligence Demo

*Powered by Snowflake Openflow and Cortex*

Transform your Google Drive business documents into actionable strategic intelligence with the complete Openflow → Cortex Search → Snowflake Intelligence pipeline.

🚀 [→ Access Full Documentation Site](https://snowflake-labs.github.io/openflow-unstructured-data-pipeline-demo)

*Complete setup guides, business-focused demos, and step-by-step tutorials*

> ⚠️ IMPORTANT PREREQUISITE: This demo requires Snowflake Openflow, which is currently available only > for Enterprise accounts as BYOC (Bring Your Own Cloud) or SPCS (Snowpark Container Services) > Public Preview. Contact your Snowflake account team to enable Openflow access.

🚀 Executive Summary

This demonstration showcases how Snowflake Intelligence with Cortex Search transforms unstructured business documents from Google Drive into queryable strategic intelligence through Openflow data processing.

Business Impact: Convert scattered business documents (PDFs, presentations, Word docs, images) into a unified intelligence platform that executives can query in natural language to make data-driven decisions.

ROI Highlight: Enable non-technical business users to extract insights from documents without SQL knowledge, reducing time-to-insight by 90% and democratizing access to organizational knowledge.

---

🌟 What This Demo Provides

Complete Documentation Site

📖 [Professional Documentation](https://snowflake-labs.github.io/openflow-unstructured-data-pipeline-demo) with:

• Setup Guides - Prerequisites, database setup, Openflow configuration
• Business Demos - 4 category-specific presentations ready for different audiences
• AI Integration - Snowflake Intelligence agent setup for conversational queries
• Reference Materials - Sample questions, commands, troubleshooting

Business-Ready Demo Categories

| Demo Category | Target Audience | Business Focus | |------------------|-------------------|------------------| | 🎯 Strategic Planning | C-level executives, board members | Investment decisions, market expansion | | 🔧 Operations Excellence | Operations managers, tech leaders | Process optimization, modernization | | ⚖️ Compliance & Risk | Compliance officers, audit teams | Policy enforcement, regulatory adherence | | 📚 Knowledge Management | HR teams, training managers | Staff development, knowledge sharing |

[→ Browse All Demo Categories](https://snowflake-labs.github.io/openflow-unstructured-data-pipeline-demo/demos/)

Competitive Advantages

• ✅ Multi-Format Processing: PDF, DOCX, PPTX, JPG - all in one platform
• ✅ Natural Language Queries: "What are our 2025 expansion plans?" vs complex SQL
• ✅ Enterprise Security: Snowflake's enterprise-grade security for sensitive documents
• ✅ Scalable Intelligence: Handles thousands of documents with sub-second query response

🚀 Quick Start Options

Option 1: Full Documentation Experience (Recommended)

🌐 [Browse Complete Site](https://snowflake-labs.github.io/openflow-unstructured-data-pipeline-demo)

• Visual setup guides with screenshots
• Business-focused demo presentations
• Copy-pasteable sample queries
• AI integration tutorials

Option 2: Technical Quick Start

For experienced users who want immediate setup:

# Run the provided setup script
snow -f sql/setup.sql

What the setup script creates:

• ✅ Role: FESTIVAL_DEMO_ROLE with appropriate permissions
• ✅ Warehouse: FESTIVAL_DEMO_S for compute resources
• ✅ Database: OPENFLOW_FESTIVAL_DEMO for data storage
• ✅ Schema: FESTIVAL_OPS for organized data structure

Alternative - Manual SQL:

-- Or run these commands individually in your Snowflake worksheet
CREATE ROLE IF NOT EXISTS FESTIVAL_DEMO_ROLE;
CREATE WAREHOUSE IF NOT EXISTS FESTIVAL_DEMO_S;
CREATE DATABASE IF NOT EXISTS OPENFLOW_FESTIVAL_DEMO;
CREATE SCHEMA IF NOT EXISTS OPENFLOW_FESTIVAL_DEMO.FESTIVAL_OPS;

Next Steps:

1. 📋 [Prerequisites](https://snowflake-labs.github.io/openflow-unstructured-data-pipeline-demo/getting-started/prerequisites/) - Technical requirements 2. ⚡ [Quick Setup](https://snowflake-labs.github.io/openflow-unstructured-data-pipeline-demo/getting-started/quick-setup/) - 15-minute streamlined setup 3. 🔧 [Openflow Setup](https://snowflake-labs.github.io/openflow-unstructured-data-pipeline-demo/getting-started/setup-openflow/) - Connector configuration 4. 🎯 [Demo Categories](https://snowflake-labs.github.io/openflow-unstructured-data-pipeline-demo/demos/) - Business presentations

---

💡 Sample Capabilities

Once your pipeline is set up, you can ask questions like:

🎯 Strategic: "What are our 2025 expansion strategies and expected ROI?"
🔧 Operations: "Find all technology modernization projects and their budgets"
⚖️ Compliance: "Show me current health and safety policies"
📚 Knowledge: "What training materials are available for staff development?"

[→ Browse 50+ Sample Questions](https://snowflake-labs.github.io/openflow-unstructured-data-pipeline-demo/reference/sample-questions/)

🏗️ What Gets Built

End-to-End Architecture:

graph LR
A[📁 Google Drive] --> B[🔄 OpenFlow Pipeline]
B --> C[🔍 Cortex Search Service]
C --> D[🤖 Snowflake Intelligence]
D --> E[💬 Natural Language Queries]
E --> F[📊 Business Insights]

Core Components:

• ✅ Multi-format document processing (PDF, DOCX, PPTX, JPG)
• ✅ Automated Cortex Search service creation and indexing
• ✅ Business-focused demo categories for different stakeholders
• ✅ Optional AI agent for conversational document queries
• ✅ Production-ready setup with security and authentication

Executive Use Cases Demonstrated

1. Strategic Planning: *"What are our 2025 expansion plans and expected ROI?"*

• Result: Instant access to strategy documents, financial projections, board decisions

2. Operational Excellence: *"Show me all technology modernization projects and their...