Major Life Insurance Company: RAG System Development Support
Global Consulting Firm
Overview
Comprehensively responsible for technical guidance and application development support, with the goal of internalizing the client AI development and nurturing talent. Led the design and development of a high-precision internal document search AI system adopting RAG (Retrieval Augmented Generation) architecture on Microsoft Azure, achieving end-to-end production deployment to a private environment meeting enterprise-grade security requirements.
Architecture
Implemented customizations based on the Azure official reference implementation (azure-search-openai-demo) to meet financial industry-specific requirements. Built frontend with React/TypeScript and adopted Python (Quart async framework) for backend. Implemented a multi-stage search pipeline combining vector search, hybrid search, and semantic ranker with Azure AI Search to maximize search accuracy.
Built a structured analysis pipeline for PDF/Word/Excel documents using Azure Document Intelligence as document processing infrastructure. Automated index updates through Integrated Vectorization, seamlessly connecting document uploads to Azure Blob Storage to searchable state.
Security & Infrastructure
Designed and implemented a fully private network configuration using Azure Private Endpoint and Virtual Network to comply with financial institution security requirements. Adopted container-based deployment with Azure Container Apps, achieving auto-scaling and high availability. Built authentication/authorization infrastructure integrated with Microsoft Entra ID, implementing user-level access control.
Built secret management with Azure Key Vault and comprehensive log analysis infrastructure with Application Insights. Implemented operational monitoring dashboards with KQL queries linked to Azure Log Analytics, establishing an environment enabling continuous evaluation and improvement of response quality.
Technology Transfer & Training
Systematically lectured on knowledge required for AI development, from web development basics (HTML/CSS/JavaScript) to Python programming and cloud architecture. Introduced modern development practices including version control with Git/GitHub and establishing code review culture utilizing Pull Requests.
Introduced agile development methodology (Scrum) and established iterative development cycles with 2-week sprints. Improved overall team development productivity and autonomy through Daily Standup meetings.