NLP-driven Automated Compliance Reporting with ELK Stack

Description

The project focuses on setting up compliance logging using Logstash, Elasticsearch, and NLP techniques. It involves configuring Logstash to process logs, extracting compliance-related data (such as PII, encryption, and GDPR mentions) using spaCy, and integrating the processed logs into Elasticsearch for analysis. The goal is to automate compliance monitoring and enhance log intelligence with AI-powered text extraction.

Languages and Utilities Used

• Python & Java
• Logstash, Elasticsearch, Kibana (ELK Stack)
• NLP
• spaCy
• Crontab
• AWS
• Ubuntu

Project Walk-through

Set Up Elasticsearch, Logstash, & Kibana


Implement Logging


Use NLP for Compliance Extraction


Store & Visualize Logs


Automate Monitoring