Scaling Innovation: From Data Lakes to LLMs—Redefining Enterprise IT at Scale

Vivek Prasanna Prabu is a Staff Software Engineer at Cloudera, where he leads key initiatives focused on rethinking the architecture, scalability, and security of enterprise data systems. With nearly two decades of experience in the IT industry, his work bridges the fields of cloud engineering, artificial intelligence, cybersecurity, and systems architecture.

At Cloudera, he has been instrumental in developing cloud-native infrastructure solutions adopted by some of the world’s largest enterprises. His focus on platform-agnostic design has enabled seamless deployment across AWS, Azure, and GCP. He is widely recognized for his ability to resolve large-scale performance and availability issues, particularly within environments involving data lakes, distributed systems, and intensive log processing.

One of his notable contributions is the design of a vertical scaling framework that enables live resizing of compute and storage resources without downtime. This solution is now embedded in Cloudera’s enterprise offerings and has helped clients reduce operational costs by a significant margin.

Prabu has also driven forward Cloudera’s AI-based security innovation, creating a CVE mitigation platform powered by Retrieval-Augmented Generation (RAG) and fine-tuned language models. This platform can autonomously generate remediation strategies for vulnerabilities, even in the absence of existing fixes.

Beyond his contributions to product development, he remains actively engaged with the broader research and engineering community. He has authored over 17 whitepapers covering areas such as cloud scaling, AI in security, predictive analytics, and data optimization. His research has influenced both internal architecture at Cloudera and broader industry standards.

His career reflects a dedication to building intelligent, resilient, and scalable systems, positioning him as both a technical leader and an advocate for innovation in enterprise technology.