searching thru the .aep project directly in windows

Being able to search through .aep files directly in Windows would require Adobe and Microsoft to collaborate with each other. And that’s in my opinion a big deal and I don’t think it’s not going to happen unfortunately.
I’m almost certain that it’s impossible for someone who’s not Adobe to make a third-party software/script that could read .aep files and grab information from them.

I’d suggest you import all the projects you have into After Effects and save them all as a new project, so that you won’t have to import the projects every time you want to search for something, and opening the big project is much faster than importing all the projects. Also you can merge the big project and the project you’re working on together so that you don’t have to switch between projects and save your time.