agentic search rightly gets a lot of hype, but a lot of the value and equally interesting problems at scale is (agentic) index creation
ie. organize data (tags, embeddings, clusters) so a good search process can even surface the right thing
it’s magic when you ping Parallel or Exa and their agent neatly returns content for our agent
but before that they do tons of data tagging (which allows filtering by keywords), tuned embeddings (which are cool again?), efficiently indexed for speed, and created a good hybrid search strategy
so much in the weeds work has to go in to make something searchable. this new wave of “grep” local search tools try to take the index burden off the user
i’m all for better search tools so if they work with our local code i’m all for it, dynamically indexing code and exposing hybrid/agentic search over it is hard with lots of little design choices but if it’s better than normal grep/glob by some margin, that means our agents get better context —> huge balue tradeoff
building agents and harnesses, prev @awscloud, phd cs @ temple