Aditya Nalawade

Full stack developer | GenAI dev

[Aditya Nalawade @scriptSageAdi]

@AshutoshRai19o7 How many passages or rows you have embedded in you vector db?

[Aditya Nalawade @scriptSageAdi]

@coderhormaz @0xSohamm @247pmstudio @_prachii01 Cool

[Aditya Nalawade @scriptSageAdi]

@coderhormaz @0xSohamm @247pmstudio @_prachii01 Arre sir mujhe P50 latency janni thii , not just for some 2-3 queries or cached responses

[Aditya Nalawade @scriptSageAdi]

@Swarnim916 What's the retrieval latency you achieved?

[Aditya Nalawade @scriptSageAdi]

@Sitansh30967981 @247pmstudio What's the retrieval latency you achieved?

[Aditya Nalawade @scriptSageAdi]

@nishant_nair_05 @AtharvaIparkar @Slug790 @247pmstudio What's the retrieval latency you achieved?

[Aditya Nalawade @scriptSageAdi]

@coderhormaz @0xSohamm @247pmstudio @_prachii01 1 akda type karna tha bro , uske liye 3 lines type kardiye 😭

[Aditya Nalawade @scriptSageAdi]

@Anushkaaaxxn @247pmstudio FAISS is a library, not a DB — so this is likely just search() kernel time on a tiny cached subset, not real retrieval on 13.68M rows.

Not hating — just saying the number doesn't add up for a student project with standard hardware.

[Aditya Nalawade @scriptSageAdi]

@Anushkaaaxxn @247pmstudio To hit 0.09ms, you'd need:

· HBM2e-class memory (not student hardware)
· Aggressive PQ compression (accuracy tradeoff)
· Zero network/serialization overhead in measurement

[Aditya Nalawade @scriptSageAdi]

@Anushkaaaxxn @247pmstudio 0.09ms on 13.68M vectors with FAISS?

Quick math: At 768d FP32, that's ~42GB of raw vector data. Just reading that from system RAM at DDR4-3200 bandwidth (~25GB/s) takes ~1.7ms — and that's before any computation.

[Aditya Nalawade @scriptSageAdi]

@im_SParashar @247pmstudio What's the retrieval latency you achieved?

[Aditya Nalawade @scriptSageAdi]

@Sanskriti1430 @247pmstudio What's the retrieval latency you achieved?

[Aditya Nalawade @scriptSageAdi]

@Aditya_2456 What's the retrieval latency you achieved?

[Aditya Nalawade @scriptSageAdi]

@HarshKadiya19 @247pmstudio What's the retrieval latency you achieved?

[Aditya Nalawade @scriptSageAdi]

@PremnathRM @orewa_shyam_007 @SBharath200 What's the retrieval latency you achieved?

[Aditya Nalawade @scriptSageAdi]

@Swarnim916 What's the retrieval latency you achieved?

[Aditya Nalawade @scriptSageAdi]

@Aanchaljain_14 @harsh_0221 @AtharvaGhuge07 @247pmstudio What's the retrieval latency you achieved?

[Aditya Nalawade @scriptSageAdi]

@pranoooov_ What's the retrieval latency you achieved?

[Aditya Nalawade @scriptSageAdi]

@localhost_um79 @247pmstudio What's the retrieval latency you achieved?

[Aditya Nalawade @scriptSageAdi]

@willow687338101 What's the retrieval latency you achieved?