Ram

software engineer || tech enthusiastic || front end developer || mobile developer

[Ashish Kushwaha @ashishllm]

If I had 1 month to build my Portfolio Project which will get me hired as an AI RAG Engineer, I would do these, starting from basics to advance:

1) Build your vectordb: Arrange a dataset with thousands of unstructured files. You can get it from any open source repository or platform. Now before chunking, you choose type of vectordb you require. Do you need a dedicated vectordb or pg vector extension? This should be a business impact based decision. If you need Vectordb + Crud operations in one database then go with pgvector extension. If you don't have crud operations in your business and require a high scalable vectordb then go with a dedicated vectordb.

2) Engineer the chunking strategy: The first and foremost strategy of any RAG pipeline is chunking. There are various types of chunking strategies like paragraph chunking, paragraph with overlap chunking, document layout aware based chunking, LLM based reasoning chunking, etc.
For the files which contains text + images + tables, you can opt for either document layout aware based chunking or build a pipeline to process three different chunking for this three different requirements.

3) Build and Evaluate your first retriever like a real engineer: Choose your retriever strategy, either it could be semantic or keyword based or both. Now question is how you gonna choose? It could be usecase wise too, if that dataset has some keywords which is hard to retrieve semantically then use hybrid approch. In interview they will ask how do you know that semantically it will be harder to fetch those?? To answer this question like a True Real Engineer, you do experiments with this two different retriever strategies semantic vs hybrid. You take 1 eval dataset, and example queries, and give those examples queries to retrieval to fetch chunks from vectordb and then you evaluate those chunks with eval dataset with metrices like Precision, Recall, MRR, Hitrate, Context Recall and Context Relevance. Now you make decisions based on this.

4) Choose LLM like a real engineer: In interview, they will ask why you chose that xyz specific model when alot of options where already there? How you gonna answer??? For that, you need to answer it in layers. First layer is resource constraint. You could choose gpt-3.5 or even gpt-5.5, and the very practical decision is based on cost vs accuracy tradeoffs. You can legit say that i chose gpt-3.5 as in my rag pipeline, even though universally we all know gpt-5.5 is better in terms of accuracy, but the cost is a big constraint. This is a legit explanation. Now interviewer might ask you that in the cost range of gpt-3.5, you have many models then why only gpt-3.5, then there to answer that, you do experiments with 3-4 models by taking eval dataset, and comparing with the answers these models generate, and log their metrices like Faithfulness, Groundness, Answer relevancy, and we can have these metrics evaluated by LLM as a judge or Human Evaluation. And then you say that i found gpt-3.5 metrics better than other 3 models so I chose that.

5) Parameters and hyperparameters: In short, you need to build intutions with experiments. When interviewer ask that why did you choose top-k=3 in llm generation part, or temperature=2, then you better answer it with evidences.

6) Deploy in AWS or Azure and practise system design concepts there. Try load testing and see if your vectordb is handling load, monitor the logs, increase load again and log the metrices. Play around, some will break, fix and debug.

The more your decisions are grounded, the more you are closer to real engineering. Otherwise you are just another vibe coder who don't understand a shitt in depth.

⭐ Save. Repost. Follow

[Pratham @Prathkum]

Learn important web development concepts for free:

• Git → https://t.co/x644UaqYat

• HTTP → https://t.co/exyWL5pNYs

• DNS → https://t.co/68tYdKAQE9

• JavaScript → https://t.co/zTPnjx7nIx

• SQL → https://t.co/69jSBmUzTe

• DS, Algo → https://t.co/Xu7gv847nE

[Elon Musk @elonmusk]

If you don’t like reality, just ignore it

[Mind Yeti @yeti_mind]

Focus on improving yourself, not proving yourself.

[Oskar @o_kwasniewski]

React Native will soon be a Monorepo! There is an open PR with migration 🚀

It's still a work in progress, currently at 3,763 files changed 🤯

Check it out here: https://t.co/TsghvreJZ8

[Marko Denic @denicmarko]

Stop wasting time doing everything from scratch.

Here are 7 CSS generators that will save you hours of work:

[Nikki Siapno @NikkiSiapno]

GitHub is an absolute goldmine of quality learning resources.

Here are 7 programming repos you'll wish you knew sooner:

[Adam | YouTube @Adam_DelDuca]

21 lessons from 5 years on YouTube (and $250,000+ generated):

- Thread -

[Ram @jscodemachine]

It's been 10 years journey with Twitter as a user. Thanks @Twitter for everything that I've learned from you!

[Adam | YouTube @Adam_DelDuca]

How to make $10,000/month on YouTube in 2023 as a beginner

(Starting with only $20)

- Thread -

[Hasan Toor @hasantoxr]

Want to master Data Structure and Algorithms.

Here're 5 websites to learn Data Structure and Algorithms easy & FREE:

[Ujjwal Chadha @ujjwalscript]

Land a top tier software developer job in 5 steps:

[Marko Denic Tech @markodenictech]

JavaScript tip:

Use Web Speech API to create a Text-to-Speech functionality.

[Ram @jscodemachine]

@smileguptaaa Did u recover from spondylosis,

[Pratham @Prathkum]

@csaba_kissi @harperdbio Yeah it awesome! I have created a project using HarperDB as my database.

[Danny Thompson @DThompsonDev]

Your end goal will never make you completely happy. Once you hit it, you will immediately move the goal posts.

It is the person you become along the way! That is where you will learn the most about yourself. THAT is where you will find your happiness.

[Ram @jscodemachine]

@RGVzoomin Just simply

[Vilva Athiban @vilvaathibanpb]

It's my turn to be positive(COVID).

Guys who wanted to register for my Storybook workshop. I am diagnosed Covid positive and hence couldn't send invites.

The workshop might get postponed to Feb as well. Sorry for the delay. Will keep you guys posted once I recover

[Ram @jscodemachine]

@_syadav @aakansha1216 @react_india Do we have recordings of the session