Job Description

Senior Data Scientist/AI Engineer

Update: Role is Hybrid and will require 3 Days onsite and 2 Days remote.

Location: Atlanta, GA

Must-Have Experience:

Candidates must have:

1. Production deployment of a Gen AI system in a professional environment.
2. RAG pipelines experience.
3. Fine-tuning language models for Gen AI applications.

***Screening questions to ask candidates during our interview***

1. Can you provide examples of Gen AI based solutions that you have built?

Check that candidate has used latest GenAI models, built solutions using RAG based approaches, chatbots, information extraction, question answering based solutions.

1. Have you tuned language models for GenAI applications? What techniques did you use? See if they finetuned any model, they used techniques such as loRA, qlora, peft.
2. Describe your experience with prompt engineering. How have you optimized prompts to get desired outputs from large language models?

What kind of prompt engineering techniques have they used, zero shot, few shot, chain of thought, react, etc

1. What types of vector databases have you used to power GenAI applications?

Candidates have used vector databases such as pinecone, chroma, qdrant, opensearch, mongo vector db, elastic vector db, fiass

1. How have you evaluated the performance and safety of your GenAI solutions? Check for What metrics did you use, and how did they validate the outputs. Do they mention metric such as ROUGE, BLUE, F1 score, groundedness, faithfulness, answer relevancy, context relevancy etc
2. Have you deployed GenAI models to production environments? Have experience deploying these solutions, built APIs around the model. We want candidate who has experience putting these models in production not just worked on a POC

Job Tags

Similar Jobs