I am a staff applied research scientist at Snorkel AI, working on LLM research.
Before this, I was at Jasper.ai, where I built and fine tuned large language models on Jasper data, worked closely with Product to integrate AI and evaluated and led some of Jasper's LLM partnerships. I led the AI solution development for Jasper Brand Voice. I created an LM-evaluation-harness (on top of EAI's LM harness) to evaluate LLMs on marketing content use-cases, and created custom metrics to support it.
Prior to that, I was a lead data scientist at Fractal.ai, where I led a team working on natural language processing and text mining problems, for industry, and applied research. Prior to that, I was a Technology Lead at Infosys, and part of the Machine Learning Center of Excellence.
I have a Masters in CS, with a specialization in Machine Learning from Georgia Institute of Technology.
I received my Bachelor's degree in Computer Engineering from PCCE, Goa.
Research interests
In the past few months, I have been involved in researching ways to build effective reward models and evaluate LLMs effectively on real-world use cases.
My other interests lie in Reinforcement Learning, Imitation Learning and Generalization. I am also motivated in the diagnosis of models, and policies.