Hi Joe, your Synthetic Research website is broken if you try to use Gemini because it's pointing to an old model (text-embedding-004) which has been deprecated. The recommended replacement is gemini-embedding-001.
This is the error "Google Embedding API error (404): { "error": { "code": 404, "message": "models/text-embedding-004 is not found for API version v1beta, or is not supported for embedContent. Call ListModels to see the list of available models and their supported methods.", "status": "NOT_FOUND" } }"
The website was made in 5 minutes by Kimi2.5. I actually should probably check the content but I asked Kimi to make the website based on the paper, lol.
Ok, it works now but I'm not getting results. I tried 3 tests with 3 screenshots each. First test was with an old hyper casual game of mine. I got a 0 score for all 5 personas for download intent and ad effectiveness.
So I thought, perhaps my game just really sucked. So I tried with screenshots from Royal Match (test 2) and screenshots of Royal Match's current most effective ad from the FB ad library. Both tests also resulted in 0 scores.
Hi Joe, your Synthetic Research website is broken if you try to use Gemini because it's pointing to an old model (text-embedding-004) which has been deprecated. The recommended replacement is gemini-embedding-001.
https://ai.google.dev/gemini-api/docs/deprecations
This is the error "Google Embedding API error (404): { "error": { "code": 404, "message": "models/text-embedding-004 is not found for API version v1beta, or is not supported for embedContent. Call ListModels to see the list of available models and their supported methods.", "status": "NOT_FOUND" } }"
Hey Jordan, thanks for letting me know! Fixed. Also, now I added a cron job to check for when any model gets deprecated.
Well, I should say opus added the cron job, lol.
Thanks for the quick update. Did you set up an agentic flow to do this whole website?
The website was made in 5 minutes by Kimi2.5. I actually should probably check the content but I asked Kimi to make the website based on the paper, lol.
Oops, I'm now getting this error: "Cannot read properties of undefined (reading 'provider')"
Can you try it now? I think I didn't redeploy the API to pick up Gemini configs. Def appreciate you helping me debug!!!
Ok, it works now but I'm not getting results. I tried 3 tests with 3 screenshots each. First test was with an old hyper casual game of mine. I got a 0 score for all 5 personas for download intent and ad effectiveness.
So I thought, perhaps my game just really sucked. So I tried with screenshots from Royal Match (test 2) and screenshots of Royal Match's current most effective ad from the FB ad library. Both tests also resulted in 0 scores.
Super insightful 😎
Glad you found it useful!