6634d236bf
* wip * integrating smart-scrape * integrate smartscrape into llmExtract * wip * smart scrape multiple links * fixes * fix * wip * it worked! * wip. there's a bug on the batchExtract TypeError: Converting circular structure to JSON * wip * retry model * retry models * feat/scrape+json+extract interfaces ready * vertex -> googleapi * fix/transformArrayToObject. required params on schema is still a bug * change model * o3-mini -> gemini * Update extractSmartScrape.ts * sessionId * sessionId * Nick: f-0 start * Update extraction-service-f0.ts * Update types.ts * Nick: * Update queue-worker.ts * Nick: new interface * rename analyzeSchemaAndPrompt -> F0 * refactor: rename agent ID to model in types and extract logic * agent * id->model * id->model * refactor: standardize agent model handling and validation across extraction logic * livecast agent * (feat/f1) sdks (#1459) * feat: add FIRE-1 agent support to Python and JavaScript SDKs Co-Authored-By: hello@sideguide.dev <hello@sideguide.dev> * feat: add FIRE-1 agent support to scrape methods in both SDKs Co-Authored-By: hello@sideguide.dev <hello@sideguide.dev> * feat: add prompt and sessionId to AgentOptions interface Co-Authored-By: hello@sideguide.dev <hello@sideguide.dev> * Update index.ts --------- Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> Co-authored-by: hello@sideguide.dev <hello@sideguide.dev> Co-authored-by: Nicolas <nicolascamara29@gmail.com> * feat(v1): rate limits * Update types.ts * Update llmExtract.ts * add cost tracking * remove * Update requests.http * fix smart scrape cost calc * log sm cost * fix counts * fix * expose cost tracking * models fix * temp: skipLibcheck * get rid of it * fix ts * dont skip lib check * Update extractSmartScrape.ts * Update queue-worker.ts * Update smartScrape.ts * Update requests.http * fix(rate-limiter): * types: fire-1 refine * bill 150 * fix credits used on crawl * ban from crawl * route cost limit warning * Update generic-ai.ts * genres * Update llmExtract.ts * test server diff * cletu --------- Co-authored-by: rafaelmmiller <150964962+rafaelsideguide@users.noreply.github.com> Co-authored-by: Thomas Kosmas <thomas510111@gmail.com> Co-authored-by: Ademílson F. Tonato <ademilsonft@outlook.com> Co-authored-by: devin-ai-integration[bot] <158243242+devin-ai-integration[bot]@users.noreply.github.com> Co-authored-by: hello@sideguide.dev <hello@sideguide.dev> Co-authored-by: Gergő Móricz <mo.geryy@gmail.com>
37 lines
873 B
TypeScript
37 lines
873 B
TypeScript
import { Response } from "express";
|
|
import { supabaseGetJobByIdOnlyData } from "../../lib/supabase-jobs";
|
|
|
|
export async function scrapeStatusController(req: any, res: any) {
|
|
const allowedTeams = [
|
|
"41bdbfe1-0579-4d9b-b6d5-809f16be12f5",
|
|
"511544f2-2fce-4183-9c59-6c29b02c69b5",
|
|
"1ec9a0b3-6e7d-49a9-ad6c-9c598ba824c8",
|
|
];
|
|
|
|
if (!allowedTeams.includes(req.auth.team_id)) {
|
|
return res.status(403).json({
|
|
success: false,
|
|
error: "Forbidden",
|
|
});
|
|
}
|
|
|
|
const job = await supabaseGetJobByIdOnlyData(req.params.jobId);
|
|
|
|
if (
|
|
!allowedTeams.includes(job?.team_id) ||
|
|
job?.team_id !== req.auth.team_id
|
|
) {
|
|
return res.status(403).json({
|
|
success: false,
|
|
error: "You are not allowed to access this resource.",
|
|
});
|
|
}
|
|
|
|
const data = job?.docs[0];
|
|
|
|
return res.status(200).json({
|
|
success: true,
|
|
data,
|
|
});
|
|
}
|