Code

History

Commits on main to apps/api/src/services/queue-worker.ts35+
  1. Format api and add pre-commit hooks (ENG-3408) (#2088)tom committed 1 year agoc527796
  2. feat(api): propagate api_key_id towards billing function (#2049)Gergő Móricz committed 1 year ago4d45f3b
  3. fix(queue-worker): return URL instead of string for Windows file paths (#2036)tom committed 1 year agobbeabf7
  4. fixed error in worker queue (#2014)Jeel Rupareliya committed 1 year agof0ee591
  5. Revert "Merge pull request #1982 from firecrawl/mog/v2-queue-multiplex"Gergő Móricz committed 1 year ago0d4c0e0
  6. feat(api/worker): better queue selectionGergő Móricz committed 1 year ago105e7d3
  7. feat(api): queue multiplexingGergő Móricz committed 1 year ago23b0790
  8. feat(crawl-status): refactor (#1971)Gergő Móricz committed 1 year ago0dd3ac8
  9. MergeGergő Móricz committed 1 year agob7d7b8e
  10. feat(api): add OTEL everywhere (#1969)Gergő Móricz committed 1 year ago06a0198
  11. fix(queue-service): reduce redis connections to BullMQ (#1966)Gergő Móricz committed 1 year ago308e4f4
  12. Merge branch 'main' into nsc/v2Gergő Móricz committed 1 year ago21cbfec
  13. fix(queue-worker): turn off useWorkerThreads in sandboxed scrape worker (#1941)Gergő Móricz committed 1 year agobd5adfe
  14. fix(queue-worker): remove OTEL undici/http instrumentationsGergő Móricz committed 1 year ago392cb5f
  15. debug: log hits to liveness endpointsGergő Móricz committed 1 year ago5f4666b
  16. fix(queue-worker): disable cacheable lookup for liveness checkGergő Móricz committed 1 year ago904bba6
  17. fix(queue-worker): reduce concurrencyGergő Móricz committed 1 year ago797577e
  18. fix(queue-worker): remove misbehaving stall checkGergő Móricz committed 1 year agoa6fc5c3
  19. Revert "fix(queue-worker): decrease concurrency to avoid stalling other workers"Gergő Móricz committed 1 year ago1a98428
  20. fix(queue-worker): decrease concurrency to avoid stalling other workersGergő Móricz committed 1 year ago33bf7eb
  21. debug: turn off langfuse debugGergő Móricz committed 1 year ago06bd9d6
  22. debug: langfuseGergő Móricz committed 1 year ago22b4a9e
  23. feat: langfuse integration (#1928)Gergő Móricz committed 1 year ago908e977
  24. fix(queue-worker): lower pressure by doubling lock durationGergő Móricz committed 1 year ago3b25432
  25. fix: handle --max-old-space-size flag for worker threads (#1922)Josh-M42 committed 1 year ago75e3cd5
  26. fix(queue-worker): increases per-worker concurrencyGergő Móricz committed 1 year ago899c6b4
  27. feat(api/dx): add test harnessGergő Móricz committed 1 year ago634d391
  28. Update queue-worker.tsNicolas committed 1 year agocff8b2b
  29. fix: WORKER_PORTGergő Móricz committed 1 year ago2990f33
  30. Merge branch 'nsc/v2' of https://github.com/mendableai/firecrawl into nsc/v2Nicolas committed 1 year ago70af6aa
  31. feat(api): separate redis connections for scrape Queue, QueueEvents, and WorkerGergő Móricz committed 1 year ago9f0df42
  32. RM Multiplexer for nowNicolas committed 1 year ago5bf3316
  33. Reapply "feat(queue): split jobs 4 ways"Nicolas committed 1 year agoaad5de2
  34. Revert "feat(queue): split jobs 4 ways"Nicolas committed 1 year ago1842883
  35. Revert "Nick: increasing multiplexity"Nicolas committed 1 year ago5991fe0