Search results

Limit container resources

Status: Open.

#22 In fooock/robots.txt;

· fooock opened on Jul 19, 2019

Auth based in JWT

Status: Open.

#20 In fooock/robots.txt;

· fooock opened on Jul 15, 2019

Rate limit for the checker API

Status: Open.

#19 In fooock/robots.txt;

· fooock opened on Jul 11, 2019

Strategy to crawl robots from ftp 55D4 scheme

Status: Open.

#13 In fooock/robots.txt;

· fooock opened on Jul 5, 2019

Check disallow typos?

Status: Open.

#8 In fooock/robots.txt;

· fooock opened on Jul 2, 2019

Use HTTP headers to control host rule expiration

Status: Open.

#5 In fooock/robots.txt;

· fooock opened on Jun 30, 2019

Implement robots.txt download priority system

enhancementNew feature or requestNew feature or request

Status: Open.

#4 In fooock/robots.txt;

· fooock opened on Jun 30, 2019