Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Question mAP and FPS #2

Open
wenjun90 opened this issue May 6, 2020 · 3 comments
Open

Question mAP and FPS #2

wenjun90 opened this issue May 6, 2020 · 3 comments

Comments

@wenjun90
Copy link

wenjun90 commented May 6, 2020

Dir sxhxliang,

Could I ask you the mAP and FPS you obtain with detectron_efficientNet on COCO dataset?

Thank you

@sxhxliang
Copy link
Owner

build_fcos_efficientnet_fpn_backbone
epoch:6
batchsize:8
gpus:4
coco results:

AP AP50 AP75 APs APm APl
29.017 45.281 30.911 16.333 31.203 38.439

@wenjun90
Copy link
Author

wenjun90 commented May 6, 2020

Could you share me FPS ou prediction time, please?
Thank you so much.

@sxhxliang
Copy link
Owner

sorry, I have no time to do this, it is easy to measure the speed and you can test the model yourself.

def compute_speed(model, input_size, device, iteration):
    print('input_size', input_size)
    torch.cuda.set_device(device)
    torch.backends.cudnn.benchmark = True

    model.eval()
    model = model.cuda()

    input = torch.randn(*input_size).cuda()

    for _ in range(10):
        model(input)

    print('=========Speed Testing=========')
    torch.cuda.synchronize()
    torch.cuda.synchronize()
    t_start = time.time()
    for _ in range(iteration):
        model(input)
    torch.cuda.synchronize()
    torch.cuda.synchronize()
    elapsed_time = time.time() - t_start
    print(
        'Elapsed time: [%.2f s / %d iter]' % (elapsed_time, iteration))
    print('Speed Time: %.2f ms / iter    FPS: %.2f' % (
        elapsed_time / iteration * 1000, iteration / elapsed_time))

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants