Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

tranquility-server realtime(not creating merged beam) #282

Open
jwydecn opened this issue Aug 22, 2018 · 4 comments
Open

tranquility-server realtime(not creating merged beam) #282

jwydecn opened this issue Aug 22, 2018 · 4 comments

Comments

@jwydecn
Copy link

jwydecn commented Aug 22, 2018

2018-08-22 16:53:00,950 [ClusteredBeam-ZkFuturePool-e24324d4-4cf8-4472-998e-b99cdfd423bb] INFO c.m.tranquility.beam.ClusteredBeam - Global latestCloseTime[2018-08-22T08:00:00.000Z] for identifier[druid:overlord/test] has moved past timestamp[2018-08-22T08:00:00.000Z], not creating merged beam
2018-08-22 16:53:00,962 [ClusteredBeam-ZkFuturePool-e24324d4-4cf8-4472-998e-b99cdfd423bb] INFO c.m.tranquility.beam.ClusteredBeam - Turns out we decided not to actually make beams for identifier[druid:overlord/test] timestamp[2018-08-22T08:00:00.000Z]. Returning None.

task of segment2018-08-22T08:00:00.000Z in overload has killed, how can i retry it or new other?

@jwydecn jwydecn changed the title tranquility-server realtime tranquility-server realtime(not creating merged beam) Aug 22, 2018
@srggrs
Copy link

srggrs commented Sep 24, 2018

yeah I have the same issue

@eksantrik
Copy link

Have you guys been able to resolve this issue? I am getting the same problem and can't figure out whats causing this. I am watching overlord and middleManager logs and not seeing anything happening as tranquility drop the new messages.

@gianm
Copy link
Member

gianm commented Jan 29, 2019

Usually it happens if tranquility fails to create tasks for some reason, or if all the tasks die for a particular segmentGranularity time chunk. It often resolves when the next time chunk begins. Fwiw, Druid's native Kafka ingestion does not have this problem, if you are interested in checking that out.

@eksantrik
Copy link

I found some indexing logs under middleManager server:
index_realtime_log.log

According to this, there is an error: "Unable to find a region via the region provider chain. Must provide an explicit region in the builder or setup environment to supply a region".

I am installing Druid v0.13. Do you think this is related?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants